CI failure percentage of master branch over 28 days

 Foreword

The following figure represents the CI failure percentage average over a one hour interval for the last 28 days.

The success/failure ratio id measured from the last finished job on each interval which, considering the length of most pipelines, is likely to be unique in this time interval. The granularity of this graph is 1 hour.

 Observations

We notice that the failing pipeline ratio is much higher outside weekdays work hours (7:00-19:00, Monday-Friday).

As many pipelines are triggered over the working hours by the teams, it is suspected that some of the failing jobs are schedulded ones. But again, further data is needed to characterise what is causing so many failed pipelines.

And overall, the failure percentage never reaches less than 12% at any time and is mostly located around 15-55% during working hours.