Now that we have a better process for taking action on Talos alerts and pushing them to resolution, it is time to take a step back and see if any trends show up in our bugs.
First I want to look at bugs filed/week:
This is fun to see, now what if we stack this up side by side with the alerts we receive:
We started tracking alerts halfway through this process. We show that for about 1 out of every 25 alerts we file a bug. I had previously stated it was closer to 1/33 alerts (it appears that is averaging out the first few weeks).
Lets see where these bugs are filed, here is a view of the different bugzilla products:
The Testing product is used to file bugs that we cannot figure out the exact changeset, so they get filed in testing::talos. As there are almost 30 unique components bugs are filed in, I took a few minutes to look at the Core product, here is where the bugs live in Core:
Now that I know where the bugs are, here is a view of how long the bugs stay open:
The fantastic news is most of our bugs are resolved in <=15 days! I think this is a metric we can track and get better at- ideally closing all Talos regression bugs in <30 days.
Looking over all the bugs we have, what is the status of them?
Yay for the blue pacman! We have a lot of new bugs instead of assigned bugs, that might be something we could adjust and assign owners once it is confirmed and briefly discussed- that is still up in the air.
The burning question is what are all the bugs resolved as?
To me this seems healthy, it is a starting point. Tracking this over time will probably be a useful metric!
In summary, many developers have done great work to make improvements and fix patches over the last 6 months that we have been tracking this information. There are things we can do better, I want to know-
What information provided today is useful to track regularly?
Is there something you would rather see?