My company is preparing to start using KPI's, they asked to give ideas on how we will measure KPI's in our QA department.
They have a couple of levels in the Test Process that they want to monitor:
Then some for Customer:
- External customers
Do you have any ideas on what are good KPI's, that prove to work also?
Any ideas are welcome, I don't have much experience with the Key Performance Indicators and would like to hear of the one's that are used in reality and prove to work. Maybe with pro's/con's.
Customer use of product
Projects within budget
Projects on schedule
Number of quality issues
Time to market
Projects supporting strategy
Degree of project risk
Learning and Growth Measures:
Training time per employee
Information system availability
Life should NOT be a trip to the grave with the intention of arriving safely in an cool and well preserved body, but rather to skid in, chocolate in one hand, beer in the other, body wrecked, totally worn out and screaming WOO HOO what a ride!
On Test Process, you can plot bug find rates over time.
The results can be interpreted in various ways but generally a smooth curve declining toward zero is 'good'. This would indicate most of the defects were found earlier rather than later and a consistent discovery process was being applied.
A curve with huge swings up and down or that goes up toward the end rather than down may be indicative of a poorly designed or executed test plan. [exceptions abound of course, this is just a general idea]
To translate to KPIs, you can pick measures like 2/3 of the defects are found during the first 1/3 of the schedule or what have you. It may be useful to separate out severity levels. So then you can have say 95% of the critical defects are found during the first 1/2 of the schedule and low level defects were found consistently throughout indicating an appropriate lower degree of attention was applied to them. There's a lot of different ways to think about it to come up with KPI's.