Thanks:  0
Likes:  0
Dislikes:  0

1. ## Test efficiency?

Hi,

wat is the formula for test effieciency???

Thanks,
pramod.

2. ## Re: Test efficiency?

Traceability metrics can give you an insight on this. You can search for forums for a topic on Traceability Metrics.

3. ## Re: Test efficiency?

Sumit, while traceability might tell you something about coverage, it tells you nothing about efficiency.

Pramod, there is no magic formula that can tell you about test efficiency. It involves coverage, as Sumit mentioned (but which involves more than traceability to requirements), reusability, automation, and a number of other factors.

For example, I can attain a high degree of test efficiency with no specifications, hence no traceability.

I can expand the test base from 10% coverage to 95% coverage; the testing itself will take 9 times longer; have I achieved efficiency? What if it is for code that is rarely changed and the extra 85% coverage never finds any errors?

I switch testers on a given bank of tests and the new resource takes 4 times longer to execute the test bank. How efficient are my tests?

Etc...

- Linda

4. ## Re: Test efficiency?

Test Efficiency is nothing but Test Coverage. After creating the test cases, preform a review for the same and make sure you have covered all possible combinations to test that perticular peace of code.

5. ## Re: Test efficiency?

[ QUOTE ]
Test Efficiency is nothing but Test Coverage. After creating the test cases, preform a review for the same and make sure you have covered all possible combinations to test that perticular peace of code.

[/ QUOTE ]

How does that tell you how efficient your testing is?

Assume I take 20 years to create test cases for every possible combination would that make me efficient?

Efficiency and Coverage are different things.

6. ## Re: Test efficiency?

Formula for Test Case Efficiency is

Test Case Efficiency = (Number of Test Cases Failed / Total Number of test cases executed)* 100

This metric expresses the ratio of test cases failed to the total number of test cases executed and is expressed as a percentage.

7. ## Re: Test efficiency?

So if all the tests passed, the Test Case Efficiency is zero. I think not!

8. ## Re: Test efficiency?

Adapa - you have shot twice and missed each time.

Efficiency is NOT about test coverage. Nor is it the failure rate of tests (which you have given the formula for).

Efficiency has to do with minimizing the cost to uncover defects. Based on that, a much closer formula would be:

Test efficiency = (number of defects discovered) / (number of tests run). Maximizing the numerator and/or minimizing the denominator gives maximum efficiency.

This is not the only forumla for test efficiency that I have seen, but it is one measure. Another forumla I have seen is:

Test efficiency = (number of defects eliminated after a test run) / (population of remaining defects)

9. ## Re: Test efficiency?

Darrel, how can you measure efficiency by even using defects uncovered? Wouldn't that be a measurement of development efficiency? How can a test case be less efficient, by your measure, if there are fewer defects to find? How about Number of defects/LOC?
Somethings does not ring true here!

10. ## Re: Test efficiency?

#### Posting Permissions

• You may not post new threads
• You may not post replies
• You may not post attachments
• You may not edit your posts
•
Search Engine Optimisation provided by DragonByte SEO v2.0.36 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.