The online community for software testing & quality assurance professionals
Calendar   Today's Topics

Lost Password?


Quality Engineering >> Estimation and Planning

Pages: 1
Junior Member

Reged: 04/05/06
Posts: 14
Loc: Sweden
Exit criteria with % of test cases run or failed?
      #708324 - 05/29/12 11:57 PM

Hi all,

I have a test plan issue... I would like to know what the point is of having an exit criteria for the test period which states that % of test cases that has been run before the test period ends or stating that X % of the test cases has to have passed? At my job the teams anyway go in and remove test cases that have not been run so that the first exit criteria is always meet and the test plan also states that full regression testing will not be done. And regarding the number of test cases that are passed or failed? Is that really relevant? Isn't it the nature of the remaining bugs that is what counts?

I would like to state that 100% of new functionality for a certain release will be tested. Not sure if there should be a percentage for the number of regression tests that should be performed.

I hope I get a lot of input about my little issue.

Post Extras: Print Post   Remind Me!   Notify Moderator  
Joe Strazzere

Reged: 05/15/00
Posts: 12344
Loc: Massachusetts, USA
Re: Exit criteria with % of test cases run or failed? [Re: Nessi]
      #708351 - 05/30/12 03:22 AM

If your team actually removes test cases in order to meet your exit criteria then there is no point in having this sort of exit criteria in the first place.

Sadly, this isn't unique. While many shops set up formal exit criteria, the real exit criteria is often "stop testing when the scheduled end date is reached".

If that's the case in your shop, it's important that you know it ahead of time so that you can plan your testing accordingly. Make sure that when the end date is reached, you have tested the most important features to the best of your ability. Order your testing so that the most risky features are tested earlier, and the least impactful features are left until the end.

- Joe
Visit to learn more about quality, testing, and QA!

I speak only for me. I do not speak for my employer, nor for anyone else.

Post Extras: Print Post   Remind Me!   Notify Moderator  
Pages: 1

Extra information
0 registered and 8 anonymous users are browsing this forum.

Moderator:  swt88, AJ, corklad, blueinatl 

Print Topic

Forum Permissions
      You cannot start new topics
      You cannot reply to topics
      HTML is disabled
      UBBCode is enabled

Topic views: 2647

Rate this topic

Jump to

Contact Us | Privacy statement SQAForums

Powered by UBB.threads™ 6.5.5