[ QUOTE ]
What are the Regression automation completion criteria?
[/ QUOTE ]
Before I can answer this question, I need to understand: How much of your regression test is automated? Also, what specific completion criteria are you looking for:
1) Regression Test completion criteria, i.e. all regression tests have been identified, were run, have passed and/or defects based on their severity level have been documented, are being evaluated, etc.
2) Automated regression testing completion criteria - which can be different from your overall regression testing criteria, i.e. in addition to your automated regression tests there might be manual regression testing steps, etc.
Please clarify and I'll try to give a more specific answer.
The first thing is
We have started automating the scripts. We need to identify the each milestone of automation is completed. i.e. a set of test cases are automated. How to identify the Completion conditions of the script automation completion crieteria.
I am not really talking about the automated regression pack running for each cycle. To be specific the completion crieteria for the script development for automated regression pack.
From your post, I am assuming that you have already identified the cases you will automate in any given milestone. Now you need to define some completion criteria so that you can say scripts are automated. We used to follow very simple completion criteria, i.e review with some tester in your team and demo of scripts ( On some different machine ) in weekly meeting.. There was no formal definition for this, it was more of a practice we followed to make sure that there is no problem in the scripts and every one is aware of the progress team is making..
What's the beneift you want to realize by making it more process oriented and clear?? May be a checklist associated for every script asking if it is demoed? If it has been executed on diff machine and so on? May be some kind of mapping between your scripts and test cases and requirement if you have any?? You can do anything you want, but if you know why you want to make it process oriented it will be easier for you to find whats the best way to achieve this. Hope it helps.