| || |
Automated test suite evaluation
I am new to automation test design. Now i need to investigate how to assess the designed automation test suite. Are there some metrics except coverage analysis for test suites? How can i evaluate executable test scripts implementation (if it is properly developed, not results of it's execution). If somebody has experience, please advise.
Re: Automated test suite evaluation
Just cautionary note, before you get someone elses list of requirements you should really do a needs analysis based on your situation - there is a great deal of variance in the automation testing world in terms of Test Architecture requirements that are situational. For example:
1) Will most of the Testers be Software Engineers or Domain Experts
2) What is the Ration of Developers to testers - wider the ratio the more robust the architecture has to be
3) How many testcases 100's - then the architecture can be fairly thin - 1000's then you need a very robust architecture
4) What is the cycle time - couple testing cycles per year or per month
...Basically treat your assessment the same way you would when addressing any critical corporate asset.