automating a load testing tool
We are looking into using a tool like loadrunner or opensta to create a load against our web application so we can do performance tuning.
We currently have an automated regression testing framework in place for functional testing of our application (tests are run through the browser). So rather than trying to rewrite test scripts using a new tool for load testing we would like to leverage our existing suite of functional tests.
Our initial thoughts are to put an automated system in place that would allow us to register a subset of our existing scripts to be used for load testing. And as a part of a nightly build, this system would run the registered tests using our existing framework and record their actions through a load testing tool like loadrunner. Then for each recorded script it would generate a specified load against our application and profile the results. So as our scripts evolve due to changes in the application our load tests will evolve respectively because they are generated at runtime.
So my biggest question is if anyone knows of a load testing tool that can be automated? We would need to have access to an api that would allow us to bring the tool up, start recording, generate the scripts to the proper location, read in our load generation requirements, start the actual load testing, and record the results....all of this programatically.
Has anyone tried using ant or cruise control to automate the running of loadrunner or opensta? If so, how much control of these tools is there?
Any help is greatly appreciated... thanks,
Re: automating a load testing tool
You have a good idea, but I feel you are going to make simple thing complicated.
I have done quite a lot in both functional test automation and load testing with the same applications. We are using Rational Robot for both. The good news for people using Robot is there is a free automation framework, RRAFS.
The key points to make the idea isn't really great are:
1. Functional testing is at UI level while load testing is at protocol level. There are much less test cases used in Load Testing and unlikely the test case used in functional test and load test will be the same, even it looks like testing with the same scenario.
2. For load test scripts, unlikely you can just record and re-play. In fact, I have never been so luck. If you want to drive the load test scripts from a functional test, you need to automate the modifications after recording as well, which is hard to predict.
3. The changes on the application normally have a complete different impact on funcitonal test and load test. Changes lead to functional test change does not lead to changes for load test script change and vice versa.
I am not aware of anyone is doing this.