I have an assignmentwhere i have to test the possibilities with two performance testtools. The two tools i have to look at are Mercury Interactive Loadrunner 6.5/7 and Compuware QALoad 4.8.0. I am starting with my testreport as we speak and i was wondering what testers out there concider as important points/criteria/fucntionalities a testtools (performance) should support.
(i.e. what analysis options/ what run option)
So i guess my question is. What are good points to compare two performance testtools on?
We evaluated both of these tools at the tail end of last year. Functionally they are both very similar (as you would expect, as they both have the same purpose/goals).
If you have not already done so, I would strongly recommend that you get both Compuware and Mercury on-site to perform a demo running in your environment and against your application(s).
In the end it really is down to how the tools suits your needs and which you feel will be easier to work with, and of course there is another parameter pricing. Who wil provide you with the best value for money?
We allready have a license for Mercury Interactive Loadrunner 6.5. This is the testtool we use here right now. We are looking into the possibility to purchase QALoad because the license agreement suits our needs better than the one from Mercury Interactive. DO you have any conclusions or reports on the investigation you did?
This would help a great deal.
Another point i have to look at is the possibility of monitoring several resources en activities. Right now it isn't clear to me how QAload manages it's monitoring but i think it does the monitoring part through an extra package called "EcoTools".
Obviously Loadrunner uses a very expensive method wich means you have to purchase all monitors seperatly.
Did you research the monitoring options aswell or only the functionality of the tool itself?
And off course: Do you have any documentation on this topic that could help me?
<BLOCKQUOTE><font size="1" face="Verdana, Arial, Helvetica">quote:</font><HR>Originally posted by JVS:
We allready have a license for Mercury Interactive Loadrunner 6.5. This is the testtool we use here right now.
i think it does the monitoring part through an extra package called "EcoTools".
Obviously Loadrunner uses a very expensive method wich means you have to purchase all monitors seperatly. <HR></BLOCKQUOTE>
I dealt with QALoad as well as with LoadRunner.
Check how idiosyncrasies of your tool interact with the idiosyncrasies of your environment. Start with the available LoadRunner 6.5.
You have to pay for "EcoTools" separately also. At the same time you could use free PerfMon (on NT or similar tools on Unix) to get the same information.
Commercial tools use the same OS counters as free tools. Commercial tools have the only advantage: statistical processing and reports (both are not perfect).