I'm looking for a test suite for a series of financial web based products, I have a very specific set of testing requirements.
Automated web tests, which will involve scripting, must use test data from a database table (any) and store results in a linked table so that I can repeat those tests periodically.
I've found a couple of cheap tools that do just that, Ionus and WinTask for example but I really want something that will fit into a test suite that might include load testing and windows application testing which will come along as the test function here develops.
I also want some way of tracking bugs and their resulting tests.
Without getting into detail, what are the packages that offer these functions as part of a suite of products ? Once I have a shortlist, I can research the details in the relevant forums here.
I don't want to do this on the cheap now, only to find I need to rewrite all my tests in 12 months when I upgrade to a more substantial test suite, like TestDirector/QTP which I feel might be a little outside my budget to begin with (and maybe the answer is to invest in that now and futureproof).
Another package that appears to do what I need, and nore, is TestComplete, think I need the Enterprise level for web testing, at $2k / user, well within my budget.
Just because Test Director is known as the Industry Great, don't believe it is anyting special. I've used it twice now at varying places of work and in both instances it failed to provide what we wanted. It fell down on many features.
What you really need to do is to consider tools which may integrate with one another but are not necessarily part of the same suite. Suites always fall down on areas. You won't get the "Best" of all you want in a suite from the same company.
There are a zillion tools out there developed by smaller companies which offer far more that the biggies like Rational, Mercury (IBM and HP) and Compuware and they are willing to provide an integration with some of the larger tools.
Tool analysis is something you do need to take your time to decide upon and not let the hype of the industry influence you. By that I mean, don't listen to "TestDirector is the best......", Rational have it all etc....Remember, most large corporations choose the larger big tools because they feel they have the financial backing if something goes wrong. This is the wrong way to buy a tool although at the same time you do not want a single developer based Software House that charges the earth for a tool. Just in case they go under...
If a tool does what you want it will probably be exactly what you are looking for.
I actually use TestComplete and it does work well. I was a little skeptical because pricing structure is so cheap, but it's a good piece of software.
Also, it does sound like it will do what you want it to do. One note, though, is that there is additional pricing for "virtual users" for load testing. I think you get 5 virtual users by default but you can buy hundreds if needed. It will all depend on what your expectations are, but even with 5 virtual users you should be able to notice areas that will cause a problem.