Do these prices look correct to you for Automated Testing Tools?
Hi. I am evaluating automated testing tools. Thus far, I have narrowed my search down to 5 vendors. The below image contains the 12 vendors I have researched thus far.
- Do these prices look right to you? I found several in forums. And, rather than deal with a bunch of sales people, I am hoping the kind people here can help out. I am looking for the all in price. So, if you happen to know that there are hidden ad-ons, etc, then I would greatly appreciate any assistance you might provide.
- Are there any vendors not listed that you would recommend I look at? I am looking for a record and playback testing tool that performs black box testing for web app UIs, but I want a no-code solution that is simple enough for non-technical domain/business users. Ideally, I would like the solution to be SaaS. Any suggestions are more than welcome!
i think you forgot to attach the image.
I'd like to say it's about 30% off in the case of RFT, Silk, TestComplete, and maybe around 60% off in QTF/UFT, but I don't know for sure.. I haven't worked with those tools in a long time so I wouldn't know if prices have creeped up over the years. Also, pricing will vary drastically. Most people will get a much cheaper price with a simple negotiation. Buying multiple licenses, product suites, support will drastically reduce the price.
Thanks Dlai, that is very helpful!
Originally Posted by dlai
Follow-up question, if you do not mind:
how critical is training / support for these products? I am specifically looking for something simple enough that my domain / business people will be willing to use it. If there is more than a 1 hour learning curve (or, any thing that even resembles coding required) to record simple UI functional tests with checkpoints, then they simply will not use the tool. From the product videos I have seen... some of these MAY fit that description. Do you have enough experience with any of these to know which are the easiest for a non-technical person to use?
Hello Admin, do you see the image now?
UFT concurrent is accurate, I received a quote not too long ago. We're a small outfit (8 licenses total), big shots may get more of a break.
Patience is like bread I say.... I ran out of that yesterday.
TestComplete, TestingAnywhere, CodedUI and QTP/UFT are in the right ballpark.
There's a bit more to it, though:
TestComplete's licensing model is a lot cheaper for a lot of execution systems because they provide the execution engine as a standalone commandline application. The cost per instance of that is much lower than the cost per instance of the full application, so if you have 2 automators and 10 automation machines you're not looking at 12 full licenses - it's closer to the equivalent of 4 full licenses.
TestingAnywhere's most expensive licensing option allows you to create a standalone executable of a test suite, so there's no need for extra licenses to run tests if you have that version.
The last time I heard, QTP/UFT requires a full license for every instance whether used for execution only or for automation development.
MS CodedUI is not part of Test Manager. Test Manager can't be run without a Team Foundation Server to connect to. Coded UI will work just fine with a standalone Visual Studio instance. Both Test Manager and Coded UI are available with a Visual Studio Premium or Ultimate license. Team Foundation Server is part of the Visual Studio license, but I don't recall precisely how (Visual Studio licensing is insanely complex). Test Manager is able to run Coded UI tests through the Team Foundation Server/Test Manager lab ecosystem if everything is configured correctly (something I haven't done) without requiring extra licenses for running instances.
If you're doing license cost comparisons you need to look at runner-only costs as well as tool costs, because there are massive differences in how that works. The last time I looked, SmartBear wanted around 16,000 for 8 machine-bound licenses of TestComplete with 30 concurrent licenses of the test runner. The quote from QTP was in excess of 80,000 for 8 licenses. No prizes for guessing which path was taken...
This point is critical. Some charge for runner licenses, while others don't. Prices can vary on those greatly, and then also some tools come very bare and require all sorts of add-ons or plug-ins to do what you want, and new or alternate items based on technologies tested. Just make sure what you're comparing is apples to apples (which since so many of the solutions vary, that comparison can be difficult to fully understand.
Originally Posted by katepaulk
It seems to me that the cost of 10 developers time for a year will be in the millions. The price of the tools for 10 licenses are between
Free (Selenium for example)
About $100K on the other end.
It seems to me that I would want the most productive tool that matches the application under test than the price of the tools.
Thanks for all the feedback. And, hmmm... other than talking to salespeople is there a source that clearly outlines all the costs per vendor necessary to get an apples-for-apples comparison? Thanks!