| || |
Rational TestFactory - has anyone been impressed ?
My company is loooking to automate testing, and evaluating tools. Rational TestFactory makes some pretty impressive claims.
Has anyone used this product, and found it cost beneficial.
Will it replace any of the functional testing you can implement via QTPro or Winrunner ?
Re: Rational TestFactory - has anyone been impressed ?
I don't have any hands-on experience with testfactory, but my understanding is that you just sort of point it at the GUI of your target application and let it loose to try any combinations of actions within the user interface it can, possibly in a sort of monkeys-sitting-at-typewriters kind of approach to getting a test done.
This contrasts quite strongly with a (hopefully) sensible approach to developing automated functional tests, where you probably at least:
-start with a test requirement (identify something that needs to be tested)
-work out how you could approach doing the test so a machine could execute it
-identify the expected outcome for the test
-work out how you can determine the outcome so a machine can check it
-work out if it's worth the effort of automating
-develop the test in your chosen tool
so useful automated tests are created from analysis of what needs testing, and how to teach a machine to test it for you, as well as what's actually a software development exercise to implement the automated test in whatever tool you've chosen. There aren't really any shortcuts to building a useful automated test suite, and I'm not sure wandering around an application front-end really qualifies as functional testing. Functional tests are directed - aimed at checking a function is behaving as expected. Maybe (using webpages as an example) testfactory would be ok for a sort of link-checking web-spidery testing in your app, to make sure all the pages are there? But there's no concept of opening the *right* page, just that a page was found, not a 404 error.
I've never heard of anyone using testfactory anyway, and (if my understanding of what it does is right) I don't think I've come across a situation when it might've been useful.
I did hear from a colleague that he'd gone as far as asking a Rational-consultant if he ought to learn about testfactory as part of his automation skills, and the reply was pretty much "well, nobody uses it, and it's not really up to much..."