The company I'm working for is about to start automating some of its testing and has placed me in charge. I'd decided on using TestPartner from Compuware, but now I've been told to look at Visual Studio 2005 Team Edition For Testers.
Does anyone know whether it can be used for regression testing, how it compares to the other popular products, or have any thoughts on it?
VSTS doesn't currently have automated regression testing like TestPartner, but it does keep have Manual tests, Unit Tests, Web tests and Load tests. We actually use both products, which covers all of our testing needs. TestPartner does integrates with VSTS, which is a nice plus.
VSTS cannot be compared with other test tools such as QTP or silk test, Rational Robot. This tool provides some features such as UNIT test for white box testing, Web test for Load/Performance testing, Load test for running Scenario and nothing else.
This tool is good for developers. Microsoft is extremely behind in testing field. The tool provide you validation and extraction rule which is good for validating web page content and extraction rule for correlating dynamic values. You can use different tables in SQL server or text file to input parameters to your test but it does not support functional, GUI and Regression testing. In fact Microsoft is totally screwed with functional test and GUI test. They think that this software can better work with functional side by defining validation rules. For me it is like a checkpoint concept use in Load runner and nothing else. On the top of that they are going to apply this product with Team foundation which could be beneficial for Developers. The VSTS for tester edition is a hell for testers. Use this product if you are concern for performance. You can convert the web test into coded test. The whole web test can be generated in VB.NET, C#. There is a disadvantage with this tool that once you convert the web test into coded test then you make changes in the coded test by using of C# or VB knowledge. For some reason if you ever need to go back to you web test and rerecord something in your web test then convert it back to coded test. Those changes will over write with new scripts.
Final conclusion this is not a good product for regression and functional testing. It does not do anything with GUI test. To cover those testing you probably need to buy good functional test tool such as Win Runner, Robot or QTP… trust me!
I have been using VSTSEdition for Tester for some time now and we are doing regression testing against every build using both unit tests and our web tests. In fact we recommend doing Load Tests against every build using auotmated unit tests and web tests. Of course the automated unit tests creatd by development need to be monitored for quality, you need to get by in from your development team. If you have tester's that have some coding experience they can improve the automated unit tests to test more functionality if development are not covering all scenario's. The automated unit tests allow you to test functionality without a User Interface so you testing very early in the project. Contact me if you want to talk about this more ... Deb
QA Practice Lead, Sr. Consultant
VSTS Edition for Testers
Loc: Toronto, ON
I'd like talk more about it [img]/images/graemlins/smile.gif[/img]! I've been tasked with evaluating VSTS for automation. I'm curious have you ever used other tools? (i.e. compuware, mecury, etc... ) If so would you reccomend VSTS over one of them?
Also does VSTS work with windows applications or other middlewares like Citrix for load testing? I assume there is no functional testing for window applications since it's called webtest am I right?