SPONSORS:






User Tag List

Thanks Thanks:  0
Likes Likes:  0
Dislikes Dislikes:  0
Page 1 of 2 12 LastLast
Results 1 to 10 of 19
  1. #1
    Member
    Join Date
    Sep 2004
    Location
    China
    Posts
    43
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    How to buy a new automatic testing tool?

    If to buy a new testing tool,what should be considered? How to evaluate a new testing tool?
    Before buying,a analysis needed,how can I begin it?
    Brian
    -Life is like a box of chocolate.....

  2. #2
    Senior Member
    Join Date
    Sep 2004
    Location
    London, UK
    Posts
    1,798
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Brian there are plenty of articles out there on this in various other boards: Try www.stickyminds.com and use a search there on tool evaluations.
    There is a fairly good, if dated now, comparision of some of the tools by Ray Robinson on this site in the download section too which is a good starting point to get an understanding of what is out there.
    ------
    Regards,
    Neill McCarthy
    Agile Testers of the World UNIT!

    For more contextual Musings visit http://www.testingreflections.com/ and now at http://www.sqablogs.com/neillmccarthy/
    ---

  3. #3
    Moderator
    Join Date
    Mar 2004
    Location
    West Coast of the East Coast!
    Posts
    7,756
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Here is my short version on how to purchase an automated tool:

    First determine if you product is stable and ready for automation. There are many past discussions on QA_Forums, just use the old search button at the top.

    Then get your 4 testers together along with your immediate manager and do a brainstorm on the requirements needed for a tool. Then put together a Planning and Scope document of your proposals and get buy-in from senior management. Take your requirements list and formalize it then send it to the Vendors of the tools which you think might be applicable for you. Once you have a list of tools, do your own evaluation on the tools, which will require you obtain demo copies of the tools. If you can get them, they are probably not the tools you want. Ask Vendors for references, contact the customers to see how they use and like the tool. Ask any that might be local, about an on-site demo of how they are using it. Finally have the Vendor do a proof of concept. This might cost you, but it's better than having useless shelfware when you abandon the tool because "it just doesn't work for you".

    And last, but not least, hire a tool skilled or certified contractor(commercial or in dependant), to get you up and running with a suite of scripts that are well documented and insure that he passes on the valuable hints and tips of the tool usage.

    Remember automating is development and must be budgeted and planned for similarly.
    Personal Comment

    Success is the ability to go from one failure to another with no loss of enthusiasm.
    ~ Winston Churchill ~


    ...Rich Wagner

  4. #4
    Member
    Join Date
    Sep 2004
    Location
    China
    Posts
    43
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    I have written a summary on analyzing the test tool,Could any body give some advices?

    The Analysis of Evaluating Test Support Tool
    Table of Content
    1. Purpose
    2. Drive
    • The Limitation of Manual Testing
    o Tester Limitation
    o Deadline Limitation
    o Test case’s management Limitation
    • The Limitation of the Test management
    o Case manage Limitation
    o Test process management limitation
    • The need of QA
    o The limitation of QC
    o Urgency of high quality
    3. Evaluate Criteria
    • Technique
    o Suits project’s Needs
    o Including the most popular auto-testing method
    • Cost
    o A acceptable cost, including software cost, the training cost ,and so on
    4. Test Scope
    • Functional Test
    • Load/Performance/Stress Test
    • GUI Test
    5. Support Resource
    • Hardware
    • Software
    o Operating system
     Windows
     Linux/Unix
     Solaris
    o Client
    o Server(including Database)
     Oracle/SQL Server/DB2
     Apache/IIS
    o Develop Tool
     VS.net
     Eclipse
    o Products
    • Support Person
    o DBA
    o GDS
    • Develop Technique
    o Develop Language
     Scripts language
    VBScripts
    JavaScript
    Python
    Perl
     Programming language
    C/C++
    Java
    C#
    o Framework
     J2EE
     .Net
    6. Tester’s Capability
    • Experience of test
    • Tester’s Technical Skills
    o Database technologies
    o Programming
    o Operating system
    • Tester’s capability of Communication
    o Language mastered
     English
    o Comprehension Ability
     New technology
     New method
    7. The Comparing of the Current testing support tool in the market
    • Technique
    • Cost
    • Availability
    • Training
    • Technical Support
    8. Company’s Requirement
    • Technique
    • Cost
    • Availability
    • Training
    • Technical Support
    9. Purchase Case(Suggestion)
    10. Prefix
    • Tables of the Vendor’s products’ Technical parameters
    • Tables of Costs of different purchase cases
    Brian
    -Life is like a box of chocolate.....

  5. #5
    Senior Member
    Join Date
    Sep 2004
    Location
    London, UK
    Posts
    1,798
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Brain this looks pretty comprehensive for a first stab.
    A few points - you may want to consider a weighting system for the success criteria, ie cost may carry a greater importance and should be scored as such.
    It might be worth looking at a quick pilot once you get to a short list as described by Rich W. This quickly sorts out the "Sales" claims from the reality of usability in your context.
    It might be worth also working out a timeline for the return on investment and longer term goals for the project too. It is important to get this buy in as in the short term it will add cost and may take a while to give an ROI (this should include the cost and the time line for the evaluation - which with all your criteria may be significant)
    As I say though for the initial paper exercise this is a darn fine starting point. [img]images/icons/smile.gif[/img]
    ------
    Regards,
    Neill McCarthy
    Agile Testers of the World UNIT!

    For more contextual Musings visit http://www.testingreflections.com/ and now at http://www.sqablogs.com/neillmccarthy/
    ---

  6. #6
    Senior Member
    Join Date
    Nov 2002
    Location
    London, UK
    Posts
    832
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    I have a comprehensive spreadhseet that I created many yrs ago where you can apply a weighting factor to each attribute you are intersted in. If you wish to have it email me at

    aoleary@csedge.com
    Life should NOT be a trip to the grave with the intention of arriving safely in an cool and well preserved body, but rather to skid in, chocolate in one hand, beer in the other, body wrecked, totally worn out and screaming WOO HOO what a ride!

  7. #7
    Member
    Join Date
    Sep 2004
    Location
    China
    Posts
    43
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Great thanks for seniorities' advices. these will help me much,for I am just a beginner in qa.
    Brian
    -Life is like a box of chocolate.....

  8. #8
    Senior Member
    Join Date
    Feb 2000
    Posts
    1,497
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Brian,

    In addition to the what's already been posted, realize that your requirements list will change as you get some evaluation time with each candidate tool. Some items will become more important than others, some far less. You'll also be adding new ones as relationships between requirements become clarified during the eval'. This is often an unexpected bonus: learning what you _really_ need from direct experience with each candidate.

    I'd suggest paying less attention to up front cost and more to the making a compatibility match between a tools' eventual users. Cost, if given too much weight too early, can eliminate a tool that is actually very cost effective because its feature set matches your exact needs. Also, you won't "reinvent the wheel" by coding desired support yourself when doing so further delays the productive use of the tool. The cheapest tool isn't always the best. Consider a tool that costs $7,500 per seat. Pretty pricey, huh? But consider this: At a delopment hour rate of $100 per hour can your developers write an equivalent replacement in just 75 hours - 2 weeks? At $50 per development hour can they do it in just 150 hours? Not a chance. Don't discount open source tools either, you can perform a lot of testing with a carefully selected group at very low cost.

    Work style compatibility of a tool to its user's work habits aids eventual productivity with that tool. A coder won't be happy with a point-n-click capture/playback-paradigm based tool, and an non-coder won't appreciate the values of low level control of class hierarchies and abstraction layering.

    Also make sure that a tools eventual users are directly involved in the evaluation process. They'll appreciate that their input is valued and buy-in and eventual productivity for the group-selected tool is far more likely.


    John

  9. #9
    Member
    Join Date
    Sep 2004
    Location
    China
    Posts
    43
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    John,
    You suggest that we should not pay too more attention on the cost,that is right.But the problem is people(especially the Boss) always like the products of the big,professional company,but the cost is the less the better.This is a contradiction.
    personally,I thought,most of the tools are in the same,especially the function test tool,so when choose such tools,i prefer using the open source tools,they are more cheaper,and more flexible.

    Brian
    Brian
    -Life is like a box of chocolate.....

  10. #10
    Moderator
    Join Date
    Mar 2004
    Location
    West Coast of the East Coast!
    Posts
    7,756
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: How to buy a new automatic testing tool?

    Brian, And worth every penny you pay for them!
    Personal Comment

    Success is the ability to go from one failure to another with no loss of enthusiasm.
    ~ Winston Churchill ~


    ...Rich Wagner

 

 
Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Search Engine Optimisation provided by DragonByte SEO v2.0.36 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Resources saved on this page: MySQL 9.09%
vBulletin Optimisation provided by vB Optimise v2.6.4 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
User Alert System provided by Advanced User Tagging v3.2.8 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
vBNominate (Lite) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Feedback Buttons provided by Advanced Post Thanks / Like (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Username Changing provided by Username Change (Free) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
BetaSoft Inc.
Digital Point modules: Sphinx-based search
All times are GMT -8. The time now is 02:35 AM.

Copyright BetaSoft Inc.