SPONSORS:






User Tag List

Thanks Thanks:  0
Likes Likes:  0
Dislikes Dislikes:  0
Results 1 to 2 of 2
  1. #1
    Junior Member
    Join Date
    Jan 2004
    Posts
    10
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Different results when missing out tests or running in isolation

    I am starting to script some tests in Test complete 3 for an application and rerun them. I have got to the stage where all tests run as expected if they are run in the order they were created in without missing any out of the tests in the suite then there is no problem and they all pass. When I decide to miss a few out in the middle the tests after the ones that wont be run all fall over because they cannot find the object in question. Doing the same actions manually outside of Test Complete give no problems. I only get problems when I run individual tests on the fly or mis out tests in the middle of the suite run. Looking at what is happening in the object browser I believe that object references are being generated on the fly and are dependent on the order, the object names generated bear no resemblence to the application source code.
    The application under test is a Windows client using Infragistics controls.
    Could any of the experts care to comment on this behaviour and suggest any solutions that would allow individual tests to be run in isolation as is possible using manual testing.

  2. #2
    Senior Member
    Join Date
    Oct 2004
    Location
    Las Vegas
    Posts
    473
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Different results when missing out tests or running in isolation

    Hello Arwen,

    Automated test cases should not depend on the results of previous test cases if you want to be able to run the tests in an arbitrary order.
    It looks like your test cases depend on each other and that is why disabling one of them breaks some of the others.

    If test case 1 starts working with the tested application when the app is in state A, the test case, ideally, should revert the application back to the exact same state at the end of the test execution. This will allow to change the order of test cases without problems.

    Atanas

 

 

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Search Engine Optimisation provided by DragonByte SEO v2.0.36 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Resources saved on this page: MySQL 11.54%
vBulletin Optimisation provided by vB Optimise v2.6.4 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
User Alert System provided by Advanced User Tagging v3.2.8 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
vBNominate (Lite) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Feedback Buttons provided by Advanced Post Thanks / Like (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Username Changing provided by Username Change (Free) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
BetaSoft Inc.
Digital Point modules: Sphinx-based search
All times are GMT -8. The time now is 04:30 AM.

Copyright BetaSoft Inc.