SPONSORS:






User Tag List

Thanks Thanks:  0
Likes Likes:  0
Dislikes Dislikes:  0
Results 1 to 9 of 9
  1. #1
    Junior Member
    Join Date
    Jun 2007
    Posts
    11
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Rerun failed test cases

    Hi,

    i am running the scripts in batch using plan file..after completing the batch file..i will rereun the failed scripts through results file by marking failures in plan file..i want to automate this process of running the scripts in batch and rerunning the failed ones..
    any suggestions to do this...

    Thanks in advance..

  2. #2
    Junior Member
    Join Date
    Aug 2006
    Posts
    5
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    You can rerun those failed testcases from TestCaseExit() function calling:
    ArgListCall(GetTestcaseName(),GetTestcaseArgs())

    But that don't overwrite .res file so the errors will remain in results.
    It's only useful if you store your results in a database instead of use .res files.

    SergiDs.com

  3. #3
    Senior Member
    Join Date
    May 2007
    Location
    LantianCity
    Posts
    103
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    I found the ArgListCall(GetTestcaseName(),GetTestcaseArgs())
    also can't work and get the error "a testcase can't be called from a testcase", do anyone have good idea?
    It never rains but it pours.
    Welcome to visit: <font color="blue">www.lantianwei.com</font>

  4. #4
    Senior Member
    Join Date
    Oct 2002
    Location
    England
    Posts
    368
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    Rather than focus on how to get the plan rerunnable, I think you need instead to understand why the testcase(s) fail first time round, and fix that.

    Testcases that fail first time they are run, but run successfully the next time sounds very strange, and are a strong indicator of serious flaws in either your plan, the testcases or test data.

    regards
    peat

  5. #5
    Senior Member
    Join Date
    May 2007
    Location
    LantianCity
    Posts
    103
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    Here really have a strange thing:
    I run about 200 cases and found 30% will failed by product crash,then you run again and 15% will failed....but we can't reproduce these product crash manually. So i hope to rerun it.
    It never rains but it pours.
    Welcome to visit: <font color="blue">www.lantianwei.com</font>

  6. #6
    Senior Member
    Join Date
    Oct 2002
    Location
    England
    Posts
    368
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    Hmm. If 30% of your automated testing fails due to the AUT crashing, then IMO you are probably automating too early in the SDLC. It's a waste of time to run automated tests if the AUT is not in a testable condition, or to run tests on particular functionality which is unstable.

    That said, if the AUT is stable when manually tested and automated testing intermittently fails, that is still a strong indicator that there are flaws in the framework code and/or the scripts.

    IME it is far more effective to resolve the root-cause of script failures, not waste valuable time inventing workarounds, unless of course there are very good reasons for doing so.

    regards
    peat

  7. #7
    Senior Member
    Join Date
    Nov 2008
    Location
    London, England
    Posts
    183
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    [ QUOTE ]
    Hi,

    i am running the scripts in batch using plan file..after completing the batch file..i will rereun the failed scripts through results file by marking failures in plan file..i want to automate this process of running the scripts in batch and rerunning the failed ones..
    any suggestions to do this...

    Thanks in advance..

    [/ QUOTE ]

    Typically I would use a test management tool for this kind of thing. Silk central test manager provides the feature of re-running just the failed tests in a suite.....
    The shortest distance between two points is under construction.

  8. #8
    Senior Member
    Join Date
    May 2007
    Location
    LantianCity
    Posts
    103
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    I guess the AUT crash because i enable the VB extension and maybe this conflict with our product. But i can't reproduce the crash manually, and i can't get the sourece code of our product, so olny way i can do is keeping it workgrounds. And one thing is other script which is not enable the VB extension will not crash. do you have any good idea?
    It never rains but it pours.
    Welcome to visit: <font color="blue">www.lantianwei.com</font>

  9. #9
    Senior Member
    Join Date
    May 2007
    Location
    LantianCity
    Posts
    103
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Total Downloaded
    0

    Re: Rerun failed test cases

    Thanks, i will try it. and now i have used the testcaseenter() and testcaseexit() to rerun our testcases.
    It never rains but it pours.
    Welcome to visit: <font color="blue">www.lantianwei.com</font>

 

 

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Search Engine Optimisation provided by DragonByte SEO v2.0.36 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Resources saved on this page: MySQL 9.38%
vBulletin Optimisation provided by vB Optimise v2.6.4 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
User Alert System provided by Advanced User Tagging v3.2.8 (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
vBNominate (Lite) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Feedback Buttons provided by Advanced Post Thanks / Like (Pro) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
Username Changing provided by Username Change (Free) - vBulletin Mods & Addons Copyright © 2016 DragonByte Technologies Ltd.
BetaSoft Inc.
Digital Point modules: Sphinx-based search
All times are GMT -8. The time now is 01:45 AM.

Copyright BetaSoft Inc.