Can anyone tell me what is a bug for WinRunner? For example if a new control is added in the GUI of an application then is that a bug for WinRunner? or is it just a Context Sensitive error? What is a bug then?
NOTHING is a "bug" to WinRunner. WR has no idea what is a bug and what isn't. The WR script tells WR to perform certain steps. It executes those steps and ends, either because it cannot proceed any further or because it is coded to do so. In any event, the meaning of its results are 100% dependent upon the logic of the script and the interpretation of a human being.
I concur - well put Peter. I don't ever rely on WinRunner (or QTP, or PERL, or any other automated solution) to determine if what it has identified is a "bug".
When we have an issue in the automated runs, we have a rule where we don't automatically log anything.
-We first ensure the AUT server is setup correctly as we are testing a toolkit
-Then we look at the issue and track back to see if a new requirement was delivered and we weren't notified.
-We also meet with our SME on the business side to determine if 1) The application is now acting as it should and the test data needs to be updated or 2) The data is correct and we need to log a "bug".
Blindly logging things reported by an test application that you aren't completely familiar with is nothing more than a recipe to cause the QA department to be looked on as a "hindrance" and start down the path of reduction in your value to the company
eiman, has KalSoft offered you any kind of training in WinRunner or standardized practices for software quality assurance? Some of your questions might lend themselves to training opportunities, especially if you have not had the opportunity to attend training yet.
you can have both false failures and false passes. This new control is likely cause your script to report failure but if this change was intentional then it merely tells you things have changed and you need to update the expected results.
On the otherhand if you are not checking anything on the dialog that had the new control added then it is giving you a false pass so to speak. You weren't cheking for anything so when something new is found it never reported it.