| || |
Search Engine testing
Can anyone tell me about strategy in testing search engine, for example, how to test shopping.com
Re: Search Engine testing
First of all, the requirements must be defined.
- If it is web-based, does it have to run on every browser (including older Safari versions running on a macintosh) or, in the other extreme, can you select IE version X.Y and tell the user that if they run another browser, they do so on their own risk?
- Are you only testing the functionality or is the performance also important? If so, how many users are likely to attempt to access the system at any given time? What is the expected behaviour at peak times (a shopping search system shortly before Christmas; What is the expected behaviour? System must work correctly and give results within 2 seconds in 99% of all cases, System must react and display that we apologize, but your request could not be handled or is it accaeptable that the session is suddenly killed)?
- If the system is already in use, try to get the support hotline and ask them about user complains - that provides excellent hints for tests.
- What resources (manpower, money for test tools,...) are available?
- What sort of testing is to be done? For example, you can't do a UAT, you can only set a rough test plan for a UAT.
- What test data is available or do you have to define it yourself?
- Do we talk about a search engine that is going to be developed in the future, that is in the state of being developed, that is released in one month and the management just thought that it might be nice to have some sort of QA or that was released and is currently tested by the customers?
Are we talking about test strategy or QA strategy?
I once worked in a company where the service and sales guys thought it absolutely normal to take the nightly build of the toprevision and send it to the customer, informing the QA several days later that "The product doesn't work", unable to tell me what version the customer used.... solution was that the administrator made sure that they had no longer access to anything but released versions.
In an interview, I hope that I would have the brains to return the question immediately and ask for more details, otherwise a strategy would be very difficult to implement.
Hope that this helps,