How to add test case for usability test issues???
Hi would like to get some consultant to advice, when we do an initial product testing normally we will adding in steps or test cases in the test scripts. But when we found some usability issue which we accidentally it, do you think like this kind of case, we need to add in to be part of the step in test case?
Yes, definitely we need to add it as parts of our testcase.
When I do product feature test, my testcases would include: 1) good setting , should get good result. 2) bad setting, must get bad result(if you still get good result, that means problem)
with my test tool(autotestnet), a similar testcase(group) was designed like this:
1. configure product with good setting
2. run a test object, expect result is "getting expectation", which means "test object" pass, therefore means this "test step" pass
3. change product configuration to a bad setting
4. run same test object as step 2, expect result is "FAIL to get expectation", which means "test object" fail, therefore means this "test step" Pass
5. change product configuration back to good setting
6. same as step 2
Your example, Hans Yin, is not usability, it is positive and negative testing (which should always be applied as needed.)
To the original post: As always, it depends! Some organizations address usability and accessibility entirely separately from functionality, performance, etc.
In general, I would say that a usability issue (especially one you stumbled across) should NOT be included as a step in a test case, unless your organization requires it. Many usability issues can and should be fixed quickly and easily be Development, and should never recur.
I can think of a usability issue (IMO) that exists with a BBC (British Broadcasting Corporation) web site. I would report it, except that they spend a lot of words explaining that they get too many emails/contacts to be able to handle them. So I guess I'll just let it go.
In case you are interested:
1: Navigate to BBC - Radio 4 - Home
2. Click on "Schedule" (near the top right of the page.) A 15-day schedule appears, with "Today" in the center.
3. Try to click on "Today" - it is not a hot link. (You can click on any other date, and it brings up the detailed schedule for that day.)
Some might call that a functional bug, but it is easy to navigate to "Today's" schedule by going to a different day, then selecting today's date near the top of the page. So, at least from one point of view, it might be considered a usability issue.
AMENDMENT: Well, what do you know? They fixed (well, changed) it SINCE THIS MORNING! It now defaults to today's schedule. It used not to do that. Originally, an abbreviated version of each day's schedule was shown as a "column" under each date! Maybe it was in process of being changed, but the behavior I described above was there for at least the last several days.
AMENDMENT #2: It's broken again!
Last edited by Peter Ruscoe; 08-05-2013 at 04:42 AM.