| || |
Cross Platform Testing
I am currently testing a graphical application across three platforms- Windows 95, Windows 98 and Windows NT. Because the application is very visual I tend to use bitmap checks, the problem being that small insignificant differences cause the checks to fail. I decided to maintain a set of bitmap checks for each platform but this is not very efficent, I would like to have one check that could be used across all platforms.
I expect this will also be a problem testing different web browsers, e-commerce etc
Does anyone have a solution to this problem, or some way to minimise it ?
Does Compuware have any plans to introduce some sort of 'sensitivity' control to the checks so that one pixel difference does not cause a fail ?
Re: Cross Platform Testing
Could you tell me what you mean by your application being very visual? Does this mean that there are no objects or controls? If the application is displaying bitmaps, then you will have to use bitmap checks. There is no option for "dithering" in QARun at this stage.
If your application is appearing as one big bitmap, then I would guess this means that QARun will find only one window to which it can attach. If this is the case then you may be able to create one check for all 3 platforms and use the command Replay.CheckCurrentAttach to tell QARun to ignore the window attach name stored in the check and perform the check against the current window. However, if the problem with using bitmaps is that there are differences in the way your application displays its graphics under the differing paltforms, then this method will probably not work. Also if there are resolution differences this will also cause a problem.
I have heard (but never tried) that if you record a bitmap check at 480x640 resolution, that the check will work at all resolutions higher than that. Might want to give that a try.
As for testing between different browsers, the latest version of QARun 4.7 has automatic cross browser support between Netscape and I.E. In my experience with using QARun in the e-commerce environment I have not had any major problems to speak about. In fact it tends to work extremely well.
Hope this helps,
Re: Cross Platform Testing
Thanks for your reply John,
When I say that the application is visual I mean that all the graphics are held in one window, they are not separate controls that QARun can find, something similar to Microsoft Paint main window.
I have no problem attaching to the graphics window, the problem is, as you say, that each platform draws the graphics slightly differently, and it only takes one pixel to be different for the check to fail.
It's a good idea to capture the bitmaps at a lower resplution but unfortunatly I have to test at 1024 x 768. I have too many bitmaps already captured at this resolution to change them and I also need to test at a resolution a customer is likely to use.