I have been working as a Load & Performance tester for the last 4 years, and one very awkward question I face from Managers is "We changed very little between the last build and the current build, why do we need to re-record the scripts?"
I try to do a windiff on the 2 scripts and show them that there are additional fields on the forms, there are additional java scripts, the object names have changed, and so on.
Somehow I get the impression that the product sales reps create this impression that there is very little effort in doing a load test and manage to sell the tool and walk away letting the load tester take the flack.
Have you experienced a similar situation? How did you handle it?
I think this is a common problem, TP!! Sometimes I have found it helpful to explain a little about how the tool works (in my case, PerformanceCenter) and why such minor changes impact the scripts.
What you are doing with the windiff is a good way to demonstrate this. Show them what has changed "behind the user interface" and describe the impact of those changes from a script perspective. Explain what will happen if you don't re-record the script. I also like to explain that what we do is write programs to test programs and if their programs have changed, then it is likely that ours will change, too. Also (you probably already know this!), beware of just saying that you need to re-record the scripts - in most cases there is correlation, parameterization, error handling and other custom code.
The misconception that it's all record and playback and scripts last forever is one of the banes of our existance!! [img]images/icons/mad.gif[/img] I've done my best to educate my management (as well as the project teams I deal with) in how the tool works, what it will do and what it won't do, and how it works across the lifecycle of a system. I still get push-back from management, particularly new managers to the load testing process, in which case I offer to do my "Introduction to Load Testing" presentation to help them to better understand the process.
Hope this helps!! [img]images/icons/cool.gif[/img]