There have been responses to a couple of different posts in the past month that provide answers like "There is really no commercial software testing tool available, that will allow you to automate functional testing effectively ..." when queried about automation of any non-Windows application or any Windows application with any non-standard controls.

The gist of the responses seems to be that if you have a product that can't be automated by hooking the application under test, you can't effectively automate the testing.

Does anyone have substantiated metrics or other case studies that compare automation with application/OS hooks versus graphical/bitmap automation? Could these be provided to validate the responses? What were the tools used? What were the applications compared?