Response time differences accessing manually & through tool
I have a weird issue. I am trying to performance test ssrs reports. Here, when i am trying to access/simulate the steps manually through browser it takes ~ 30-40 seconds for 1 user. Alternatively, if i load the scripts through VSTS perf tool, it takes ~ 2-3 seconds when loaded with 100 users during a 10 min run.
I am not sure of this behavior. Here, we have ensured:
cache is cleared when trying to load the user.
We can see that the scripts are doing the desired activity and there are no issues with script.
Valid data is provided in the scripts - same as the ones used while accessing manually
No change in the servers.
we have tried to access manually when we triggered the test to see if there is any other activity on the server which is giving us this difference. but we dont see any issues there.
Any help or pointers to identify the issue is appreciated !!
* Make certain you are issuing exactly the same requests
* If you are not testing at the same layer of the OSI model then you can expect differences imposed by actions in the layer you are not testing. For example, if you have a very heavily styled page with lots of JavaScipt and DOM manipulation in the browser but you are testing at the HTTP transport layer, then you may be seeing the imp[act of your in browser code.
* before you place the items under load, benchmark one user to one user. Use the HTTP access logs on the server to determine if you are (in fact) making the same requests from your VSTS client as you are from the browser. Only once you have passed the QA phase for your performance testing scripts should you move to load. If it doesn't work for one, it will never work for many.
To me something is definitely different. Is there a bunch of client side processing and rendering done in the browser that your performance scripts arent taking into account? Are your Perf scripts just sending a request then receiving the right response? If so then the browser rendering and possibly some processing of the response recevied on the client side isn't taken into account. Most perf tools don't do any client side rendering and processing.