Flakiness in Performance testing
want to get some suggestion on some questions.
I am using Visual studio load test for doing a load test on a distributed system. I use Test controller and 14 agents [100/200 load pattern] in my load test, where the tests talk to a 3 node server cluster.
The problem here is, I am seeing flakiness in the results throughput and latency. I am unable to figure out why this flakiness is happening. The server machines, the controller and agents are on a dedicated network switch. There are no extra processes running on any of these machines.
Is any here comfortable with load test framework? any suggestions on how to use load test efficiently.
Re: Flakiness in Performance testing
I think you might need to define 'flakiness'. This is British slang for a bit weird / ecentric, unreliable or prone to break but I'm not sure how throughput and latency can be any of these things so I'm guessing you have your own definition.
Also, this seems a tool specific question for VSTS - might be better off in that tool's own forum.