Hi, I posted a while back for some advice about discerning who really had load testing experience and from those who didn't and the responses were valuable- thanks!
I continue to be concerned that a good deal of the candidates I am interviewing are inflating their experience and I am currently reworking my interview questions.
So, I am hoping I can get a few of you to respond to me privately and give me one or two questions that I could ask specific to the load testing tool you use that would help me weed out those people who are not professional load/performance testers.
For example, asking how a respository is used in Quick Test Pro usually sorts out the experienced from the inexperienced quickly.
I am looking for a similar question for LoadRunner etc.
in order to get an intelligible answer - an intelligible question helps!
do you mean how to set up a transaction so that it only records response time on 33% of iterations??? - possibly a good starter question, if they can't answer that then end the interview and don't hire
I'd have said stuff about monitors, for example a cpu on server 1 is at 90% and on server 2 is at 15% given round robin load balancing please discuss
also stuff about using c programming in LR and also manual/automated correlation (if they claim never to have done manual correlation then don't hire them) and general discussion about different protocols they claim to have used and any problems/issues they've had with them
When interviewing potential performance engineers I would normally question them about bottleneck recognition, how to determine which component in a multi-tiered system is causing performance degradation, and how to go about tuning that component and retesting?
I would also ask about benchmarking techniques. I would not really get into heavy stuff such as markhov queues or little's law etc as I think modern tooling has caused most engineers to ignore the fundamentals while still being able to adequately analyse performance.