| || |
- 1 Post By dlai
What would make our tools better?
In my 20 years in QA I have found that the tools used, although well meaning, always come up short. I would like to understand if we, as a community of Quality Assurance Professionals and technologists, have a common experience in finding tools that really meet our needs.
I have started a project to create a better solution for our communities that I believe will improve the speed, ease, and efficacy of Requirements --> Tests --> Feedback -->Reporting, allowing us to focus even more on the integrity of Quality. I am polling some groups on LinkedIn with this same survey and have promised to share the results of it with them - I would be more than happy to do the same here if there is interest.
If you have 5 minutes (no need to take longer than that), I would very much appreciate your help. What is your experience? What would make the tools you use better?
Let's better our community and options by pooling our knowledge and finding better solutions: Test & Requirement Needs
I appreciate your feedback, your insight and expertise, your experience, and your effort.
Thank you for helping create a clear vision of what will meet our needs in the future.
Successful Quality Assurance
Quality in a service or product is not what you put into it. It is what the customer gets out of it.
Took your survey.
My initial impressions is your questions are skewed towards a solution you have in mind. You'll want to use ranking and free form questions to get more accurate feedback. While 'managing' requirements and getting 'user feedback' are things all organizations struggle with, I struggle more with someone even more basic.
As someone who has implemented ALM and TCM solutions to multiple organizations, I feel there is a fundamental need that is completely missed by all the tools. That feature is GAP and Risk analysis. There are many tools that organize test cases, organize requirements, and allow you to link the two to create a traceability matrix, there isn't a tool out there that does any risk modeling or gives you objective ways of evaluating a test set/test plan.
What I mean by that is, say there is a new feature coming out. How do you determine which tests should be tested and what the priority should be? Even with the most advanced ALM tools, this has fallen on the QA Engineer to pick the test cases. The process relies so much on QA Engineer's experience, this makes it hard to do right in distributed teams. This is probably one of the main reasons why outsourcing manual testing and hiring temporary contract workers has been inefficient. It takes too much internal product knowledge and soft skills without any way of duplicating across organization beyond just experience.
Thanks for the feedback, David. Very good points.
On the survey, I did my best to allow free form answers to the questions - though the questions themselves weren't open-ended. This was intentional - and if I get enough feedback, it will open up more lines of inquiry that work better for deeper analysis.
I love (and agree wholeheartedly) with your point about GAP and Risk analysis. Really appreciate your insight.
Thanks for taking the survey!!
Each tool has good parts and does poorly in other areas.
The weak areas seem as if they should not be that tough to fix.
Then add on tools come along to attach to the weak spots. I don't understand why additional tools need to be added. Why don't the vendors work with third parties to add in the capability to their product? Some companies are competing but some add in their product to others.
I wish a vendor would work with the Automation Community from scratch and come up with a total solution. It seems like open source tries to go in that direction but the pieces seem fragmented.
When in Florida, Don't Tampa with the code. I made this up.