large scale android testing
The application I am attempting to test works with a server which communicates with android devices via wifi. The purpose of the application on the android device is simply to receive messages from the server. This needs to be able to reliably support communication with hundreds of android devices and varying loads.
I'm wondering what the best way to go about doing this is. After some brain storming, we have come up the with following (unfortunately) short list of options:
1. Running multiple mini android devices (like raspberry pi) in a large, physical setup communicating over a controlled network.
2. Run android simulators on virtual machines to accomplish the desired scale for the environment to test. (This is less preferable as the android simulators on windows have seemed to be rather unreliable and behave quite differently than physical devices)
We do have the means to use professional level testing software and solutions, basically, anything can be on the table for this solution, we just need the most realistic and reasonable way to test the reliability of this software in a large scale environment.
Your solutions will work, but are also possible candidates for automation; especially if you will be running large numbers of users and/or many tests. What purpose does the application on the Android provide? More importantly how does the client app integrate with server it integrates with? Automation does have its upfront costs, but will prove beneficial if these tests are not a one-time endeavor. If it's a one-time endeavor putting together a solution that you have identified may give you what you need.