Mobile Testing with GPRS Latency and Transfer Rate
I have an application developed with .Net Compact Framework in C# that gets deployed on Smart phones with WM, this app has passed all of its Functional testing, but when used in the field has had some problems.
It is an application that connects to some WS by GPRS that provide LDAP validation (for user access and rights) and some searchs, it is a Read-Only app. It is going to be deployed in many PDA's whose only requirements so far are WM5 and 64Mb of memory.
So we are trying to start a new set of tests. We want to validate:
- Transfer Rate
- Performance of the App (just in case there´s a resources leak)
- GPRS Signal Quality and Connection
- Sesion Timeout
We want to run the test on field, so we can register all this on several hours during the day, on several days. This is to validate the operation and response times during peak and non-peak hours.
Any suggestions for the Tools needed to measure and register this?
Any other comment that helps this field test be successful is welcomed.
Thank you very much.
Re: Mobile Testing with GPRS Latency and Transfer Rate
Latency, transfer rate and GPRS signal quality IMO are very much based on contention ratio, location and carrier. As such, they are very resource intensive to test properly, and if required, must be retested at each deployment location at regular intervals.
For example, if you have a carrier providing HSDPA, 3G and GPRS services in a given location, the quality of service will go from HSDPA -> 3G -> GPRS to no availability as more people log on in the same cell. This may equate to throughputs going from 2mbs to 250kbs to 50kbs to zero and back within a given session. Some carriers will sell a product that provides better rates based on a higher cost, which is usually delivered through an alternate APN.
My experience is that the best tools for this are still plenty of testing hours and pen and paper. Let us know if you find something that works better in the field.
For resource leaks in a mobile App you could check out www.entrek.com.