Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
Given that the question comes up again and again, I've decided to add this sticky listing the tools currently available to help the tester working with handheld, embedded and other mobile devices. Please only post to this thread to add details on a new tools, or make comments on a tool that you have used.
Automation tools
TestQuest Countdown Supports a wide range of devices, some limited discussion here and here
TestComplete7 - See the seperate TestComplete forum and limited discussion here. Support MS devices only.
TestPlant - Graphic based testing, requires VNC server on device, otherwise can test on any device
T-PlanRobot / VNCRobot - Graphic based testing, requires VNC deleted on device, otherwise can test on any device
SOTI Pocket controller - Simple macro record / playback, MS devices only.
RoutineBot, image based, unsure of supported devices, see discussion here
SeeTest from Experitest, plugs into QTP,TestComplete,MSTest,Junit,Perl,Python. See also this thread more discussion here.
Automated Test and Re-Test (ATRT), more here
VNC servers
VNC2Go – Wide range of supported devices[/URL] RealVNC - Symbian, Microsoft Mobile, iPhone, Linux and Blackberry platforms Mocha VNC
On Windows mobile touch screen devices, touch screen emulates a mouse, such that a mouse can be used to a large extent to test it under VNC. For example, a tap with the pen equates to left mouse button down, draw the pen across the screen equates to holding the left mouse button down and dragging the mouse. This may not work for many gestural inputs on the iPhone / android etc... as there are no corresponding mouse equivalents. With VNC, it is advisable to check the specific devices and applications you are testing against the tools you intend to use to determine if automation is feasible.
Remote display controllers
Microsoft Remote display controller, free
SOTI Pocket controller - MS devices only.
My Mobiler – Freeware, better than MS Remote display controller for newer high res devices. MS devices only
Leak detection and execution profiling
Entrek toolbox – See discussion here.
CETK - Microsoft CE testing toolkit with a number of useful tools, Windows mobile 5.5 and up.
iPhone/iPad tools
Fonemonkey is an open source record/playback functional testing tool for iOS apps on the iPhone and iPad
XCode is an IDE including testing / debigging and simulation tools for a range of apple platforms.
Android
Ranorex: http://www.ranorex.com/mobile-automation...test automation
Android driver for selenium http://code.google.com/p/selenium/wiki/AndroidDriver
And don’t forget that other great resource for mobile testing tools
Edited by Shane_MacLaughlin (06/29/12 01:09 AM)
|
Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
And for the iPhone - xCode
-------------------- My LinkedIn profile
|
DougReeder
Newbie
Reged: 11/01/10
Posts: 4
|
|
For HP webOS (formerly known as Palm webOS), there are two tools for the JavaScript side.
The Mojo framework supports a simple automatic testing framework under the name Mojo.Test: http://developer.palm.com/index.php?id=1827&option=com_content&view=article It supports asynchronous tests (essential under webOS), but Mojo assertions only work for synchronous tests, so you'll have to roll your own assertions. There's no support for mocking nor spies, so testing UI code is generally more trouble than it's worth.
New development is probably better off using Jasmine webOS, a an extension of Pivotal's Jasmine BDD framework that runs under webOS. It's more idiomatic and has a rich set of assertions. It supports mocking and spies. Currently, mocks for UI objects such as controllers are little-developed, but as an open project, it's easy to add the support you need. http://pivotal.github.com/jasmine-webos/
|
tommasodwyers
Newbie
Reged: 10/25/10
Posts: 3
|
|
For testing mobile applications on real handsets, I use http://www.perfectomobile.com which is a remote device access service. It is an excellent tool with great automation capabilities, plus there's a free trial so you can check it out for yourself.
|
MacQAGuy
Newbie
Reged: 11/21/09
Posts: 4
|
|
Deleted, main list updated
Edited by Shane_MacLaughlin (06/29/12 01:03 AM)
|
elixxur
Newbie
Reged: 04/28/09
Posts: 24
Loc: Chicago IL
|
|
The only thing about this http://www.perfectomobile.com site is that anyone can access this phones, so the user must clear the history manually or else anyone can see what was tested.
-------------------- Do you let work get to you or get to work?
Edited by elixxur (03/08/11 01:23 PM)
|
UserPhriendly
Newbie
Reged: 03/09/11
Posts: 1
|
|
QC Mobile from Genilogix is an iPhone, iPad, iPod Touch app that integrates the manual testing in HP Quality Center 10+ with your iDevice. Its available in the app store, and there is a trial version. You can Download tests into your iDevice from QC, go offline and conduct your testing, then once you finish, you can upload them right back to Quality Center. Its camera enabled, so you can track your defects or irregularities. Pretty cool app. The Genilogix website has a small youtbe that shows the highlights.
|
Felix4Lin
Junior Member
Reged: 10/08/01
Posts: 7
|
|
Deleted, main list updated
Edited by Shane_MacLaughlin (06/29/12 01:04 AM)
|
alex68md
Newbie
Reged: 03/25/11
Posts: 3
|
|
Deleted, links to tools only please, start a new thread for questions
Edited by Shane_MacLaughlin (06/29/12 12:20 AM)
|
Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
Deleted, main post updated
-------------------- My LinkedIn profile
Edited by Shane_MacLaughlin (06/29/12 01:10 AM)
|
alex68md
Newbie
Reged: 03/25/11
Posts: 3
|
|
Deleted, main post updated
Edited by Shane_MacLaughlin (06/29/12 01:10 AM)
|
Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
Post deleted by Shane_MacLaughlin
-------------------- My LinkedIn profile
|
alex68md
Newbie
Reged: 03/25/11
Posts: 3
|
|
thank you
|
Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
Some more related resources, courtesy of Brad Johnson;
may be useful for some of the perf testing;
Android
CPU Usage Monitor ($.99) https://market.android.com/details?id=com.pocketappbuilders.cpuusagestatusbar
CPUMonitorMicro ($2.00) https://market.android.com/details?id=ms.salt.cpumonitormicro&feature=related_apps
iOS
Go to the iTunes Store and search on “cpu battery monitor” and you get a few nice ones:
A+ Systems Monitor (Free) System Status ($.99) System Status Lite (Free) System Activity Monitor ($.99) System Info ($.99)
RIM
MemoryUp (Free) http://www.blackberrydownload.net/download-memoryup.html
Native (NICE) Settings->Device->Application Management http://www.berryreview.com/2010/08/10/new-usage-monitor-in-blackberry-6-shows-you-cpu-usage-more/
-------------------- My LinkedIn profile
|
Shane_MacLaughlin
Super Member
Reged: 09/22/05
Posts: 1736
Loc: Dublin, Ireland
|
|
Dollop, from their web site,
"The Dollop Test Tool is a desktop application that allows you to create a test of your mobile application or website by interacting with your phone or tablet."
Still in beta by the looks of things.
-------------------- My LinkedIn profile
|
Robert Martin
Super Member
Reged: 03/22/06
Posts: 1836
Loc: Pennsylvania, USA
|
|
The sqa.stackexchange.com site has started a community wiki to answer this question.
http://sqa.stackexchange.com/q/1/453
-------------------- -Robert Martin
Automated Testing Evangelists
TestComplete "expert"
Definition expert - noun - Unknown drip under pressure
|
Elfriede Dustin
Moderator
Reged: 12/28/99
Posts: 1351
Loc: Washington, DC
|
|
Deleted, main post updated
-------------------- Elfriede Dustin
My amazon blog
Solving your Automated Software and Security Testing problems
my twitter handle @ElfriedeDustin
Edited by Shane_MacLaughlin (06/29/12 01:13 AM)
|
Brad Johnson
Special Member
Reged: 07/10/06
Posts: 194
Loc: San Jose
|
|
For performance testing the supporting infra for mobile apps, CloudTest (including the free CloudTest Lite) works really well and in a unique way. Here's how - pulled from our online doc: http://cloudlink.soasta.com/t5/Knowledge-Base/Using-a-Conductor-as-a-Public-Proxy/ba-p/80
A SOASTA Conductor installed on a given machine acts as a publicly available proxy whenever installed on a public network. HTTP(S) recording can be achieved from mobile devices with web browsers, such as the iPhone, by configuring a network proxy.
Note: The Conductor must be on a wireless network to work with wireless devices. The Conductor should also be running on the server machine when the proxy is configured. To configure an iPhone to use a Conductor as a proxy:
1. In Settings, Ensure that WiFi is set to "On" 2. Select the blue arrow to the right of the WiFi where the Conductor is installed. The Wi-Fi Networks > <network name> page appears. 3. Scroll down to the HTTP Proxy section and click the Manual tab. 4. Enter the IP address of the Conductor proxy server machine. For example, 192.168.1.114 5. Enter the Conductor proxy port. The default is 4440. If the Conductor was installed with another port, enter that port number instead.
You then treat all recordings, test execution and real-time analysis the same as any web load test.
For real-time device support - CloudTest integrates with Device Anywhere, then functional tests built in DA can be run to create the base CloudTest automated clip to run. During load tests, Device Anywhere provides performance views and duration metrics from the actual devices.
There are demos online and in our webcasts on our site: http://www.soasta.com/cloudtest/mobile-application-testing/
Brad
-------------------- ** I work for SOASTA, the CloudTest Company **
|
Brad Johnson
Special Member
Reged: 07/10/06
Posts: 194
Loc: San Jose
|
|
I see Device Anywhere is not listed: http://www.deviceanywhere.com/
Actual devices that you control remotely to build, execute and analyze tests. Several good options as well as real device monitoring (which is where CloudTest actually integrates)
-------------------- ** I work for SOASTA, the CloudTest Company **
|
daluu
Member
Reged: 08/24/06
Posts: 339
|
|
On the test automation side (via emulators):
Just learned of another tool today at a conference: SeeTest from Experitest.
And it's open source equivalent (based on similar functionality): Sikuli (in tandem with mobile device emulators).
Edited by daluu (10/09/11 12:09 AM)
|