Developing A Mobile Testing Strategy

In today’s mobile-first world, a good app is important, meaning an effective Mobile Testing strategy is  essential.  

We recently started working with a new client on a Mobile Testing project. As with many mobile-first and mobile-only companies, their first question was how to develop a Mobile Testing strategy for ensuring quality in this constantly shifting mobile landscape. For starters, building out a Mobile Testing strategy requires several dimensions including:

  • Functional
  • Platform Compatibility (OS/Devices)
  • Network Variances
  • Performance
  • Test Automation
  • Integration
  • Usability and User Experience

Each of these mobile QA and test strategy dimensions are summarized below.

Mobile Functional Testing

When you approach Mobile Functional Testing, you need to start with the type(s) of mobile application (Pre-Installed Mobile Applications, Native Mobile Applications, Mobile Hybrid, Mobile WebApp, Mobile Website, etc.) you’ll be working on and then build out the important characteristics to be tested for each type. Functionality is assumed across platforms, but there are many other platform specific functionality differences and considerations.

Mobile Platform Compatibility

Because a mobile application must be compatible with native device features and not interfere with or inhibit common functions, mobile QA needs to incorporate the capabilities and limitations of different device/OS platforms in order to differentiate defects from platform limitations. With so many permutations and combinations to test, it’s critical to have a strategy for prioritizing the combinations to be tested. With such a large number of test permutations, simulators and remote devices provide reasonable alternatives. In the end, you’ll need a combination of real, emulated, and remote devices and have to figure out when it’s best to use each option.

Network Variances

One of the special aspects of Mobile App Testing is that it involves more than the mobile phone or application. Network configurations can significantly impact your application’s performance and impact your test environment. Network variations including 2G, 3G, 4G, LTE, CDMA, GPRS, GSM, HSCSD, SIM, and WAP should make up a critical part of your test matrix depending on your target market. Adding 5G will only increase complexities.

Mobile Performance

Performance is much more complicated with mobile applications as the pieces are disjointed and not well integrated. There are 3 main components: server, network, and mobile device with application. You need to be cognizant of each component while determining your strategy based on the type of mobile application discussed above. Many don’t prioritize Performance Testing as they should, only to realize way too late.

Mobile Test Automation

As with regular Automation, Test Automation for mobile follows the same rules; it makes no sense to automate where it’s not economical. Don’t automate tests that aren’t run often or tests that will need to be changed frequently due to an application that is changing often. There are many Automation tools available, some open source and commercial. In the end, Mobile Automation concerns are much deeper than tools.

Integration

With the popularity of wearables and IoT devices, the importance of integration comes to the forefront. Almost all wearables are dependent on the mobile smartphone as a communications and processing hub. Inherent in their functionality is communication with the smartphone either through WIFI, Bluetooth or NFC, and sometimes a combination. The usage of these interfaces and the gathering of data broadens the concerns for security and privacy.

Usability and User Experience

Getting a product out that is functional is not enough. Touch enabled and haptic interfaces make the interaction between the user and the device more direct and personal. The distance between user and device is reduced not just physically but also emotionally, and users create a relationship with the device, hence the importance of user experience in mobile applications.

Summary

If you’re developing a mobile app, you probably didn’t realize all the things that go into assuring its quality. In the end, it takes more than the ‘wow’ factor in screen design.

Philip Lew
Philip Lew is the CEO at XBOSoft. As a Corporate Executive, Development Manager, Product Manager, and Software Engineer, Philip has managed teams to tackle broken processes, develop solutions to difficult problems, and coached others to be leaders, managers, and experts. He leverages his academic background in Operations Research and Computer Science combined with hands-on work experience in programming, predictive modeling, and algorithm development to work with clients and colleagues around the world in improving their software processes.

The Related Post

This article was adapted from a presentation titled “How to Turn Your Testing Team Into a High-Performance Organization” to be presented by Michael Hackett, LogiGear Vice President, Business Strategy and Operations, at the Software Test & Performance Conference 2006 at the Hyatt Regency Cambridge, Massachusetts (November 7 – 9, 2006). Introduction Testing is often looked ...
One of the most common challenges faced by business leaders is the lack of visibility into QA activities. QA leaders have a tough time communicating the impact, value, and ROI of testing to the executives in a way that they can understand. Traditional reporting practices often fail to paint the full picture and do not ...
Creative Director at the Software Testing Club, Rob Lambert always has something to say about testing. Lambert regularly blogs at TheSocialTester where he engages his readers with test cases, perspectives and trends. “Because It’s Always Been Done This Way” Study the following (badly drawn) image and see if there is anything obvious popping in to ...
CEO and founder of mVerify Corporation, Robert V. Binder tackles questions from field testers regarding such issues as strategic considerations when dealing with single stack apps versus globalized enterprise mobile apps, and methods and tools that developers and testers should be aware of. He also offers his own advice from lessons learned from experience. 1. ...
The key factors for success when executing your vision.   There is an often cited quote: “…unless an organization sees that its task is to lead change, that organization—whether a business, a university, or a hospital—will not survive. In a period of rapid structural change the only organizations that survive are the ‘change leaders.’” —Peter ...
Gal Tunik explains the necessity of test automation in mobile applications, citing the unique challenges that that platform raises, including the intricate differences between mobile and desktop interfaces, and performance test results for applications as well as mobile networks. It is no surprise in this day and age of instant-on gratification that mobile devices are ...
Testing appears to be the least popular topic in Android development circles based on the relatively few books on Android app testing. Most tend to focus on development because, unfortunately (but true), application testing isn’t be something most developers think much about, or if they do, they don’t do it systematically (I’m guilty of this ...
Regardless of the method you choose, simply spending some time thinking about good test design before writing the first test case will have a very high payback down the line, both in the quality and the efficiency of the tests. Test design is the single biggest contributor to success in software testing and its also ...
Test engineers face a rapidly changing mobile application landscape, making mobile test automation a necessity. We know that mobile apps are becoming increasingly complex along with the technological advances in tablets and smartphones. Test engineers have to address multiple challenges while testing data-centric mobile apps, including the growing diversity of device features, platforms, and technologies. Fortunately, ...
LogiGear Magazine – September 2013 – Mobile Testing
This article was developed from concepts in the book Global Software Test Automation: Discussion of Software Testing for Executives. Quality cost is the sum of all costs a company invests into the release of a quality product. When developing a software product, there are 4 types of quality costs: prevention costs, appraisal costs, internal failure ...
There are many ways to approach test design. These approaches range from checklists to very precise algorithms in which test conditions are combined to achieve the most efficiency in testing. There are situations, such as in testing mobile applications, complex systems and cyber security, where tests need to be creative, cover a lot of functionality, ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe