Developing A Mobile Testing Strategy

In today’s mobile-first world, a good app is important, meaning an effective Mobile Testing strategy is  essential.  

We recently started working with a new client on a Mobile Testing project. As with many mobile-first and mobile-only companies, their first question was how to develop a Mobile Testing strategy for ensuring quality in this constantly shifting mobile landscape. For starters, building out a Mobile Testing strategy requires several dimensions including:

  • Functional
  • Platform Compatibility (OS/Devices)
  • Network Variances
  • Performance
  • Test Automation
  • Integration
  • Usability and User Experience

Each of these mobile QA and test strategy dimensions are summarized below.

Mobile Functional Testing

When you approach Mobile Functional Testing, you need to start with the type(s) of mobile application (Pre-Installed Mobile Applications, Native Mobile Applications, Mobile Hybrid, Mobile WebApp, Mobile Website, etc.) you’ll be working on and then build out the important characteristics to be tested for each type. Functionality is assumed across platforms, but there are many other platform specific functionality differences and considerations.

Mobile Platform Compatibility

Because a mobile application must be compatible with native device features and not interfere with or inhibit common functions, mobile QA needs to incorporate the capabilities and limitations of different device/OS platforms in order to differentiate defects from platform limitations. With so many permutations and combinations to test, it’s critical to have a strategy for prioritizing the combinations to be tested. With such a large number of test permutations, simulators and remote devices provide reasonable alternatives. In the end, you’ll need a combination of real, emulated, and remote devices and have to figure out when it’s best to use each option.

Network Variances

One of the special aspects of Mobile App Testing is that it involves more than the mobile phone or application. Network configurations can significantly impact your application’s performance and impact your test environment. Network variations including 2G, 3G, 4G, LTE, CDMA, GPRS, GSM, HSCSD, SIM, and WAP should make up a critical part of your test matrix depending on your target market. Adding 5G will only increase complexities.

Mobile Performance

Performance is much more complicated with mobile applications as the pieces are disjointed and not well integrated. There are 3 main components: server, network, and mobile device with application. You need to be cognizant of each component while determining your strategy based on the type of mobile application discussed above. Many don’t prioritize Performance Testing as they should, only to realize way too late.

Mobile Test Automation

As with regular Automation, Test Automation for mobile follows the same rules; it makes no sense to automate where it’s not economical. Don’t automate tests that aren’t run often or tests that will need to be changed frequently due to an application that is changing often. There are many Automation tools available, some open source and commercial. In the end, Mobile Automation concerns are much deeper than tools.

Integration

With the popularity of wearables and IoT devices, the importance of integration comes to the forefront. Almost all wearables are dependent on the mobile smartphone as a communications and processing hub. Inherent in their functionality is communication with the smartphone either through WIFI, Bluetooth or NFC, and sometimes a combination. The usage of these interfaces and the gathering of data broadens the concerns for security and privacy.

Usability and User Experience

Getting a product out that is functional is not enough. Touch enabled and haptic interfaces make the interaction between the user and the device more direct and personal. The distance between user and device is reduced not just physically but also emotionally, and users create a relationship with the device, hence the importance of user experience in mobile applications.

Summary

If you’re developing a mobile app, you probably didn’t realize all the things that go into assuring its quality. In the end, it takes more than the ‘wow’ factor in screen design.

Philip Lew
Philip Lew is the CEO at XBOSoft. As a Corporate Executive, Development Manager, Product Manager, and Software Engineer, Philip has managed teams to tackle broken processes, develop solutions to difficult problems, and coached others to be leaders, managers, and experts. He leverages his academic background in Operations Research and Computer Science combined with hands-on work experience in programming, predictive modeling, and algorithm development to work with clients and colleagues around the world in improving their software processes.

The Related Post

Testing appears to be the least popular topic in Android development circles based on the relatively few books on Android app testing. Most tend to focus on development because, unfortunately (but true), application testing isn’t be something most developers think much about, or if they do, they don’t do it systematically (I’m guilty of this ...
  Mobile analytics experts Julian Harty and Antoine Aymer have teamed up to deliver a 161-page handbook designed to help you “enhance the quality, velocity, and efficiency of your mobile apps by integrating mobile analytics and mobile testing”.
“Combinatorial testing can detect hard-to-find software faults more efficiently than manual test case selection methods.” Developers of large data-intensive software often notice an interesting—though not surprising—phenomenon: When usage of an application jumps dramatically, components that have operated for months without trouble suddenly develop previously undetected errors. For example, newly added customers may have account records ...
Plan your Test Cases with these Seven Simple Steps What is a mind map? A mind map is a diagram used to visually organize information. It can be called a visual thinking tool. A mind map allows complex information to be presented in a simplified visual format. A mind map is created around a single ...
LogiGear Magazine – February 2014 – Test Methods and Strategies
There are many ways to approach test design. These approaches range from checklists to very precise algorithms in which test conditions are combined to achieve the most efficiency in testing. There are situations, such as in testing mobile applications, complex systems and cyber security, where tests need to be creative, cover a lot of functionality, ...
Differences in interpretation of requirements and specifications by programmers and testers is a common source of bugs. For many, perhaps most, development teams the terms requirement and specification are used interchangeably with no detrimental effect. In everyday development conversations the terms are used synonymously, one is as likely to mean the “spec” as the “requirements.”
Great mobile testing requires creativity to find problems that matter. I’d like to take you through the thought process of testers and discuss the types of things they consider when testing a mobile app. The intention here is to highlight their thought processes and to show the coverage and depth that testers often go to.
VISTACON 2010 – Keynote: The future of testing THE FUTURE OF TESTING BJ Rollison – Test Architect at Microsoft VISTACON 2010 – Keynote   BJ Rollison, Software Test Architect for Microsoft. Mr. Rollison started working for Microsoft in 1994, becoming one of the leading experts of test architecture and execution at Microsoft. He also teaches ...
Training has to be fun. Simple as that. To inspire changed behaviors and adoption of new practices, training has to be interesting, motivating, stimulating and challenging. Training also has to be engaging enough to maintain interest, as trainers today are forced to compete with handheld mobile devices, interruptions from texting, email distractions, and people who think they ...
What you need to know for testing in the new paradigm This two part article analyzes the impact of the Internet of Things (IoT) product development on traditional testing. Part one of this series starts with a wide view on the IoT, embedded systems and device development aspects of testing. Part two, to be published ...
It’s a bird! It’s a plane! It’s a software defect of epic proportions.

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe