Top 10 Mobile App Testing Mistakes to Avoid

This article will cover 10 common mobile app testing mistakes to avoid when you are a software tester working in a mobile app testing and development environment. The 10 points may help you to start your mobile testing activities if you are new to mobile testing or they may help you to recap your existing mobile testing approaches.

picture3

1. Miss the platform UI/ UX guidelines

No matter if you are testing an Android, iOS or Windows phone app you as tester must know the different platform guidelines. Those guidelines include the interaction and the design as well as common development patterns. If you don’t know them you can test your app against those requirements. However, every app must be aligned with the different platform guidelines.

2. Try to test everything

Well this is not only a pitfall for mobile apps but rather for every software out there. Testing everything is not possible and also not efficient. When you are new to an app start exploring the provided features and play with the app to learn about it. Try to narrow down the changes in the app and try to focus on those, e.g. use the context-driven testing approach to plan your testing activities. Use touring heuristics to be focused during your testing activities.

3. Mobile is not web

This point is especially hard for software testers who shift from web application software testing to mobile. The mobile use case is completely different than the web approach. Mobile users are on the move rather than in front of a stationary computer with a fixed location. Mobile apps are used in different environments e.g. during sport activities, while traveling or at work. Furthermore, mobile applications are optimized for smaller screens and have access to special hardware sensors. Therefore, it is very important for software testers to be on the move while testing the app and to keep the different mobile use cases as well as the different environments in mind.

4. Just look on the UI

Mobile applications, business software and social media networking service concept: modern black glossy touchscreen smartphone with cloud of color application icons isolated on white background with reflection effect

Unfortunately, that is what many software testers are doing. Take a look at the UI if everything is looking nice. However, mobile apps are more than just a shiny UI. Mobile apps are using plenty of APIs and those APIs itself are worth checking. Is the API delivering the correct response to the requested call? How is the API handling wrong calls with wrong data? Besides checking APIs, mobile apps rely on many backend services. It is definitely worth checking the backend function too. Is the backend mature enough to handle slow requests coming from the mobile app in EDGE network? The network itself has a huge effect on mobile apps and therefore apps must be tested in different networks, too. Check also the integration with hardware features like the different sensors. There is many more stuff to test besides the UI.

5. No in the wild testing

As already mentioned in several blog posts and tweets, mobile apps are used by your customers while they are on their move in different mobile networks. Mobile testers must leave the office to test the app in real life environments to catch some bugs that may only occur in the different network conditions.

6. Try to automate as much as you can

Writing automated checks for software is not easy. Writing automated checks for mobile apps is even more complex given all the dependencies to APIs, networks, sensors and backend systems. 100% test automation is not possible and also not efficient! Writing automated checks is expensive if you keep in mind that those checks need developing and maintenance time. Automated checks are also nothing that should be done, just because there must be some checks in place. Automated checks must be treated as production code and this requires that skilled and educated people should work on that topic. Have the mobile test pyramid in mind when you want to start test automation for your mobile apps.

7. Test only one Single Device

As we all know the mobile market is highly fragmented when it comes to hardware and software combinations. This is not an Android problem anymore, the same problem exists on all mobile platforms. Therefore, it is very important to test on various mobile devices to have a higher coverage of the different devices. However, it makes no sense to test on Android or iOS devices that are not used by your customers. Concentrate on those devices which are used by your target audience.

8. Don’t Listen to your Customers

picture of angry woman shouting at phone

Check the app store reviews of the mobile platforms on a regular basis to see what your customers say about your app. Sometimes there is valuable feedback that may help you to find and fix a problem. It is also worth to check the social media platforms for error, bug reports or direct feedback that indicate problems. If the company has a customer support department, go to your colleagues and talk to them about possible problems. If you have the chance to talk or respond to your customers use that instrument to get in contact with them. In that way customers feel appreciated and welcome and they may change their mind about the product and will provide better feedback once the problem is solved. If there are customers who deliver great feedback ask them to become a beta tester of your app to use their engagement in the product to turn them into a valuable source.

9. No update/ installation testing

Installation and update testing an app is crucial for every mobile tester. The installation is the first thing a customer will see from your product and from your company. If the first impression is a bad one, they will most likely delete the app with a single tap from their devices. Therefore, it is important to test the installation and update process of your app. Read about update testing in this post.

10. No security testing

Most of us know that security is a very important topic for every software product out there. We also know that security testing is not easy and therefore it is really important to talk to experts to ask them in security related topics. A first starting point for all of you might be the OWASP pages, they offer nice lists and overviews of potential security problems in software. However, use those lists to question your app and the architecture the app relies on. Then get in contact with experts to check mobile apps for security problems. Sad but true, security testing comes in many cases way too late when really bad stuff happened.

Now that you have read the 10 common mobile app testing mistakes, you should check your testing activities if you miss something in your daily work. Maybe the overview will help you to become a better mobile tester.

#HappyTesting

 

Daniel Knott

Daniel is a mobile testing expert working as Senior Software Test Engineer at XING’s Android team. He started his software testing career in 2003 as a trainee at IBM Germany. After his time at IBM, Daniel studied computer science with a focus on software development and testing. Since 2009, Daniel has worked for companies such as Accenture, AOE and XING. In several agile development projects he tested web, desktop or mobile applications. However, mobile testing became his passion and since the beginning of 2011 he is working in the mobile development and testing industry. He worked and is working with several mobile test automation tools such as Robotium, Calabash for iOS/ Android, Espresso and Keep It Functional. With the help of this tools, he developed a fully automated testing environment for Android and iOS.

Daniel likes to share his knowledge and therefore he started to share his experience on his blog www.adventuresinqa.com” as well as in several testing magazines. Daniel is a well-known mobile expert, a speaker at various conferences in Europe and since 2014, he is the author of the book “Hands-On Mobile App Testing“, more information about the book can be found at www.handsonmobileapptesting.com .

Get in touch with Daniel:
– Twitter: @dnlkntt (https://twitter.com/dnlkntt)
– XING: Profile (www.xing.com/profile/Daniel_Knott)

Daniel Knott
Daniel is a mobile testing expert working as Senior Software Test Engineer at XING’s Android team. He started his software testing career in 2003 as a trainee at IBM Germany. After his time at IBM, Daniel studied computer science with a focus on software development and testing. Since 2009, Daniel has worked for companies such as Accenture, AOE and XING. In several agile development projects he tested web, desktop or mobile applications. However, mobile testing became his passion and since the beginning of 2011 he is working in the mobile development and testing industry. He worked and is working with several mobile test automation tools such as Robotium, Calabash for iOS/ Android, Espresso and Keep It Functional. With the help of this tools, he developed a fully automated testing environment for Android and iOS. Daniel likes to share his knowledge and therefore he started to share his experience on his blog at http://www.adventuresinqa.com as well as in several testing magazines. Daniel is a well-known mobile expert, a speaker at various conferences in Europe and since 2014, he is the author of the book “Hands-On Mobile App Testing“, more information about the book can be found at http://www.handsonmobileapptesting.com. Get in touch with Daniel:
– XING: Profile ( www.xing.com/profile/Daniel_Knott )
Daniel Knott on Twitter

The Related Post

25% of Americans own a tablet. Up from 11% of U.S. adults in July of 2011 to 18% in January of 2012. – Pew Internet & American Life Project Nigeria has close to 100 million mobile phone lines, making it Africa’s largest telecoms market. – Nigerian Communications Commission Google plans to sell 200 million Android ...
Devices matter. We don’t yet trust the mobile devices like we trust desktops and laptops. In the course of testing traditional web applications, rarely do you have to think about the model of the actual machine. In mobile, however, the behavior of an application can vary from device to device. You can no longer just ...
Removing the barriers to move and better mobile testing. Over the last decade, application testing has continually proved itself to be an important concern. When done well, testing can drastically reduce the number of bugs that make it into your release code (and thus actually affect your users). In addition, good testing approaches will help your ...
To help testers gain an edge, here’s a list of free resources Mobile testing is making leaps and bounds of progress in the overall testing space. As this field is highly dynamic, a tester must constantly evolve and improvise his or her knowledge of mobile testing. To help software testers gain an edge, I have compiled the following list ...
Organizations need to implement automated testing strategies designed specifically for mobile applications. Mobile device usage continues to gain momentum at increasing speed. Enterprises that delay mobile adoption face the danger of becoming competitively disadvantaged. But, before jumping in headlong, you need to be fully aware of the unique challenges that can arise when developing and implementing ...
What you need to know in order to have effective and reliable Test Automation for your mobile apps I realized that Test Automation interfaces are pivotal to effective and efficient Test Automation, yet very few people trying to test their mobile apps seemed to know how their automated tests connected with the apps they wanted ...
iOS culture, even in many large organizations with skilled engineers, is behind on up-to-date testing practices. Agile development has long been all the rage; indeed, in most modern development shops the great agile methodologies are old hat. If you come from a software background like Ruby on Rails, Python, or certain Java niches, you may–until ...
The mobile application ecosystem is very dynamic. OEMs are launching new devices and new customization, and new OS versions are delivered every now and then. This is the constant challenge that most enterprises face.
LogiGear Magazine – November 2011 – Mobile Application Testing Issue
Don’t make the mistake of assuming too many similarities. It is common knowledge that mobile applications don’t function in the same way as their web-based counterparts. The user experience is affected by a few other factors such as device and network capability. If you are building out a performance testing strategy for your mobile website ...
LogiGear Magazine, September 2015: Mobile Testing
                                                                                                              ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe