Mobile & Web Performance Testing

shutterstock_81380530,84284302.h850

Don’t make the mistake of assuming too many similarities.

It is common knowledge that mobile applications don’t function in the same way as their web-based counterparts. The user experience is affected by a few other factors such as device and network capability. If you are building out a performance testing strategy for your mobile website or native mobile application, avoid migrating your existing test plans to a mobile environment, because it’s not that easy. There are extreme differences between performance testing of mobile and web applications, and you need a plan that gives those factors the attention they deserve.

Mobile and web performance testing are not similar to each other. Mobile apps require specialized testing strategies along three key vectors that don’t typically apply to traditional web-based apps. In this article, we will impart the best practices to build a suitable set of test plans. It is your responsibility to ensure your users get an excellent experience irrespective of the device — desktop or mobile.

The device is the key difference

Web servers are aware of the device an existing user has and will often send users different content — or send them a completely different mobile version of the site. Furthermore, responsive web applications are designed to adjust their look, feel and behavior based on the size of the screen being used.

This makes performance testing of your web or mobile application with different devices extremely important, because each device has the tendency to translate the content of the application differently — which could affect the performance in great ways.

It is essential to have a clear performance testing plan to understand how these iterations affect your application’s performance features. Your mobile performance testing plan needs to take into account different factors that include processing power, screen size, bandwidth capabilities, platform, parallel connections, and more.

Chak_Takeaways.01

Network — an important factor

Mobile devices in this generation generally access the server over networks that are slower than those used by desktop computers. Network conditions have a significant effect on the user experience, and the effect may be more or less pronounced depending on the application. Low bandwidth increases the time it takes to download a resource, which then results in higher page load times. If the customer is connected longer, front-end servers hold sockets longer, load balancers have more active TCP sessions, and application servers use more threads.

Mobile networks have limited bandwidth and high latency compared to Wi-Fi and broadband. Since the latency increases with any time added to each request and web pages are composed of many sub-requests, the time required to load a webpage on a mobile device greatly depends on the latency. In fact, latency can become a bigger bottleneck than performance due to physical limitations of networks. Even connections with very high bandwidth can’t get around latency issues. Limiting bandwidth and simulating latency and packet loss during a load test allows you to check that all of your users, including mobile users, will get the best user experience and acceptable response times while ensuring your servers won’t have problems under load.

Chak_Takeaways.02

High expectations are liable

According to a survey conducted by EffectiveUI, a majority of the 780 individuals surveyed will abandon a mobile app if the performance is slow or difficult or confusing to use. Similarly, if a web application is too slow, even by milliseconds (according to Google engineers), users will abandon your website.
In this fast-paced world, when you load test your application with user experience in mind, you have to take into account a new set of failure scenarios too. Reset the criteria of good and bad performance according to your users. Ask: Will your users bear any kind of delay on their device? Or will they switch applications? Take into account the responsiveness on the device. Is the content being downloaded and accessed quickly enough to keep users happy and interested? If yes, it is, then bingo! — you are heading in the right direction.

Chak_Takeaways.03
As an organization or as a tester, try and empathize with the end-user experience and design test scenarios accordingly. Remember the customer doesn’t really give second and third chances to an application if it doesn’t work — he instead leaves the application. This impacts the business and thus the reputation of the organization/application.

 

This article originally appeared in The Official 360Logica Blog at http://www.360logica.com/blog/2014/06/mobile-web-performance-testing.html

 

Atin Chak
Atin Chak is a Senior Automation QA at 360Logica Testing Services. He has expertise in web application and desktop application testing with 10 years of experience.
Atin Chak
Atin Chak is a Senior Automation QA at 360Logica Testing Services. He has expertise in web application and desktop application testing with 10 years of experience.

The Related Post

This article will cover 10 common mobile app testing mistakes to avoid when you are a software tester working in a mobile app testing and development environment. The 10 points may help you to start your mobile testing activities if you are new to mobile testing or they may help you to recap your existing mobile testing ...
The most significant facet of mobile testing is understanding the mobile ecosystem. Mobile applications are growing in use and sophistication along with the speed of the networks and the increasing power of the devices. To be sure, mobile application testing can be done with minimal automation, but a high level of test automation will help ...
LogiGear Magazine December 2012 – Mobile Test Automation  
25% of Americans own a tablet. Up from 11% of U.S. adults in July of 2011 to 18% in January of 2012. – Pew Internet & American Life Project Nigeria has close to 100 million mobile phone lines, making it Africa’s largest telecoms market. – Nigerian Communications Commission Google plans to sell 200 million Android ...
Here’s some good news: Jonathan Kohl has a new book out titled Tap Into Mobile Application Testing. This is a Leanpub release and is still in Beta, but the beauty of buying through Leanpub – you get all the author updates as they make them! However I will be keeping an eye out for the print-on-demand ...
Organizations need to implement automated testing strategies designed specifically for mobile applications. Mobile device usage continues to gain momentum at increasing speed. Enterprises that delay mobile adoption face the danger of becoming competitively disadvantaged. But, before jumping in headlong, you need to be fully aware of the unique challenges that can arise when developing and implementing ...
Testing appears to be the least popular topic in Android development circles based on the relatively few books on Android app testing. Most tend to focus on development because, unfortunately (but true), application testing isn’t be something most developers think much about, or if they do, they don’t do it systematically (I’m guilty of this ...
Convergence of Social Media, Mobile, Analytics, & Cloud [SMAC] is one of the hottest trends these days. It is a major business agenda forcing organizations to rethink their strategies and increase technology investments in this direction.
LogiGear_Magazine_December 2016_Riding the New Software Testing Wave  
Test engineers face a rapidly changing mobile application landscape, making mobile test automation a necessity. We know that mobile apps are becoming increasingly complex along with the technological advances in tablets and smartphones. Test engineers have to address multiple challenges while testing data-centric mobile apps, including the growing diversity of device features, platforms, and technologies. Fortunately, ...
In today’s mobile-first world, a good app is important, meaning an effective Mobile Testing strategy is  essential.  
Drawing from the Greek mythology of the lotus eaters, Anne-Marie Charrett warns testers to be weary of enjoying early success too soon upon finding high impact bugs.

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe