3 Keys to Testing for Real User ConditionsIf your company is taking steps to be a more digitally engaged business, congratulations -- you're on the path to innovation and success. But when trying to deliver high quality digital products across mobile, web (mobile web, responsive web, desktop web), and IoT (Internet of things) on a variety of operating systems and networks, remember to stay focused on the all-important user experience.
Everything is driven by a winning UX: Business goals, customer satisfaction, positive app store reviews, word-of-mouth uptick and, of course, revenue. But in complex digital environments, testing just basic mobile app features under ideal conditions will fall short of delivering great UX.
For instance, to the left is a recent search for Starbucks stores in Miami using both web search and the Starbucks native mobile app (on the right). Clearly, the mobile app testing team did not test against real conditions in this case.
In today's world, it's essential to test for the real user conditions that your customers experience every day. Here are three key tips to keep in mind when making user conditions part of your testing.
Define the right users for your productsStep one is to identify your target users (aka "personas"). While this sounds easy, accurate personas can only be created through market research and data analytics; defining personas relies on consistent communication between engineering and business teams.
The next step is integrating these users and their traits into the test lab. This is usually the toughest task for engineering teams because mimicking real environment conditions is hard and requires ongoing lab maintenance.
Some of the core requirements for sustaining a lab that tests for user conditions:
- Ability to insert into the lab various network conditions, apps running in the background, phone call interruptions, and more
- Support for different geographies to cover testing of relevant users in relevant countries
- Support for any device and any operating system to sustain lab coverage as market matures
Add user conditions to existing functional tests
Once the lab is ready, DevTesters can add the relevant user conditions to existing functional tests in various ways, including manual testing, data-driven testing or through automated test code. We believe the most efficient path is through automation.
View the slides below from our recent webinar Testing Mobile Apps under Real User Conditions
Integrating these user traits into an existing continuous integration (CI) workflow and running many scenarios simultaneously will pay off in shorter release cycles, increased test coverage and, ultimately, better UX.
Related post: Quick Guide on How to Add User Condition Testing to Appium
Use reports to find and fix issuesNow that your team has defined the target personas and implemented the test code correctly, they'll now need a detailed and actionable rich media report (see below). This report should include network logs, device and app memory and battery consumption details, and timers showing how long it took certain actions to take place.
Such reports should include results for every test scenario and should allow teams to take action and fix the issues. It's also worth noting that to consistently address bug fixes, the report should compare the specific user condition tests to a "happy path" to show the contrast between real world conditions and ideal conditions.automation, digital engagement, mobile app performance, user experience, Wind Tunnel