Professional Documents
Culture Documents
UX app
analysis
techniques to
win over
customers
A pocket guide to experience analytics.
Table of contents
01
02
Quantitative methods
Funnel analysis
Custom event inspection
Session exploration
03
Qualitative methods
Voice-of-customer research
Gesture-based heatmaps
Session recording
Behavioral screen flow
04
Technical method
Crash vs. issue analytic
Issue analytics with integrated session replay
01
CHAPTER 01
Understanding mobile
experience analytics
02
CHAPTER 01
Understanding mobile
experience analytics
03
There are multiple avenues when it comes to understanding user
behavior. User research and usability testing is a concept that has
been around for a while. It's an excellent method that involves deep-
dive research techniques from a usually small sample of your users.
But what's the catch? Although you can acquire deep user insights,
it’s costly and requires a considerable investment into either in-
house user researchers or specialized research agencies. Moreover,
it is often hard to validate research findings due to the smaller
samples available for qualitative research methods.
1 Quantitative
analytics
Experience
analytics
3 Qualitative 2 Technical
analytics analytics
04
1. Quantitative analytics:
Once the relevant attributes have been defined, the segmented data
can be organized in various structured formats. A common
technique in mobile apps is to create funnels based on the defined
customer journey.
2. Technical analytics:
05
3. Qualitative analytics:
Qualitative analytics is the trickiest area and is often not easy to get
right. There are multitudes of deep user experience insights that can
only be uncovered via qualitative analysis.
06
CH APTER 02
Quantitative methods
07
CHAPTER 02
In most analytics tools, once data is captured, you can get started
with aggregate analysis on sessions and users. The best way to get
started is to use attributes for segmentation.
App version
Driver class
Device model
Screen size
OS version (e.g., iOS 14.5)
Geo data
Number of screens viewed
Number of events completed
Screen size
Time spent in app
First-visit data
Number of sessions
Session duration
Carrier name
On the other hand, the above metrics tell very little about the actual
gestures can already enrich your quantitative reports and provide the
Funnel analysis
that users need to meet the end goal. The end goal will, of course,
mobile app.
case, the key milestones are simple, and the journey is typically
Added to cart
Purchase
Checkout started
09
Most funnels will only work in tandem with custom event analytics.
accurate data.
But there are many other ways to create funnels. The funnel setup
can be very long. There are multiple moments of truth that such
10
The following funnel is an example that banks often use for credit
Credit repaid
100%
21k
60.45%
13k
82.35%
8.4k 27.56%
28.65%
2.3k 21.39%
6.1k 22.52%
1.3k
4.8k
These steps allow such companies to track the user journey from
transaction.
In the case of UXCam funnels, users can easily filter sessions based
instance, they can easily see which users abandoned the funnel.
above.
11
why these drop-offs are happening. To get more answers behind the
The number of food and grocery delivery startups has been rising in
The following showcases how a funnel looks for online food order
companies:
Funnel 1 Funnel 2
Locate address
Checkout initiated
saved address selected or new address picked
Restaurant selected
12
Custom event inspection
The classic transactional funnel, while still relevant, doesn’t tell the
whole story. Choose a tool that allows for custom events instead of
sticking to the typical metrics like registration or password setting.
Set specific events that meet your needs, like whether the user has
engaged with a new feature or whether they’ve completed a given
step.
13
Session exploration
application.
Pick and choose the KPIs based on your product needs and what
Consider tracking:
*Rage taps are repeated clicks on a specific area, an action often caused by frustration.
By analyzing these metrics over time, you can see trends and draw
14
CH APTER 03
Qualitative methods
15
CH APTER 03
Qualitative methods
16
Doing this type of research is helpful for
The App Store or Google Play reviews are great places to start looking for
mobile app reviews. They are a powerful source of feedback that often gets
overlooked. Users are actively reviewing your product — mostly whenever deeply
frustrated or highly satisfied with it. Focus on both sides to know what’s
working and what isn’t.
Pay special attention to the negative reviews, and quantify the number of users
that mention a specific topic, e.g., the app crashing as they’re about to perform
a frequent action. Classify topics by urgency and tackle them when possible.
The beauty of using reviews as a source of research is that they usually come in
larger numbers and are left by users who found your app appealing — at least
when they first downloaded it. The demographic covered here has already
proven to be interested in what you have to offer.
17
Other VoC methods
Understanding user experience User testin After or while using the app
Passive feedback
18
If understanding user motivations and goals is what you’re aiming
polls would be better. On the other hand, this type of user research
Gesture-based heatmaps
Heatmaps visualize how users engage with your app. The more
elevated the temperature — and the warmer the color shown on the
visual representation.
shows where users are clicking the most on any given screen. Pure
clicks may have proven sufficient back in the day, but we all know
that single clicks — or taps — aren’t the only way people interact with
mobile apps.
Other gestures that can and should be tracked with heatmaps are:
Double
Long
Swipes
Rage
Unresponsive
right)
19
Depending on the functionality of the elements of the screen, one
type of heatmap or the other will aid more in the analysis. Rage taps
and unresponsive taps will give you instant insights into what isn’t
working on your app from a UX perspective. Every time a user rage
taps on your app, they’re begging you to fix an issue that’s leading to
frustration and, possibly, churn.
20
Session recording
sounds like: The entire session is captured from start to finish and
made available so you can watch it. Replaying sessions provides the
you, use a tool that allows you to filter the sessions by the metrics
example, flag sessions with rage taps, observe the heatmap of the
21
This method lets you monitor engagement on the app without
exposing any personally identifiable information (PII) like address or
credit card information. Any data that qualifies as such should
always be treated with care. UXCam doesn’t store it and
automatically hides it for and from you.
your app."
Funnels are built off of assumptions, and screen flows show you
what users are doing from the moment they open your app until the
moment they close it. Screen flows validate funnels, prove your
hypotheses, or show what unexpected paths users take in your app.
The advantage of screen flows is that personal bias can be taken
out of the equation.
22
Filter which first and last screen you want to appear on the flow to
get concrete insight into how users go from one screen to another —
and how they perform specific actions. You may be surprised to find
out what the most popular ways are of getting to a certain screen.
You can also compare the screen flow from users that have only
been on your app once to those who have visited at least five times
screen. You can review the sessions of the users that went on the
With this feedback, you can facilitate flows in a natural way through
Start With
Overview
Sessions
Users
Events
Heatmaps
Screen Flow
Funnels
Insights
Issues
23
CH APTER 04
Technical methods
24
CHAPTER 04
Technical methods
Analyze the more technical aspects of your app that have a direct
impact on the user experience.
Crash issues are dangerous because users don’t forgive them: They
quickly grow frustrated and potentially look for a competitor or
delete the app if they occur too often. In fact, more than half of
users will uninstall your app if it crashes or freezes. For that reason,
you need to go beyond crash analytics and also keep track of the
issues that cause them.
Handled exceptions
25
Keeping track of handled exceptions allows developers to prioritize,
and gives them the necessary context to finding a permanent
solution.
Unhandled Exceptions
26
Issue analytics with integrated session replay
These logs help developers diagnose what happened when the app
crashed. However, this can still leave a few unanswered questions
and requires additional investigation.
27
In most cases, more context is required about how a user ended up
in a crash, such as:
Long story short, the missing piece is the user’s experience. The
easiest way to answer the above questions is to use session replay.
UXCam offers an integrated session replay solution within its issue
analytics feature. But how does this look in reality?
Until this point, we've mainly been covering how developers can use
issue analytics. However, our collaboration features aren't restricted
to the tech team.
Having access to a tool like UXCam's issue analytics can easily filter
out users who recently experienced crashes, UI freezes, or even rage
taps.
Screens Notes
Save note
29
The above example shows how comments can be left on specific
sessions. Whether you tag a team member or share a link in a Jira
ticket, these comments will appear when a developer opens the
session.
30
CHAPTER 05
Experience analytics
case studies
31
CHAPTER 05
32
CASE STUDY 01
The funnel revealed how many users went from the registration
screen to the password-created page to the complete registration
screen. They noticed a quarter-to-quarter drop in the conversion rate
to the last step of the registration funnel. Since they’d released a
new version since the previous quarter, they had additional data to
33
The hypothesis was that there was an issue with the app’s password
creation page in the latest version, so they set up two events:
password fails and password success. As the data rolled in, it was
clear that password failures were spiking. To complete the picture,
the team turned to qualitative data.
Tracking user behavior with a heatmap, the Bean Roasters team saw
that people were tapping all over the password screen, indicating
frustration — or rage taps. Session recordings revealed users could
not use special characters in their passwords. By the end of the
analysis, the product team confidently concluded that 15% of new
users dropped off the app after entering invalid passwords — this
actionable insight was brought to the attention of the development
team. Once the team resolved the password issue, they continued to
test the app.
Poorly-timed pop-ups
After months of testing, they saw that there was still drop-off after
users successfully created their passwords. Looking back at the
heatmaps, customers were repeatedly tapping the next screen to
remove an additional Coffee Club Card pop-up ad on the complete
registration page. The repeated tapping of the same screen was
flagged as rage tapping, indicating that the customers were once
again frustrated with getting to the next page. The product team
removed the mistimed pop-up and put in a push notification for later
down the funnel for the Club Card.
34
CASE STUDY 02
To avoid the bias and high cost of frequent in-person interviews, they
turned to UXCam to scale their qualitative user feedback. They set
intended usage goals, tracked different objectives, created
hypotheses based on the results, and tagged and collated evidence
via session recordings.
Home.com* is a fast-growing online real estate platform based in New York. The property search
platform enables users to filter homes and apartments based on specific criteria and offers
apartments for rent and purchase.
35
Improving search functionality with heatmaps
The session replays feature also helped them better understand the
decreasing adoption rate of new features. Among the many
observations, they learned that their most-used tool, the search bar,
was the source of user frustration on the app. After seeing the
problem pages in the replay videos, the product team dug deeper
using heatmaps. The map detected a high amount of rage taps while
using the new search bar. The team hypothesized that most users
wanted to search for houses across multiple cities within a single
search. Customers were frustrated with manually adding new cities
every time they searched.
With this actionable piece of insight, the team revamped the design
of the search bar, enabling users to select multiple locations easily.
The heatmaps enabled the Home.com team to validate their test
results and found the most optimal solution with the highest level of
engagement.
With the search experience improved, it's fast becoming one of the
app's most used features, with the adoption rate growing from 20%
to 40% since the fix.
36
CASE STUDY 03
active users
workout plans after enrollment and that the time spent on their app
They used UXCam to drill down deeper into the user experience. The
flow, they learned who the most active customers were, their
One of the breakthrough learnings was that the most highly engaged
With this data, the team provided a new content category that
Fit2Go* is a mobile app that delivers live and on-demand workouts. Subscribers can access
37
The Fit2Go team made improvements based on a comprehensive
picture of feature engagement through session recording, event
analytics, and heatmaps. The qualitative insights enabled the team
to make further iterations to their product roadmap. In the next
quarter, user sign-ups increased by 181%, the total app sessions and
time spent in-app increased by 415% and 460%, respectively.
38
Want to see more of what
UXCam can do for your app?
Book a demo with one of our experts.
Book a demo