Factors Magazine From Perfecto Edition 9-2018

Factors is a reference guide for
cross platform testing of digital apps

Apply Perfecto’s Triple E Coverage Strategy:
Essential, Enhanced & Extended
NEW
Expanded Coverage:
Denmark Norway Sweden
Denmark, Finland and Sweden rank numbers one, two and three in
Europe in terms of digitization in all of Europe.
In a constantly changing market,

Objective market data
digital app teams must keep up:
45 %
30 %
Windows 7 Huawei market
market share share in European
and Asian grows
COUNTRIES EMEA: EU5,
16
UK, Germany,
North and South Netherlands,
America: U.S, Switzerland, Italy,
Canada, Brazil Spain, France
COVERED APAC: Australia,

China, India
2
Table of Contents
Why We Created Factors................................................................................ Pg. 4
Here’s your answer: The Perfecto Coverage Methodology..................................... Pg. 5
The solution Part 2: Putting it into your development process............................. Pg. 7
Indexes by Country
Global Web Index ........................................................................................ Pg. 10
North and South America
U.S........................................................................................................ Pg. 11
Canada................................................................................................... Pg. 12
Brazil..................................................................................................... Pg. 13
EMEA:
EU5....................................................................................................... Pg. 14
UK......................................................................................................... Pg. 15
Germany................................................................................................. Pg. 16
Netherlands............................................................................................ Pg. 17
Switzerland............................................................................................ Pg. 18
Italy...................................................................................................... Pg. 19
Spain..................................................................................................... Pg. 20
France.................................................................................................... Pg. 21
Nordics:
Denmark................................................................................................ Pg. 22
Norway.................................................................................................. Pg. 23
Sweden.................................................................................................. Pg. 24
APAC:
Australia................................................................................................ Pg. 25
China..................................................................................................... Pg. 26
India..................................................................................................... Pg. 27
Calendars
Mobile Market Calendar 2018......................................................................... Pg. 28
Web Browser Calendar 2018........................................................................... Pg. 29
3
Why We Created The
Factors Reference Guide
Our customers often ask us a simple question:
Which devices and browsers should I be testing my apps and websites on?
Enterprise brands recognize that the main channel for customer engagement is shifting toward digital apps. Distilled
from Perfecto's wealth of expertise in partnering with teams to implement continuous testing, Factors is a reference
guide that helps developers, QA pros and test lab managers select the best platforms on which to test their apps during
development. These teams are faced with the challenge of delivering flawless user experiences in a market beset by a
continually evolving set of platforms used by consumers worldwide; to reach their goal, they must apply a sound platform
coverage strategy at each stage of the development process.
Average number of devices per person 2017
Western Europe
9 4 Central and
Eastern Europe
North America 13 3 Asia Pacific

1 Middle East
and Africa
3 Latin America
Number of Devices and Connections Per Person by 2021
2.3 3.5
4 2016 2021
Here’s your answer: The Perfecto Coverage Methodology
The problem: coverage vs. risk technique. It is then broken down by region into sixteen countries;
the data includes platform type, model, screen size, screen
It is critical for development and test teams to make sure that
resolution, operating system, and release date. This analysis also
new and existing code behaves as expected on an array of platforms
includes trend data comparing the current quarter to the previous.
during development. With the landscape of digital platforms in
constant flux, the “what platforms to test” decision is
Perfecto helps teams identify the specific platforms on
inherently risky.
which to test, thereby lowering the risk of a poor user
Factors is designed to empower development teams by lowering the experience while utilizing the appropriate amount of
risk associated with identifying their optimal platform test coverage. testing resources.
Our analysis simplifies this task by helping teams determine a
platform coverage goal using a simple three-tier categorization. Examining the bulk of mobile traffic by operating systems reveals
We recommend combining data from this reference guide with that the Android usage is essentially split across five OS families
traffic data generated by your own customers. while iOS usage is split between three OS families. Therefore, eight
smartphones are required to cover roughly eighty percent of mobile
traffic. In addition to operating system families, displays represent
The solution: a proven methodology
a second critical coverage aspect. Analyzing display characteristics
With unparalleled experience in digital app quality, Perfecto identifies important clusters between screen size and pixel density.
is in a unique position to help you choose the right set of platforms We have grouped these into categories: small, normal, large, and
for your test lab. The Factors reference guide analyzes actual extra-large. When display characteristics are taken into account,
traffic for desktop browsers, smartphones, and tablets, across the importance of including tablets, with their extra-large displays,
operating systems. becomes readily apparent. Our top-10 list of smartphones and
tablets represents the highest-usage platforms when accounting
For mobile devices, platforms are selected based on an analysis for operating system, display characteristics, and model.
of global web traffic combined with testing activity performed by
over 3,000 Perfecto customers, measured quarterly. The dataset
is generated by applying a patented user agent string-parsing
> 1920px
1280px - 1920px XL
960px - 1280px L
< 480px M
Source: Android Support Different Screen Sizes (https://developer.android.com/training/multiscreen/screensizes.html)
5
Keystones
376 387
Color
System C54 M0 Y100 K0 C12 M0 Y80 K0
R130 G188 B65 R227 G233 B53
Foundations
Color is a powerful component of
the Perfecto identity system. It’s Black 3 7460 7493 7545 355 5503
often the first perceived attribute of
a brand and creates an undeniable
first impression in the minds of the
audience. Our color palette speaks
to customers before they even have
a chance to recognize the related
words or graphics. That’s why color
is such an important part of creating
excitement, setting a mood, ex-
pressing personality and conveying
brand attributes. C67 M44 Y67 K95 C100 M6 Y2 K10 C25 M4 Y44 K3 C58 M32 Y18 K54 C91 M0 Y100 K0 C39 M2 Y14 K10
R33 G39 B33 R0 G134 B191 R187 G197 B146 R66 G85 B99 R0 G150 B57 R148 G183 B187
The color system presented was
informed by an extensive compet-
Accents
To simplify responding to the “which devices and browsers should I be testing my apps and websites on?”
itive audit. This system also seeks
to improve strength, impact and
uniqueness in expressing Perfecto’s 109 300 151 186
brand attributes.
Wordmark
Special Dark Field Use C0 M9 Y100 K0 C99 M50 Y0 K0 C0 M60 Y100 K0 C2 M100 Y85 K6
question, we have defined three representative groups of devices: essential, enhanced, and extended.
R255 G209 B0 R0 G94 B184 R255 G130 B0 R200 G16 B46
7541
C7 M1 Y3 K2
R217 G225 B226
• ESSENTIAL: a ten-device list which

covers the leading smartphones and
Usage
tablets. While the most-used devices 100%
fall into the essential category, this isn’t
sufficient to cover the entire market.
• ENHANCED coverage adds more

commonly used platforms such as the
previous and prior operating systems for
iOS and Android. It also expands the list
of device vendors.
• The EXTENDED group of devices adds

legacy devices that remain popular, 10 + 15 + 7
together with new and emerging devices

Essential Enhanced Extended # Unique Device/OS Combinations
that, based on our experience, will grow
in usage in the coming quarters.
While traffic share is easily determined for mobile devices, desktop browsers are updated more often and thus
requires a different approach. Perfecto builds the desktop browser set based on two criteria: browser version
and operating system. Browser version selection should normally consist of the following: current version,
current version minus one, current version minus two and the most recent beta version. Given the long life of
computer operating systems, it is best to look not only at the most current Windows OS but the previous two as
well. For Macs, it is best to include the current version as well as the previous one.
DESKTOP BROWSERS ARE BEING

CONTINUOUSLY UPDATED
Dial into the right criteria
to identify the desktop
browser combinations
required for your test lab
6
The solution Part 2:
Putting it into your development process
Making sure you have the right amount of platform coverage in your test lab solves the first part of the problem.
In an ideal world, teams would perform all tests on every platform; practically speaking, however, this is impossible.
To achieve development velocity objectives, you need to apply the appropriate set of platforms for each development
stage: unit testing, build acceptance testing, acceptance testing, and testing during production. During each stage,
the feedback objectives from testing range from ensuring that new and existing code works to verifying that user
experience is achieved across a variety of typical conditions.
In this ninth edition of Factors, we have extended our methodology to include a prescriptive approach for defining
which set of platforms should be used during each stage of development. This approach achieves the objective of
quality at speed. But, of course this approach requires tailoring for each development team.
With continuous testing as your goal, the Factor’s Reference Guide optimizes platform coverage while balancing
test scope, test duration and platforms under test. We recommend teams work towards the following target:
• Smoke testing every commit with a maximum ten-minute duration executed in parallel on a
maximum of four platforms.
• Build acceptance testing executed on a daily schedule with a maximum 90-minute

duration using the Essential set of platforms.
• Regression and non-functional testing executed nightly with a maximum 8-hour

duration using the appropriate Enhanced/Extended platforms.
• Testing in production executed hourly focused on high value transactions using

four to six platforms.
Platform Coverage Throughout the DevOps Pipeline
Unit Testing Build Acceptance Test Acceptance Test Production
Regression and
22 P1 P1 + P2
Non-functional*
P32
1 iOS (Device/Simulator) 2 iOS

Essential (Top 10) Mobile1 Enhanced/Extended Coverage
Test Platform 1 Android (Device/Emulator) 2 Android
and Web Platforms (Top 25-32 Platforms)
2 Desktop Browsers 2-4 Browsers
Trigger Per-commit Post-commit Scheduled Daily Scheduled Nightly Scheduled Hourly
Environment Dev Workstation Continuous Integration Server Production
Priority 1 Flows (P1)

Code impacted areas short test scenarios
Smoke and Integration testing of the newly introduced features
Subset of the regression suite that covers key business transactions in the product
(focusing on response time and availability)
7 1. Real devices
2. Subset of P1 & P2 test flows
* Fit into regression as many non-functional automated tests as possible
Summary
With more than 3,000 global customers, Perfecto is uniquely positioned to provide you with both the expertise
and the information necessary to minimize user experience risk created by platform coverage gaps in your app
testing process. The Factors Reference Guide delivers objective market data to complement your own customer
traffic in order to define your platform coverage strategy.
Mobile Device Desktop Web (Only) Responsive Web

Coverage Levels Coverage Coverage Design Coverage
Top 20 (Essential
Essential Top 10 Top 10
Web + Mobile)
Top 47 (Enhanced
Enhanced Top 25 (Essential +15) Top 22 (Essential +12)
Web + Mobile)
Top 65 (Extended
Extended Top 32 (Enhanced +7) Top 33 (Enhanced +11)
Web + Mobile)
8
Responsive Web Design Coverage
Essential Web Family Enhanced Web Family Extended Web Family
Chrome Latest/Win 10 Chrome Beta/Win 7 Chrome Latest/Win 8.1
Chrome Latest/MacOS Latest Chrome -1/Win 7 Chrome Beta/Win 8.1
Firefox Latest/Win 10 Firefox Beta/Win 10 Chrome -1/Win 8.1
IE 11/Win 10 Firefox Latest/Win 7 Firefox Latest/Win 8.1
Safari Latest/MacOS Latest Firefox -1/Win 10 Firefox -1/Win 8.1
Edge Latest/Win 10 Safari Latest/MacOS -1 Firefox Beta/Win 8.1
Chrome Beta/Win 10 IE 11/Win 7 Safari -1/MacOS Latest
Chrome Latest/Win 7 IE 11/Win 8.1 Safari -1/MacOS -1
Firefox -1/Win 7 IE 9/Win 7 Firefox Beta/MacOS Latest
Chrome -1/Win 10 Chrome -1/MacOS -1 Chrome Beta/MacOS Latest
Chrome Latest/MacOS -1 IE 8/WIN 7
Firefox Beta/WIN 7
Total 10 Browser Permutations Total 12 Browser Permutations Total 11 Browser Permutations
10
Mobile Test Coverage – U.S. powered by
Screen Recommended
Device Name Screen Family Screen Size Resolution Release Date OS Version
Apple iPhone 7 Plus L 5.5'' 1080 x 1920 Sep-2016 iOS Latest
Apple iPhone 7 M 4.7'' 750 x 1334 Sep-2016 iOS Latest
Samsung Galaxy S7 M 5.1'' 1440 x 2560 Mar-2016 Android 7.0
Apple iPhone 6S M 4.7" 750 x 1334 Sep-2015 iOS Latest

Essential
Samsung Galaxy S8 L 5.8'' 1440 x 2960 Apr-2017 Android 7.0
Samsung Galaxy S8+ L 6.2'' 1440 x 2960 Apr-2017 Android 7.0
Apple iPhone 6 M 4.7" 750 x 1334 Sep-2014 iOS 10.3.3
Apple iPhone 6S Plus L 5.5" 1080 x 1920 Sep-2014 iOS 10.3.3
Google Pixel REF M 5.0'' 1080 x 1920 Oct-2016 Android 8.1
Apple iPad Air 2 XL 9.7" 2048 x 1536 Oct-2014 iOS Latest
Apple iPhone X NEW L 5.8'' 1125 x 2436 Nov-2017 iOS Latest
Samsung Galaxy S7 Edge L 5.5'' 1440 x 2560 Mar-2016 Android 6.0.1
Apple iPad Mini 4 NEW XL 7.9'' 1536 x 2048 Sep-2015 iOS Latest
Samsung Galaxy Note 8 L 6.3'' 1440 x 2960 Sep-2017 Android 7.1.1
Samsung Galaxy S5 M 5.1" 1080 x 1920 Apr-2014 Android 6.0.1
Apple iPad 2 XL 9.7" 1024 x 768 Mar-2011 iOS 9.3.5

Enhanced
Apple iPad mini XL 7.9" 1024 x 768 Nov-2012 iOS 9.3.5
Apple iPhone 5S S 4.0" 640 x 1136 Sep-2013 iOS 10.3.3
Apple iPhone 8 NEW M 4.7'' 750 x 1334 Sep-2017 iOS Latest
Apple iPad 4 XL 9.7" 2048 x 1536 Nov-2012 iOS 10.3.3
Samsung Galaxy Note 5 L 5.67" 1440 x 2560 Aug-2015 Android 7.0
Samsung Galaxy Tab S3 XL 9.7'' 1536 x 2048 Apr-2017 Android 7.0
Apple iPad Pro XL 12.9'' 2048 x 2732 Nov-2015 iOS Latest
Google Pixel 2 NEW M 5.0'' 1080 x 1920 Oct-2017 Android 8.1
Apple iPad 9.7 XL 9.7" 2048 x 1536 Mar-2017 iOS Latest
Apple iPhone 8 Plus NEW L 5.5'' 1080 x 1920 Sep-2017 iOS Latest
Extended
Apple iPhone 4S S 3.5" 640 x 960 Oct-2011 iOS 9.3.5
LG G6 L 5.7'' 1440 x 2880 Mar-2017 Android 7.0
Apple iPhone SE NEW S 4.0'' 640 x 1136 Mar-2016 iOS Latest
Google Pixel XL L 5.5'' 1440 x 2560 Oct-2016 Android 8.1
Motorola Moto Z NEW L 5.5'' 1440 x 2560 Sep-2016 Android 7.1.1

11
*Some devices/OS combinations may not be commercially available. See Note on page 4.
Mobile Test Coverage – Canada powered by
Screen Recommended
Samsung Galaxy S7 M 5.1'' 1440 x 2560 Mar-2016 Android 7.0
Apple iPad 4 XL 9.7" 2048 x 1536 Nov-2012 iOS 10.3.3

Essential
Apple iPad mini 2 XL 7.9" 2048 x 1536 Nov-2013 iOS Latest
Google Pixe REF M 5.0'' 1080 x 1920 Oct-2016 Android 8.1
Samsung Galaxy S5 neo (SM-G903W) M 5.1" 1080 x 1920 Aug-2015 Android 6.0.1
Apple iPhone 5S S 4.0" 640 x 1136 Sep-2013 iOS Latest
Apple iPhone SE S 4.0'' 640 x 1136 Mar-2016 iOS Latest
Samsung Galaxy A5 (2017) NEW L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Enhanced
Samsung Galaxy S7 Edge L 5.5'' 1440 x 2560 Mar-2016 Android 7.0
LG G5 M 5.3'' 1440 x 2560 Apr-2016 Android 7.0
Apple iPhone 5C S 4.0" 640 x 1136 Sep-2012 iOS 10.3.3
Google Pixel 2 NEW XL 5.0'' 1080 x 1920 Oct-2017 Android 8.1
Samsung Galaxy Note 8 NEW XL 6.3'' 1440 x 2960 Sep-2017 Android 7.1.1
Samsung Galaxy Tab E M 9.6'' 800 x 1280 Jul-2015 Android 6.0.1
Huawei P10 NEW M 5.1'' 1080 x 1920 Mar-2017 Android 7.0

Extended
Blackberry Keyone M 4.5'' 1080 x 1620 Apr-2017 Android 7.1
Blackberry Motion NEW L 5.5'' 1080 x 1620 Dec-2017 Android 7.1
Apple iPhone 8 Plus NEW S 5.5'' 1080 x 1920 Sep-2017 iOS Latest
Google Pixel XL NEW L 5.5'' 1440 x 2560 Oct-2016 Android 8.1
Samsung Galaxy S8+ NEW L 6.2'' 1440 x 2960 Apr-2017 Android 7.0
12
Mobile Test Coverage – Brazil powered by
Screen Recommended
Samsung Galaxy S7 M 5.1'' 1440 x 2560 Feb-2016 Android 7.0
Motorola Moto G5 Plus L 5.2'' 1080 x 1920 Apr-2017 Android 7.0
LG Q6 NEW L 5.5'' 1080 x 1920 Aug-2017 Android 7.1.1

Essential
Motorola Moto G5S NEW L 5.2'' 1080 x 1920 Aug-2017 Android 7.1
Apple iPhone 7 M 4.7'' 750 x 1334 Sept-2016 iOS Latest
Motorola Moto G4 Plus (XT1640) L 5.5'' 1080 x 1920 May-2016 Android 6.0.1
Samsung Galaxy J5 Prime M 5.0'' 720 x 1280 Oct-2016 Android 6.0.1
LG G4 L 5.5" 1440 x 2560 Apr-2015 Android 6.0
Apple iPhone 6S M 4.7" 750 x 1334 Sep-2015 iOS 10.3.3
Samsung Galaxy A5 (2017) L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Motorola Moto X4 NEW L 5.2'' 1080 x 1920 Oct-2017 Android 7.1

Enhanced
LG K10 (K430) L 5.3'' 720 x 1280 Jan-2016 Android 5.1.1
Samsung Galaxy S7 Edge L 5.5'' 1440 x 2560 Feb-2016 Android 6.0.1
Asus Zenfone 4 NEW L 5.5'' 1080 x 1920 Oct-2017 Android 5.1.1
Apple iPhone 6 Plus L 5.5" 1080 x 1920 Sept-2014 iOS 10.3.3
Motorola Moto Z Play (XT1635M) L 5.5'' 1080 x 1920 Oct-2016 Android 6.0.1
Samsung J2 Prime NEW M 5.0'' 540 x 960 Nov-2016 Android 6.0
Samsung J5 Duos NEW L 5.2'' 720 x 1280 Apr-2016 Android 7.1.1
Motorola Moto Z2 Play NEW L 5.5'' 1080 x 1920 Jun-2017 Android 7.1.1
Samsung Galaxy S5 M 5.1" 1080 x 1920 Apr-2014 Android 5.0
Samsung Galaxy Grand Prime M 5.0'' 540 x 960 Oct-2014 Android 4.4.4
Apple iPhone 5C S 4.0" 640 x 1136 Sept-2013 iOS 10.3.3

Extended
Samsung Galaxy Note 8 NEW L 6.3'' 1440 x 2960 Sept-2017 Android 7.1.1
Apple iPhone 8 NEW M 4.7'' 750 x 1334 Sept-2017 iOS Latest
Apple iPad mini 2 XL 7.9" 2048 x 1536 Nov-2013 iOS 10.3.3

13
Mobile Test Coverage – EU5 powered by
Screen Recommended
Samsung Galaxy S7 Edge L 5.5'' 1440 x 2560 Feb-2016 Android 7.0

Essential
Apple iPhone 6S L 4.7'' 750x1334 Sep-2015 iOS Latest
Samsung Galaxy J3 M 5.0'' 720 x 1280 Jan-2016 Android 5.1.1
Apple iPad 4 XL 9.7" 2048 x 1536 Nov-2012 iOS Latest
Samsung Galaxy S6 Edge M 5.1" 1440 x 2560 Apr-2015 Android 6.0.1

Enhanced
Apple iPad Air XL 9.7" 2048 x 1536 Oct-2013 iOS 10.3.3
Samsung Galaxy J5 NEW L 5.2'' 720 x 1280 Apr-2016 Android 7.1.1
Samsung Galaxy A5 L 5.2" 1080 x 1920 Dec-2015 Android 7.0
Huawei P9lite L 5.2'' 1080 x 1920 Apr-2016 Android 7.0
Samsung Galaxy Tab A XL 10.1" 1200 x 1920 Jun-2016 Android 7.0

Extended
Samsung Galaxy A3 M 4.7" 720 x 1280 Dec-2015 Android 6.0.1
Samsung Galaxy Note 8 NEW L 6.3'' 1440 x 2960 Sep-2017 Android 7.1.1
Apple iPad Pro XL 9.7'' 1536 x 2048 Mar-2016 iOS Latest

14
Mobile Test Coverage – UK powered by
Screen Recommended

Essential
Apple iPhone SE S 4.0'' 640 x 1136 Mar-2016 iOS 10.3.3

Enhanced
Apple iPad Air XL 9.7" 2048 x 1536 Oct-2013 iOS 10.3.3
Sony Xperia XA NEW M 5.0'' 720 x 1280 Jun-2016 Android 7.0
Samsung Galaxy Tab E XL 9.6'' 800 x 1280 Jul-2015 Android 6.0.1
Apple iPhone 6S Plus L 5.5" 1080 x 1920 Sep-2014 iOS Latest

Extended
Samsung Galaxy J5 L 5.2'' 720 x 1280 Apr-2016 Android 7.1.1
Apple iPad Pro NEW XL 9.7'' 1536 x 2048 Mar-2016 iOS Latest

15
Mobile Test Coverage – Germany powered by
Screen Recommended

Essential
Samsung Galaxy S8+ XL 6.2'' 1440 x 2960 Apr-2017 Android 7.0
Samsung S5 Mini M 4.5'' 720 x 1280 Jun-2014 Android 5.1.1

Enhanced
Huawei P8lite M 5.0" 720 x 1280 May-2015 Android 6.0
Samsung Galaxy Tab A XL 10.1'' 1200 x 1920 Jun-2016 Android 7.0
Samsung Galaxy S5 Neo M 5.1'' 1080 x 1920 Aug-2015 Android 6.0.1
Samsung Galaxy A5 L 5.2'' 1080 x 1920 Jan-2017 Android 7.0

Extended
Sony Xperia XZ1 Compact NEW M 4.6'' 720 x 1280 Oct-2017 Android 8.0
Blackberry Motion NEW L 5.5'' 1080 x 1620 Dec-2017 Android 7.1

16
Mobile Test Coverage – Netherlands powered by
Screen Recommended

Essential
Apple iPad 3 XL 9.7" 1024 x 768 Mar-2011 iOS Latest
Apple iPhone 6 M 4.7" 750 x 1334 Sep-2014 iOS Latest

Enhanced
Samsung Galaxy S5 Neo M 5.1'' 1080 x 1920 Aug-2015 Android 6.0.1
Samsung Galaxy A5 L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Apple iPad Air XL 9.7" 2048 x 1536 Oct-2013 iOS Latest

Extended
Samsung Galaxy Note 4 L 5.7" 1440 x 2560 Sep-2014 Android 6.0.1
Huawei Mate 10 Pro NEW L 6.0'' 1080 x 2160 Nov-2017 Android 8.0
17
Mobile Test Coverage – Switzerland powered by
Screen Recommended

Essential
Apple iPad 3 XL 9.7" 1024 x 768 Mar-2011 iOS Latest
Samsung Galaxy A3 M 4.7" 720 x 1280 Dec- 2015 Android 6.0.1
Apple iPhone 5S S 4.0" 640 x 1136 Sep- 2013 iOS 10.3.3

Enhanced
Samsung Galaxy J5 NEW L 5.2'' 720 x 1280 Mar-2016 Android 7.1.1

Extended
18
Mobile Test Coverage – Italy powered by
Screen Recommended

Essential
Google Pixel REF NEW M 5.0'' 1080 x 1920 Oct-2016 Android 8.1
Samsung Galaxy S7 M 5.1'' 1440 x 2560 Feb-2016 Android 6.0.1
Samsung Galaxy S3 Neo M 4.8" 720 x 1280 May-2014 Android 4.4.4
Huawei P8lite (2017) NEW L 5.2" 1080 x 1920 Jan-2017 Android 7.0

Enhanced
Huawei P10 Lite NEW L 5.2'' 1080 x 1920 Mar-2017 Android 7.0
Sony Xperia XZ1 Compact NEW M 4.6'' 720 x 1280 Oct-2017 Android 8.0
Samsung Galaxy Note 4 L 5.7" 1440 x 2560 Sep-2014 Android 6.0.1

Extended
Huawei GR3 (2017) NEW L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Nokia 8 NEW L 5.3'' 1440 x 2560 Oct-2017 Android 7.1.1

19
Mobile Test Coverage – Spain powered by
Screen Recommended
Samsung Galaxy J3 NEW M 5.0'' 720 x 1280 Jan-2016 Android 5.1.1

Essential
Samsung Galaxy S8 NEW L 5.8'' 1440 x 2960 Apr-2017 Android 7.0
Samsung Galaxy S3 Neo M 4.8" 720 x 1280 May-2014 Android 4.4.4

Enhanced
Huawei P8 Lite (2017) NEW L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Samsung Galaxy J7 L 5.5'' 720 x 1280 Apr-2016 Android 6.0.1
Samsung Galaxy Tab A XL 9.7" 768 x 1024 May-2015 Android 6.0.1

Extended
LG G6 L 5.7'' 1440 x 2880 Mar-2017 Android 7.0
Huawei Mate 10 NEW L 5.9'' 1440 x 2560 Nov-2017 Android 8.0
Sony Xperia XZ1 NEW L 5.2'' 1080 x 1920 Sep-2017 Android 8.0
BQ Aquaris U NEW M 5.0'' 720 x 1280 Sep-2016 Android 6.0.1

20
Mobile Test Coverage – France powered by
Screen Recommended
Samsung Galaxy J5 L 5.2'' 720 x 1280 Mar-2016 Android 7.1.1

Essential
Apple iPhone 6S M 4.7'' 750x1334 Sep-2015 iOS Latest
Huawei P8 Lite (2017) NEW L 5.2'' 1080 x 1920 Jan-2017 Android 7.0
Enhanced
Blackberry Keyone S 4.5'' 1080 x 1620 Apr-2017 Android 7.1
Nokia 8 NEW L 5.3'' 1440 x 2560 Oct-2017 Android 7.1.1

Extended
Sony Xperia XA1 Ultra NEW L 6.0'' 1080 x 1920 May 2017 Android 7.0
21
Mobile Test Coverage – Denmark powered by
Screen Recommended
Samsung Galaxy S7 Edge NEW L 5.5'' 1440 x 2560 Feb-2016 Android 7.0
Apple iPhone 6S NEW M 4.7'' 750x1334 Sep-2015 iOS Latest
Samsung Galaxy S7 NEW M 5.1'' 1440 x 2560 Feb- 2016 Android 7.0

Essential
Huawei P9lite NEW L 5.2'' 1080 x 1920 Apr-2016 Android 7.0
Samsung Galaxy S6 NEW M 5.1" 1440 x 2560 Apr-2015 Android 6.0.1
Apple iPad Air 2 NEW XL 9.7" 2048 x 1536 Oct-2014 iOS Latest
Apple iPhone 6 NEW M 4.7" 750 x 1334 Sep-2014 iOS 10.3.3
Samsung Galaxy S6 Edge NEW M 5.1" 1440 x 2560 Apr-2015 Android 6.0.1
Apple iPhone SE NEW S 4.0'' 640 x 1136 Mar-2016 iOS 10.3.3
Apple iPad 2 NEW XL 9.7" 1024 x 768 Mar-2011 iOS 9.3.5
Huawei P8lite NEW M 5.0" 720 x 1280 May-2015 Android 6.0

Enhanced
Apple iPhone 5S NEW S 4.0" 640 x 1136 Sep-2013 iOS Latest
Samsung Galaxy A5 NEW L 5.2" 1080 x 1920 Dec-2016 Android 7.0
Huawei P9 NEW L 5.2'' 1080 x 1920 Apr-2016 Android 6.0
OnePlus 3 NEW L 5.5'' 1080 x 1920 Jun-2016 Android 6.0.1
Samsung Galaxy S5 NEW M 5.1" 1080 x 1920 Apr-2014 Android 5.0
Huawei Mate 9 Pro NEW L 5.5'' 1440 x 2560 Jan-2017 Android 7.0
Apple iPad Air NEW XL 9.7" 2048 x 1536 Oct-2013 iOS Latest
Extended
Lenovo Tab 2 A10-30 NEW XL 10.1'' 800 x 1280 Apr-2016 Android 5.1
Apple iPad mini NEW XL 7.9" 1024 x 768 Nov-2012 iOS 9.3.5
Sony Xperia Z5 NEW L 5.2'' 1080 x 1920 Oct-2015 Android 7.1.1
22
Mobile Test Coverage – Norway powered by
Screen Recommended
Samsung Galaxy S7 NEW M 5.1'' 1440 x 2560 Feb-2016 Android 7.0
Samsung Galaxy S7 Edge NEW L 5.5'' 1440 x 2560 Feb- 2016 Android 7.0
Essential
Apple iPhone 6 NEW M 4.7" 750 x 1334 Sep- 2014 iOS 10.3.3
Apple iPad 4 NEW XL 9.7" 2048 x 1536 Nov-2012 iOS Latest
Samsung Galaxy A3 NEW M 4.7" 720 x 1280 Jan-2017 Android 7.0
Enhanced
Samsung Galaxy S5 Neo NEW M 5.1'' 1080 x 1920 Aug-2015 Android 6.0.1
Apple iPhone 5 NEW S 4.0'' 640 x 1136 Sep-2012 iOS 10.3.3
Huawei Honor 8 NEW L 5.2'' 1080 x 1920 Jul-2016 Android 7.0
Huawei P9 NEW L 5.2'' 1080 x 1920 Apr-2016 Android 6.0

Extended
Samsung Galaxy Tab A NEW XL 10.1'' 1200 x 1920 Jun-2016 Android 7.0
Huawei P10 Lite NEW M 5.1'' 1080 x 1920 Mar-2017 Android 7.0
23
Mobile Test Coverage – Sweden powered by
Screen Recommended
Samsung Galaxy S7 NEW M 5.1'' 1440 x 2560 Feb-2016 Android 7.0

Essential
Samsung Galaxy S7 Edge NEW L 5.5'' 1440 x 2560 Feb-2016 Android 7.0
Apple iPhone 6 NEW M 4.7" 750 x 1334 Sep-2014 iOS 10.3.3
Apple iPad 4 NEW XL 9.7" 2048 x 1536 Nov-2012 iOS Latest
Huawei Honor 8 NEW L 5.2'' 1080 x 1920 Jul-2016 Android 7.0

Enhanced
Apple iPad Air NEW XL 9.7" 2048 x 1536 Oct-2013 iOS Latest
Apple iPhone 5S NEW S 4.0" 640 x 1136 Sep-2013 iOS 10.3.3
Samsung Galaxy S5 Neo NEW M 5.1'' 1080 x 1920 Aug-2015 Android 6.0.1
Apple iPhone 5 NEW S 4.0'' 640 x 1136 Sep-2012 iOS 10.3.3
Extended
Sony Xperia X Compact NEW M 4.6'' 720 x 1280 Sep-2016 Android 7.1.1
Samsung Galaxy A3 NEW M 4.7" 720 x 1280 Jan-2017 Android 7.0

24
Mobile Test Coverage – Australia powered by
Screen Recommended

Essential
Apple iPhone 6S Plus L 5.5" 1080 x 1920 Sep-2014 iOS Latest
Samsung Galaxy Tab A XL 8.0" 768 x 1024 May-2015 Android 6.0.1

Enhanced
Google Pixel XL L 5.5'' 1440 x 2560 Oct-2016 Android 8.1
OPPO F1s L 5.5'' 720 x 1280 Aug-2016 Android 5.1

Extended
Apple iPad Pro XL 9.7'' 1536 x 2048 Mar-2016 iOS Latest
Huawei Mate 9 L 5.9'' 1080 x 1920 Dec-2016 Android 7.0
Oppo A57 NEW L 5.2'' 720 x 1280 Nov-2016 Android 6.0.1

25
Mobile Test Coverage – China powered by
Screen Recommended
Huawei Mate 9 L 5.9'' 1080 x 1920 Dec-2016 Android 7.0
Oppo R9S L 5.5'' 1080 x 1920 Oct-2016 Android 6.0.1
Samsung Galaxy Note 3 L 5.7'' 1080 x 1920 Sep-2013 Android 4.4.2
Huawei P9 L 5.2'' 1080 x 1920 Apr-2016 Android 6.0

Essential
Samsung Galaxy A5 M 5.0'' 720 x 1280 Dec-2014 Android 6.0.1
Huawei Mate 8 L 6.0'' 1080 x 1920 Nov-2015 Android 7.0
Google Nexus 6P REF NEW L 5.7'' 1440 x 2560 Sep-2015 Android 8.1
Huawei P8lite NEW M 5.0" 720 x 1280 May-2015 Android 6.0
Xiaomi Mi 6 M 5.15'' 1080 x 1920 Apr-2017 Android 7.1.1
Coolad Y82-520 NEW L 5.5'' 540 x 960 Sep-2015 Android 4.4.4
Huawei P10 M 5.1'' 1080 x 1920 Mar-2017 Android 7.0
Smartisan T2 NEW M 4.95'' 1080 x 1920 Jan-2016 Android 5.1.1

Enhanced
Xiaomi Mi 5 M 5.15'' 1080x1920 Apr-2016 Android 6.0
Xiaomi Redmi Note 3 L 5.5'' 1080x1920 Feb-2016 Android 5.1.1
Oppo R9m NEW L 5.5'' 1080 x 1920 Mar-2016 Android 6.0
Huawei Honor 9 NEW M 5.15'' 1080 x 1920 Jul-2017 Android 7.0
Vivo X7 NEW L 5.2'' 1080 x 1920 Jul-2016 Android 5.1
Sony Xperia X Performance NEW M 5.0'' 1080 x 1920 Jun-2016 Android 6.0.1
Huawei Honor 8 L 5.2'' 1080 x 1920 Jul-2016 Android 6.0
Vivo X9 NEW L 5.5'' 1080 x 1920 Nov-2016 Android 6.0.1
Huawei P10 Plus NEW L 5.5'' 1440 x 2560 Apr-2017 Android 7.0
Meizu MX4 Pro L 5.5'' 1536 x 2560 Dec-2014 Android 4.4.4
Oppo A57 L 5.2'' 720 x 1280 Dec-2016 Android 6.0

Extended
Huawei Honor 6X L 5.5'' 1080 x 1920 Oct-2016 Android 7.0
Huawei Maimang 5 L 5.5'' 1080 x 1920 Jul-2016 Android 6.0

26
Mobile Test Coverage – India powered by
Screen Recommended
Samsung Galaxy J2 NEW M 4.7'' 540 x 960 Sep-2015 Android 5.1.1
Xiaomi Redmi Note 4 L 5.5'' 1080 x 1920 Jan-2017 Android 7.0
Samsung Galaxy J7 NEW L 5.5'' 720 x 1280 Apr-2016 Android 7.0
Xiaomi Redmi 3s M 5.0'' 720 x 1280 Jun-2016 Android 6.0.1

Essential
Samsung Galaxy J7 Prime NEW L 5.5'' 1080 x 1920 Sep-2016 Android 7.0
Xiaomi Redmi 4A NEW M 5.0'' 720 x 1280 Nov-2016 Android 6.0.1
Apple iPhone 6S M 4.7'' 750x1334 Sep-2015 iOS Latest
Xiaomi Redmi Note 3 L 5.5'' 1080x1920 Feb-2016 Android 5.0.2
Samsung Galaxy On Max NEW L 5.7'' 1080 x 1920 Jul-2017 Android 7.0
Samsung Galaxy J7 Prime L 5.5'' 1080 x 1920 Sep-2016 Android 6.0.1
Oppo A37F M 5.0'' 720 x 1280 Jun-2016 Android 5.1
Motorola Moto G5 Plus L 5.2'' 1080 x 1920 Apr-2017 Android 7.0
Oppo F1S L 5.5'' 720 x 1280 Aug-2016 Android 5.1

Enhanced
Vivo Y53 NEW M 5.0'' 540 x 960 Mar-2017 Android 6.0.1
Oppo A57 L 5.2'' 720 x 1280 Dec-2016 Android 6.0
OnePlus 5 NEW L 5.5'' 1080 x 1920 Jun-2017 Android 7.1.1
Vivo Y21L S 4.5'' 480 x 854 Aug-2016 Android 5.1
Oppo Neo7 NEW M 5.0'' 540 x 960 Oct-2015 Android 5.1
OnePlus 3T L 5.5'' 1080 x 1920 Nov-2016 Android 7.1.1
Lenovo Vibe K5 Note NEW L 5.5'' 1080 x 1920 Jan-2016 Android 5.1
Xiaomi Mi A1 NEW L 5.5'' 1080 x 1920 Sep-2017 Android 7.1.2

Extended
Samsung Galaxy A9 Pro (2016) L 6.0'' 1080 x 1920 May-2016 Android 6.0.1
Vivo V5 L 5.5'' 720 x 1280 Nov-2016 Android 6.0

27
Mobile Market Calendar 2018
Be sure to plan ahead to get maximum test coverage.
JANUARY FEBRUARY MARCH APRIL MAY JUNE JULY AUGUST SEPTEMBER OCTOBER NOVEMBER DECEMBER
U11 Eyes iPad Pro 9.7” iPhone 9

Galaxy S9 Xiaomi Redmi Note9 Google Pixel 3
Note 5 (2018) iPhone 9 Plus
Galaxy S9+ Motorola Moto Pixel 3 XL
E5 / G6 / X5 iPhone X2
A series(A8, A8+)
BlackBerry
Keyone 2 LG G7
Huawei Honor
DEVICES 9 Lite
Nokia 9
Huawei P20
Nokia 6
Xperia XZ Pro
Xperia XA 2
Oppo A83 Xperia XA 2
Ultra
iOS 11.2.2 iOS 11.2.6 iOS 11.3 Android 9 iOS 11.6 iOS 12 iOS 12 Beta 1 Android 9 iOS 12 iOS 12.1 iOS 12.2 iOS 12.3
iOS 11.2.5 Beta 1 Dev Preview iOS 11.7 (P) Release Release
iOS 11.4 iOS 11.4.1
OS
Android 9 iOS 11.8
Dev Preview iOS 11.5
Browser Calendar 2018
Be sure to plan ahead to get maximum test coverage.
JANUARY FEBRUARY MARCH APRIL MAY JUNE JULY AUGUST SEPTEMBER OCTOBER NOVEMBER DECEMBER
64 65 Beta 65 66 67 68 Beta 68 69 Beta 69 70 71 Beta 71
58 59 60 61 62 63 64 65
59 Beta 60 Beta 61 Beta 62 Beta 63 Beta 64 Beta 65 Beta
16
(September 2017)
11.0.3
Mac OS
10.14 Release
Sources:
www.chromium.org/developers/calendar
wiki.mozilla.org/Rapidrelease/calendar
About Perfecto
Perfecto is a cloud-based platform for web, mobile
and IoT software testing, empowering enterprises with
the tools needed to deliver better digital experiences.
Perfecto’s users can automate continuous testing
throughout the DevOps cycle, using a test lab
comprised of real browsers, smart phones and devices
under real end-user conditions. More than 3,000
customers, including the top global enterprises across
the banking, retail, telecommunications, hospitality
and media industries rely on Perfecto to help meet user
expectations, boost brand reputations, and establish
loyal customers. For more information about Perfecto,
visit perfecto.io and join our community.
Looking to learn more?

Here are some of our favorite resources:
GSMArena http://www.gsmarena.com/ Android Developers http://developer.android.
com/about/dashboards/index.html
Phone Arena http://www.phonearena.com/
App Annie https://www.appannie.com/
Open Signal http://opensignal.com/reports/
IHS https://www.ihs.com/index.html
Apple https://developer.apple.com/support/
app-store/ Localytics http://www.localytics.com
www.perfectomobile.com
781.205.4111 © 2018 Perfecto Mobile Ltd.

Factors Magazine From Perfecto Edition 9-2018

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Factors Magazine From Perfecto Edition 9-2018

Uploaded by

Copyright:

Available Formats

Factors is a reference guide for

cross platform testing of digital apps

Denmark Norway Sweden

In a constantly changing market,

COUNTRIES EMEA: EU5,

COVERED APAC: Australia,

Average number of devices per person 2017

North America 13 3 Asia Pacific

Number of Devices and Connections Per Person by 2021

Source: Android Support Different Screen Sizes (https://developer.android.com/training/multiscreen/screensizes.html)

• ESSENTIAL: a ten-device list which

• ENHANCED coverage adds more

• The EXTENDED group of devices adds

together with new and emerging devices

DESKTOP BROWSERS ARE BEING

• Build acceptance testing executed on a daily schedule with a maximum 90-minute

• Regression and non-functional testing executed nightly with a maximum 8-hour

• Testing in production executed hourly focused on high value transactions using

Platform Coverage Throughout the DevOps Pipeline

Unit Testing Build Acceptance Test Acceptance Test Production

1 iOS (Device/Simulator) 2 iOS

Trigger Per-commit Post-commit Scheduled Daily Scheduled Nightly Scheduled Hourly

Environment Dev Workstation Continuous Integration Server Production

Priority 1 Flows (P1)

Mobile Device Desktop Web (Only) Responsive Web

Essential Web Family Enhanced Web Family Extended Web Family

Chrome Latest/Win 10 Chrome Beta/Win 7 Chrome Latest/Win 8.1

Chrome Latest/MacOS Latest Chrome -1/Win 7 Chrome Beta/Win 8.1

Firefox Latest/Win 10 Firefox Beta/Win 10 Chrome -1/Win 8.1

IE 11/Win 10 Firefox Latest/Win 7 Firefox Latest/Win 8.1

Safari Latest/MacOS Latest Firefox -1/Win 10 Firefox -1/Win 8.1

Edge Latest/Win 10 Safari Latest/MacOS -1 Firefox Beta/Win 8.1

Chrome Beta/Win 10 IE 11/Win 7 Safari -1/MacOS Latest

Chrome Latest/Win 7 IE 11/Win 8.1 Safari -1/MacOS -1

Firefox -1/Win 7 IE 9/Win 7 Firefox Beta/MacOS Latest

Chrome -1/Win 10 Chrome -1/MacOS -1 Chrome Beta/MacOS Latest

Chrome Latest/MacOS -1 IE 8/WIN 7

Total 10 Browser Permutations Total 12 Browser Permutations Total 11 Browser Permutations

Apple iPhone 7 Plus L 5.5'' 1080 x 1920 Sep-2016 iOS Latest

Apple iPhone 7 M 4.7'' 750 x 1334 Sep-2016 iOS Latest

Samsung Galaxy S7 M 5.1'' 1440 x 2560 Mar-2016 Android 7.0

Apple iPhone 6S M 4.7" 750 x 1334 Sep-2015 iOS Latest

Samsung Galaxy S8 L 5.8'' 1440 x 2960 Apr-2017 Android 7.0

Samsung Galaxy S8+ L 6.2'' 1440 x 2960 Apr-2017 Android 7.0

Apple iPhone 6 M 4.7" 750 x 1334 Sep-2014 iOS 10.3.3

Apple iPhone 6S Plus L 5.5" 1080 x 1920 Sep-2014 iOS 10.3.3

Google Pixel REF M 5.0'' 1080 x 1920 Oct-2016 Android 8.1

Apple iPad Air 2 XL 9.7" 2048 x 1536 Oct-2014 iOS Latest

Apple iPhone X NEW L 5.8'' 1125 x 2436 Nov-2017 iOS Latest

Samsung Galaxy S7 Edge L 5.5'' 1440 x 2560 Mar-2016 Android 6.0.1

Samsung Galaxy Note 8 L 6.3'' 1440 x 2960 Sep-2017 Android 7.1.1

Samsung Galaxy S5 M 5.1" 1080 x 1920 Apr-2014 Android 6.0.1

Apple iPad 2 XL 9.7" 1024 x 768 Mar-2011 iOS 9.3.5

Apple iPad mini XL 7.9" 1024 x 768 Nov-2012 iOS 9.3.5

Apple iPhone 5S S 4.0" 640 x 1136 Sep-2013 iOS 10.3.3

Apple iPhone 8 NEW M 4.7'' 750 x 1334 Sep-2017 iOS Latest

Apple iPad 4 XL 9.7" 2048 x 1536 Nov-2012 iOS 10.3.3

Samsung Galaxy S6 M 5.1" 1440 x 2560 Apr-2015 Android 6.0.1

Samsung Galaxy Note 5 L 5.67" 1440 x 2560 Aug-2015 Android 7.0

Samsung Galaxy Tab S3 XL 9.7'' 1536 x 2048 Apr-2017 Android 7.0

Apple iPad Pro XL 12.9'' 2048 x 2732 Nov-2015 iOS Latest

Google Pixel 2 NEW M 5.0'' 1080 x 1920 Oct-2017 Android 8.1

Apple iPad 9.7 XL 9.7" 2048 x 1536 Mar-2017 iOS Latest

Apple iPhone 4S S 3.5" 640 x 960 Oct-2011 iOS 9.3.5