Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Look up keyword
Like this
2Activity
0 of .
Results for:
No results containing your search query
P. 1
Selecting the Right Mobile Test Automation Strategy Challenges and Principle.pdf

Selecting the Right Mobile Test Automation Strategy Challenges and Principle.pdf

Ratings: (0)|Views: 51|Likes:
Published by priyanka
Selecting_the_Right_Mobile_Test_Automation_Strategy_Challenges_and_Principle.pdf
Selecting_the_Right_Mobile_Test_Automation_Strategy_Challenges_and_Principle.pdf

More info:

Published by: priyanka on Nov 21, 2012
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

03/20/2013

pdf

text

original

 
Selecting the Right Mobile Test AutomationStrategy: Challenges and Principles
Understanding the various options and choosing the tools andautomation processes best suited to testing both mobile Web andnative mobile apps can reduce complexity and speed time to value.
Executive Summary
The mobile phone has transitioned from its tra-ditional role as a mere communication mediumto that of a multipurpose personal gadget. Tech-nological advancements and the proliferationof devices across operating systems (Apple iOS,Android and Windows Mobile) and platforms havemade it more challenging for hardware manufac-turers and application developers to develop androll out new products.For vendor peace of mind, mobile applica-tions must be tested to ensure they run on keyplatforms and across a multitude of networks.Despite the pressures of short mobile develop-ment cycles, quality testing of applications acrossoperating systems, device platforms and networksis a necessary but daunting task to ensurelong-term success in what is a highly fragmentedand competitive global market. Moreover, non-functional testing — including usability, securityand adaptability — is as critical as functionaltesting. Effective testing can help device makersand application developers collect appropriatemetrics that improve product quality.This white paper explores industry best practiceson mobile testing and demonstrates effectiveways of managing mobile application qualitythrough test automation. As with conven-tional applications, there is an increased needto automate mobile applications testing toimprove scale and efciency. A well-orchestratedautomation strategy enables hardware manufac-turers and software developers to reduce effortand accelerate time to market.
Mobile Technology’s Growth Promise
The growth of mobile devices is evidenced by thefollowing:
Globally, the user base of location-basedservices has grown from 96 million in 2009to more than 526 million in 2012, according toGartner Research.
1
Worldwide mobile advertising and contentrevenue is forecast to reach $67 billion thisyear.
2
IDC predicts that smartphone shipments willreach 978 million in 2014.
3
By 2016, smartphones and tablets willput power in the hands of a billion globalconsumers, according to ForresterResearch, Inc.
4
Mobile device makers are providingcustomized platforms to increase their shareof the customer’s wallet.
 
Cognizant 20-20 Insights
cognizant 20-20 insights|september 2012
 
cognizant 20-20 insights
2
Figure 1
Real-time Scenario or a Smartphone-based App: Sample Test Execution
Use Case 1Mobile ApplicationsUse Case 2Use Case n
Wi-FiiPhoneBlackberryAndroid
Real DeviceEmulators
 Devices/BrowsersSky Fire Dolphiniphone3iphone4iphone5Nexus OneMoto DroidSamsungCaptivateHTC IncredibleNexus SMoto Droid XCurve 8330Tour 9630Bold 9650Bold 9000 TouchiOS Native3,4&5Android Native(2.1,2.2,2.3, 3.0,4.0)Blackberry Native5,6 ,7,8 & 9Opera MiniFirefox 4 Firefox 5 Firefox 6OperaMobile 11.1
Device Anywhere
   M  o   b   i   l  e   T  e  s   t   L  a   b
Two Key Challenges in MobileApplication Test Automation
Mobile Platorms and Technology Coverage
The primary factor that determines an automationtool’s success is its ability to work across platformsand technology stacks. The following challengesinuence automation success:
Device Diversity:
 
>
Multiple platforms and browsers.
 
>
Rendering differences.
 
>
Mobile devices with varied application runtimes.
Network Challenges:
 
>
Multiple network types (e.g., GSM/GPRS/Wi-Fi/Wi-Max).
 
>
Different speeds of connectivity acrossgeographies.
 
>
Multiple network operators with custom-ized network features.
Hardware Challenges:
 
>
Limitations in processing speed.
 
>
Limitations of mobile memory size.
>
Differences in device communicationprotocols (e.g., WAP/HTTP).
Test Execution Challenge
Test execution across different devices and brows-ers is a huge, challenging effort. For example,consider a test case that is created and needs tobe executed on three different platforms — iOS,Android and Blackberry. In this example, the testcase is expected to be executed on 13 differentdevices and in 10 different combinations, whichleads to 130 rounds of testing. Designing a testexecution matrix of this scope is both difcult andtime-consuming (see Figures 1 and 2).
Mobile Testing Industry Opportunities
In the growing mobile market, the need for spe-cialized mobile testing is growing. The followingthree opportunities contribute almost 80% oftotal market demand.
Mobile Automation Testing
There are only a handful of tools available to suc-cessfully automate testing. The ROI promised byautomation testing highlights the need for moreoptions.
Functional Testing
Mobile functional testing always involves a non-heuristic component that cannot be automated.
Mobile Perormance Testing
Compared with a desktop/notebook environment,mobile device system resources (e.g., processingpower, memory, etc.) are limited. Hence, perfor-mance testing of mobile applications is crucial.Therefore, this domain is growing and has greatpotential.
 
cognizant 20-20 insights
3
iOS
Current Version 6.0Closed SourceAppleMultitaskingSafari Web Browser
Android
Current Version 4.2Open SourceGoogleMultitasking
 Windows Phone
Current Version 7.5Key Version 6.5Closed SourceMicrosoftMultitaskingInternet Explorer
Blackberry OS
Current Version 7.0Closed SourceRIMMultitaskingWebkit Browser
Symbian
Symbian 4Open SourceSymbianMultitasking
Key Versions(iPhone 4.0, iPad 2)Key Version 2.3, 3.0, 4.0Chrome/Webkit BrowserKey Version6.x & 7.x seriesWebkit Browser
Figure 2
Smartphone Platorms and Browser Combinations
Mobile Automation: What and Why?
Mobile applications are becoming increasinglysophisticated, signicantly increasing the require-ment for functional testing (see Figures 3 and4). To tackle this, test organizations are increas-ingly exploring alternatives to traditional manualtesting. Automated testing is a highly effectiveapproach to mobile app QA that can providesignicant business returns, provided it is imple-mented by using the right tools and architecture,factoring in cross-platform challenges.The following specic types of testing also needto be automated:
Cross-platform compatibility testing:
Thisis necessitated by the growing number ofhandsets and platforms.
User experience testing:
Most testing orga-nizations have limited experience with designand execution of usability tests.
Field or network testing:
Testing must beperformed in a geographically distributed envi-ronment to account for a variety of networktypes.
Structural challenges:
Integrating mobiletesting toolsets into existing IT systems is acrucial hurdle.
Test Automation Mechanismsor Mobile Apps
A mobile Web site can be automated in one of thefollowing three manners:
User agent-based automation:
This approachleverages user agent add-ons that come withpopular browsers such as Mozilla Firefoxand Google Chrome. The user agents helprender the specic Web content that would bedisplayed on the device onto a regular desktopbrowser. The functionality can be automatedby using popular tools such as QTP, Seleniumor RFT — each of which supports all desktopbrowsers.
Cloud-based automation:
Cloud-based testautomation vendors support Web-based QAacross platforms. Cloud-based automatedsolutions are highly effective as they areoffered as a unied package.
Lab-based automation (devices/simulators):
 This method involves setting up tools in atest environment and leveraging simulatorsor physical devices to automate testing usingpopular open-source tools such as Selenium.Web driver–supported device browsers andsimulators are best suited here.
Approaches or Native and HybridMobile Applications
Cloud-based Approach
Cloud-based test automation is one popularmeans for achieving native and hybrid types oftest automation. The method is useful whenlong-term automation is required across a setof predened devices. Commercial tool add-onmechanisms such as HP QTP and IBM RFT are alsoavailable for test engineers who are familiar with

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->