Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Standard view
Full view
of .
Look up keyword
Like this
0 of .
Results for:
No results containing your search query
P. 1
Crowd testing

Crowd testing

Ratings: (0)|Views: 20 |Likes:
Published by priyanka
The power of Crowd testing
The power of Crowd testing

More info:

Published by: priyanka on Nov 21, 2012
Copyright:Attribution Non-commercial


Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less





The Power of ‘Crowd’ Testing 
Cognizant 20-20 Insights
Executive Summary
The prevalence of social media, along with easyaccess to the Internet through multiple channelsincluding Web and mobile devices, has ensuredthat it is easy for a group of individuals to sharetheir thoughts, initiate discussion and even en-force action on areas of common interest.Conversely, the easy access to such a crowd en-ables organizations to leverage these individualsin achieving business goals. Crowdsourcing as aconcept is not necessarily new. However, the In-ternet and mobile devices have acted as catalyststhat have triggered a chain reaction, increasingtheir effectiveness and ROI. This white paper willdiscuss how cloud-enabled crowdsourcing tsinto the full testing lifecycle.
Where Crowd Testing Applies
Testing essentially validates that the nal productmeets the targeted quality standard. This neces-sitates the testing of a large number of intuitiveas well as esoteric test scenarios. Crowd testing,in many cases, becomes a broad, but effectivemeans of ensuring that all bases are covered. Ofcourse by leveraging the crowd, testing movesfrom a focused activity aimed at a few individualsto a “hit it all” approach.Crowd testing can be leveraged regardless of theunderlying development methodology. In fact, itis viable in both agile and waterfall scenarios.However, one cannot yet replace traditional test-ing with crowd testing.If organizations focus only on crowd testing,the quality assurance process becomes more ofa game and is no longer a science with predict-ability. And if application stability has not beenensured through early lifecycle testing, a viciousloop of ever-increasing defects can ensue. Also,challenges often arise in effectively using crowdtesting for specialized requirements, such as ser-vices testing. Thus, organizations need to adopt astrategy that blends traditional and crowd testingapproaches to get the maximum ROI.
Crowd Testing: A Key Element of theTesting Lifecycle
There are four approaches to handling the blendingof traditional and crowd testing approaches.
As an add-on to testing:
Crowd testing canbe used as a complementary add-on prior toproduction release. This will be effective incatching any residual UI and congurationdefects. Options like VDI (Virtual DesktopInterface) access can be considered if secu-rity or privacy concerns prevent the organi-zation from letting the crowd access the sitethrough the Internet. 
For specialized testing scenarios:
An exampleis multivariate testing where end-users canbe used to select Web site components or
Cognizant 20-20 Insights|april 2011
controls from a set of choices available aspart of tests based on the response. Perfor-mance testing is also an increasingly lever-aged option.
Leverage based on risk and priority:
Usecrowd testing for those applications thathave a higher Defect Exposure Factor (DEF isdened as Number of Releases/yr * Averagenumber of daily critical stakeholder visits)and high business criticality. This results inprioritizing the use of discretionary budget inareas where it will make the highest impact(see Figure 1).
Crowd testing integrated into overall test-ing, and TaaS strategy:
Treat crowd testingas one of a basket of services used in com-bination with the optimal tool, infrastructureand test type combinations as dictated bythe overall test strategy. As organizationsand the industry mature, crowd testing willgradually permeate into the testing commu-nity, further reducing the need currently ful-lled through dogfooding and domain SME-led testing.
Current pricing models largely tend to be a com-bination of a xed-based price and a variablecomponent that is dependent on the number ofdefects uncovered in each run.We have increasingly found that it is more effec-tive for our clients if we bundle this as part of ouroverall Testing as a Service (TaaS) cloud-basedoffering. While it is still an option to provide de-fect-based pricing, we believe that crowd testingas part of an overall bundled service or pricingmodel dependent on the application test strategyis more optimal for most companies.
 Future Trends
Extinction of pure-play crowd testing seems tobe a foregone conclusion. Niche vendors arescrambling to expand their service offering by en-tering into alliances with similar players offeringspecialized testing services such as performancetesting. We believe that crowd testing will soonbecome synonymous with community testing.Our BA – QA model, which ensures that there isa domain-driven viewpoint applied to all testingengagements, married with the large and expe-rienced testing resource pool, enables us to pro-vide crowd testing delivered by testers who areboth competent in rigors of QA and knowledge-able of the client’s business unique requirements.Social media is already a critical lever in crowdsourcing. We foresee greater integration be-tween social media and crowd test execution.Special interest groups, including those withinFacebook and Twitter that are business focused,will help build knowledge and efcient handoveracross releases even in a crowd testing scenario.This will further enhance the integration of crowdand community testing.
Looking Ahead
Crowd testing is fast growing as a viable testoption. However, it is a complementary testing-
Leverage Achieved via Risk and Priority.
Defect Exposure Factor (DEF)
    A   p   p    l    i   c   a    t    i   o   n    C   r    i    t    i   c   a    l    i    t   y
Low DEF,High CriticalityLow DEF,Low CriticalityHigh DEF,Low CriticalityHigh DEF,High Criticality12
*Focus crowd testing on areas with a high Defect Exposure Factor. DEF measures immediate customer exposurepost release.Figure 1:
Cognizant 20-20 Insights

You're Reading a Free Preview

/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->