controls from a set of choices available aspart of tests based on the response. Perfor-mance testing is also an increasingly lever-aged option.
Leverage based on risk and priority:
Usecrowd testing for those applications thathave a higher Defect Exposure Factor (DEF isdened as Number of Releases/yr * Averagenumber of daily critical stakeholder visits)and high business criticality. This results inprioritizing the use of discretionary budget inareas where it will make the highest impact(see Figure 1).
Crowd testing integrated into overall test-ing, and TaaS strategy:
Treat crowd testingas one of a basket of services used in com-bination with the optimal tool, infrastructureand test type combinations as dictated bythe overall test strategy. As organizationsand the industry mature, crowd testing willgradually permeate into the testing commu-nity, further reducing the need currently ful-lled through dogfooding and domain SME-led testing.
Current pricing models largely tend to be a com-bination of a xed-based price and a variablecomponent that is dependent on the number ofdefects uncovered in each run.We have increasingly found that it is more effec-tive for our clients if we bundle this as part of ouroverall Testing as a Service (TaaS) cloud-basedoffering. While it is still an option to provide de-fect-based pricing, we believe that crowd testingas part of an overall bundled service or pricingmodel dependent on the application test strategyis more optimal for most companies.
Extinction of pure-play crowd testing seems tobe a foregone conclusion. Niche vendors arescrambling to expand their service offering by en-tering into alliances with similar players offeringspecialized testing services such as performancetesting. We believe that crowd testing will soonbecome synonymous with community testing.Our BA – QA model, which ensures that there isa domain-driven viewpoint applied to all testingengagements, married with the large and expe-rienced testing resource pool, enables us to pro-vide crowd testing delivered by testers who areboth competent in rigors of QA and knowledge-able of the client’s business unique requirements.Social media is already a critical lever in crowdsourcing. We foresee greater integration be-tween social media and crowd test execution.Special interest groups, including those withinFacebook and Twitter that are business focused,will help build knowledge and efcient handoveracross releases even in a crowd testing scenario.This will further enhance the integration of crowdand community testing.
Crowd testing is fast growing as a viable testoption. However, it is a complementary testing-
Leverage Achieved via Risk and Priority.
Defect Exposure Factor (DEF)
A p p l i c a t i o n C r i t i c a l i t y
Low DEF,High CriticalityLow DEF,Low CriticalityHigh DEF,Low CriticalityHigh DEF,High Criticality12
*Focus crowd testing on areas with a high Defect Exposure Factor. DEF measures immediate customer exposurepost release.Figure 1:
Cognizant 20-20 Insights