An Introduction to Software Testing

([HFXWLYH 6XPPDU\

7KLV SDSHU SURYLGHV DQ LQWURGXFWLRQ WR VRIWZDUH WHVWLQJ ,W VHUYHV DV D WXWRULDO IRU GHYHORSHUV ZKR DUH QHZ WR IRUPDO WHVWLQJ RI VRIWZDUH DQG DV D UHPLQGHU RI VRPH ILQHU SRLQWV IRU H[SHULHQFHG VRIWZDUH WHVWHUV

7RSLFV FRYHUHG LQFOXGH EDVLF GHILQLWLRQV RI WHVWLQJ YDOLGDWLRQ DQG YHULILFDWLRQ WKH OHYHOV RI WHVWLQJ IURP XQLW WHVWLQJ WKURXJK WR DFFHSWDQFH WHVWLQJ WKH UHODWLRQVKLS ZLWK UHTXLUHPHQWV DQG GHVLJQ VSHFLILFDWLRQV DQG WHVW GRFXPHQWDWLRQ ,3/ LV DQ LQGHSHQGHQW VRIWZDUH KRXVH IRXQGHG LQ  DQG EDVHG LQ %DWK ,3/ ZDV DFFUHGLWHG WR ,62 LQ  DQG JDLQHG 7LFN,7 DFFUHGLWDWLRQ LQ  ,3/ KDV GHYHORSHG DQG VXSSOLHV WKH $GD7(67 DQG &DQWDWD VRIWZDUH YHULILFDWLRQ SURGXFWV $GD7(67 DQG &DQWDWD KDYH EHHQ SURGXFHG WR WKHVH VWDQGDUGV

&RS\ULJKW

7KLV GRFXPHQW LV WKH FRS\ULJKW RI ,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG ,W PD\ QRW EH FRSLHG RU GLVWULEXWHG LQ DQ\ IRUP LQ ZKROH RU LQ SDUW ZLWKRXW WKH SULRU ZULWWHQ FRQVHQW RI ,3/
,3/ (YHOHLJK +RXVH *URYH 6WUHHW %DWK %$ /5 8. 3KRQH     )D[     HPDLO LSO#LSOEDWKFRP

/DVW 8SGDWH  )LOH $Q ,QWURGXFWLRQ WR 6RIWZDUH 7HVWLQJGRF 

:KDW LV 6RIWZDUH 7HVWLQJ"

7KHUH DUH PDQ\ SXEOLVKHG GHILQLWLRQV RI VRIWZDUH WHVWLQJ KRZHYHU DOO RI WKHVH GHILQLWLRQV ERLO GRZQ WR HVVHQWLDOO\ WKH VDPH WKLQJ VRIWZDUH WHVWLQJ LV WKH SURFHVV RI H[HFXWLQJ VRIWZDUH LQ D FRQWUROOHG PDQQHU LQ RUGHU WR DQVZHU WKH TXHVWLRQ 'RHV WKH VRIWZDUH EHKDYH DV VSHFLILHG" 

6RIWZDUH WHVWLQJ LV RIWHQ XVHG LQ DVVRFLDWLRQ ZLWK WKH WHUPV YHULILFDWLRQ DQG YDOLGDWLRQ 9HULILFDWLRQ LV WKH FKHFNLQJ RU WHVWLQJ RI LWHPV LQFOXGLQJ VRIWZDUH IRU FRQIRUPDQFH DQG FRQVLVWHQF\ ZLWK DQ DVVRFLDWHG VSHFLILFDWLRQ 6RIWZDUH WHVWLQJ LV MXVW RQH NLQG RI YHULILFDWLRQ ZKLFK DOVR XVHV WHFKQLTXHV VXFK DV UHYLHZV DQDO\VLV LQVSHFWLRQV DQG ZDONWKURXJKV 9DOLGDWLRQ LV WKH SURFHVV RI FKHFNLQJ WKDW ZKDW KDV EHHQ VSHFLILHG LV ZKDW WKH XVHU DFWXDOO\ ZDQWHG • 9DOLGDWLRQ $UH ZH GRLQJ WKH ULJKW MRE" • 9HULILFDWLRQ $UH ZH GRLQJ WKH MRE ULJKW"

7KH WHUP EXJ LV RIWHQ XVHG WR UHIHU WR D SUREOHP RU IDXOW LQ D FRPSXWHU 7KHUH DUH VRIWZDUH EXJV DQG KDUGZDUH EXJV 7KH WHUP RULJLQDWHG LQ WKH 8QLWHG 6WDWHV DW WKH WLPH ZKHQ SLRQHHULQJ FRPSXWHUV ZHUH EXLOW RXW RI YDOYHV ZKHQ D VHULHV RI SUHYLRXVO\ LQH[SOLFDEOH IDXOWV ZHUH HYHQWXDOO\ WUDFHG WR PRWKV IO\LQJ DERXW LQVLGH WKH FRPSXWHU 6RIWZDUH WHVWLQJ VKRXOG QRW EH FRQIXVHG ZLWK GHEXJJLQJ 'HEXJJLQJ LV WKH SURFHVV RI DQDO\]LQJ DQG ORFDWLQJ EXJV ZKHQ VRIWZDUH GRHV QRW EHKDYH DV H[SHFWHG $OWKRXJK WKH LGHQWLILFDWLRQ RI VRPH EXJV ZLOO EH REYLRXV IURP SOD\LQJ ZLWK WKH VRIWZDUH D PHWKRGLFDO DSSURDFK WR VRIWZDUH WHVWLQJ LV D PXFK PRUH WKRURXJK PHDQV RI LGHQWLI\LQJ EXJV 'HEXJJLQJ LV WKHUHIRUH DQ DFWLYLW\ ZKLFK VXSSRUWV WHVWLQJ EXW FDQQRW UHSODFH WHVWLQJ +RZHYHU QR DPRXQW RI WHVWLQJ FDQ EH JXDUDQWHHG WR GLVFRYHU DOO EXJV

2WKHU DFWLYLWLHV ZKLFK DUH RIWHQ DVVRFLDWHG ZLWK VRIWZDUH WHVWLQJ DUH VWDWLF DQDO\VLV DQG G\QDPLF DQDO\VLV 6WDWLF DQDO\VLV LQYHVWLJDWHV WKH VRXUFH FRGH RI VRIWZDUH ORRNLQJ IRU SUREOHPV DQG JDWKHULQJ PHWULFV ZLWKRXW DFWXDOO\ H[HFXWLQJ WKH FRGH '\QDPLF DQDO\VLV ORRNV DW WKH EHKDYLRXU RI VRIWZDUH ZKLOH LW LV H[HFXWLQJ WR SURYLGH LQIRUPDWLRQ VXFK DV H[HFXWLRQ WUDFHV WLPLQJ SURILOHV DQG WHVW FRYHUDJH LQIRUPDWLRQ 

6RIWZDUH 6SHFLILFDWLRQV DQG 7HVWLQJ

7KH NH\ FRPSRQHQW RI WKH DERYH GHILQLWLRQV LV WKH ZRUG VSHFLILHG 9DOLGDWLRQ DQG YHULILFDWLRQ DFWLYLWLHV VXFK DV VRIWZDUH WHVWLQJ FDQQRW EH PHDQLQJIXO XQOHVV WKHUH LV D VSHFLILFDWLRQ IRU WKH VRIWZDUH 6RIWZDUH FRXOG EH D VLQJOH PRGXOH RU XQLW RI FRGH RU DQ HQWLUH V\VWHP 'HSHQGLQJ RQ WKH VL]H RI WKH GHYHORSPHQW DQG WKH GHYHORSPHQW PHWKRGV VSHFLILFDWLRQ RI VRIWZDUH FDQ UDQJH IURP D VLQJOH GRFXPHQW WR D FRPSOH[ KLHUDUFK\ RI GRFXPHQWV $ KLHUDUFK\ RI VRIWZDUH VSHFLILFDWLRQV ZLOO W\SLFDOO\ FRQWDLQ WKUHH RU PRUH OHYHOV RI VRIWZDUH VSHFLILFDWLRQ GRFXPHQWV • 7KH 5HTXLUHPHQWV 6SHFLILFDWLRQ ZKLFK VSHFLILHV ZKDW WKH VRIWZDUH LV UHTXLUHG WR GR DQG PD\ DOVR VSHFLI\ FRQVWUDLQWV RQ KRZ WKLV PD\ EH DFKLHYHG 

‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

• 7KH $UFKLWHFWXUDO 'HVLJQ 6SHFLILFDWLRQ ZKLFK GHVFULEHV WKH DUFKLWHFWXUH RI D GHVLJQ ZKLFK LPSOHPHQWV WKH UHTXLUHPHQWV &RPSRQHQWV ZLWKLQ WKH VRIWZDUH DQG WKH UHODWLRQVKLS EHWZHHQ WKHP ZLOO EH GHVFULEHG LQ WKLV GRFXPHQW • 'HWDLOHG 'HVLJQ 6SHFLILFDWLRQV ZKLFK GHVFULEH KRZ HDFK FRPSRQHQW LQ WKH VRIWZDUH GRZQ WR LQGLYLGXDO XQLWV LV WR EH LPSOHPHQWHG
5HTXLUHPHQWV 6SHFLILFDWLRQ $UFKLWHFWXUDO 'HVLJQ 6SHFLILFDWLRQ 'HWDLOHG 'HVLJQ 6SHFLILFDWLRQ

:LWK VXFK D KLHUDUFK\ RI VSHFLILFDWLRQV LW LV SRVVLEOH WR WHVW VRIWZDUH DW YDULRXV VWDJHV RI WKH GHYHORSPHQW IRU FRQIRUPDQFH ZLWK HDFK VSHFLILFDWLRQ 7KH OHYHOV RI WHVWLQJ ZKLFK FRUUHVSRQG WR WKH KLHUDUFK\ RI VRIWZDUH VSHFLILFDWLRQV OLVWHG DERYH DUH • 8QLW 7HVWLQJ LQ ZKLFK HDFK XQLW EDVLF FRPSRQHQW RI WKH VRIWZDUH LV WHVWHG WR YHULI\ WKDW WKH GHWDLOHG GHVLJQ IRU WKH XQLW KDV EHHQ FRUUHFWO\ LPSOHPHQWHG • 6RIWZDUH ,QWHJUDWLRQ 7HVWLQJ LQ ZKLFK SURJUHVVLYHO\ ODUJHU JURXSV RI WHVWHG VRIWZDUH FRPSRQHQWV FRUUHVSRQGLQJ WR HOHPHQWV RI WKH DUFKLWHFWXUDO GHVLJQ DUH LQWHJUDWHG DQG WHVWHG XQWLO WKH VRIWZDUH ZRUNV DV D ZKROH $ IXUWKHU OHYHO RI WHVWLQJ LV DOVR FRQFHUQHG ZLWK UHTXLUHPHQWV

• 6\VWHP 7HVWLQJ LQ ZKLFK WKH VRIWZDUH LV LQWHJUDWHG WR WKH RYHUDOO SURGXFW DQG WHVWHG WR VKRZ WKDW DOO UHTXLUHPHQWV DUH PHW • $FFHSWDQFH 7HVWLQJ XSRQ ZKLFK DFFHSWDQFH RI WKH FRPSOHWHG VRIWZDUH LV EDVHG 7KLV ZLOO RIWHQ XVH D VXEVHW RI WKH V\VWHP WHVWV ZLWQHVVHG E\ WKH FXVWRPHUV IRU WKH VRIWZDUH RU V\VWHP 2QFH HDFK OHYHO RI VRIWZDUH VSHFLILFDWLRQ KDV EHHQ ZULWWHQ WKH QH[W VWHS LV WR GHVLJQ WKH WHVWV $Q LPSRUWDQW SRLQW KHUH LV WKDW WKH WHVWV VKRXOG EH GHVLJQHG EHIRUH WKH VRIWZDUH LV LPSOHPHQWHG EHFDXVH LI WKH VRIWZDUH ZDV LPSOHPHQWHG ILUVW LW ZRXOG EH WRR WHPSWLQJ WR WHVW WKH VRIWZDUH DJDLQVW ZKDW LW LV REVHUYHG WR GR ZKLFK LV QRW UHDOO\ WHVWLQJ DW DOO  UDWKHU WKDQ DJDLQVW ZKDW LW LV VSHFLILHG WR GR

:LWKLQ HDFK OHYHO RI WHVWLQJ RQFH WKH WHVWV KDYH EHHQ DSSOLHG WHVW UHVXOWV DUH HYDOXDWHG ,I D SUREOHP LV HQFRXQWHUHG WKHQ HLWKHU WKH WHVWV DUH UHYLVHG DQG DSSOLHG DJDLQ RU WKH 
‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

VRIWZDUH LV IL[HG DQG WKH WHVWV DSSOLHG DJDLQ 7KLV LV UHSHDWHG XQWLO QR SUREOHPV DUH HQFRXQWHUHG DW ZKLFK SRLQW GHYHORSPHQW FDQ SURFHHG WR WKH QH[W OHYHO RI WHVWLQJ

7HVWLQJ GRHV QRW HQG IROORZLQJ WKH FRQFOXVLRQ RI DFFHSWDQFH WHVWLQJ 6RIWZDUH KDV WR EH PDLQWDLQHG WR IL[ SUREOHPV ZKLFK VKRZ XS GXULQJ XVH DQG WR DFFRPPRGDWH QHZ UHTXLUHPHQWV 6RIWZDUH WHVWV KDYH WR EH UHSHDWHG PRGLILHG DQG H[WHQGHG 7KH HIIRUW WR UHYLVH DQG UHSHDW WHVWV FRQVHTXHQWO\ IRUPV D PDMRU SDUW RI WKH RYHUDOO FRVW RI GHYHORSLQJ DQG PDLQWDLQLQJ VRIWZDUH 7KH WHUP UHJUHVVLRQ WHVWLQJ LV XVHG WR UHIHU WR WKH UHSHWLWLRQ RI HDUOLHU VXFFHVVIXO WHVWV LQ RUGHU WR PDNH VXUH WKDW FKDQJHV WR WKH VRIWZDUH KDYH QRW LQWURGXFHG VLGH HIIHFWV 

7HVW 'HVLJQ 'RFXPHQWDWLRQ

7KH GHVLJQ RI WHVWV LV VXEMHFW WR WKH VDPH EDVLF HQJLQHHULQJ SULQFLSOHV DV WKH GHVLJQ RI VRIWZDUH *RRG GHVLJQ FRQVLVWV RI D QXPEHU RI VWDJHV ZKLFK SURJUHVVLYHO\ HODERUDWH WKH GHVLJQ RI WHVWV IURP DQ LQLWLDO KLJK OHYHO VWUDWHJ\ WR GHWDLOHG WHVW SURFHGXUHV 7KHVH VWDJHV DUH WHVW VWUDWHJ\ WHVW SODQQLQJ WHVW FDVH GHVLJQ DQG WHVW SURFHGXUH GHVLJQ 7KH GHVLJQ RI WHVWV KDV WR EH GULYHQ E\ WKH VSHFLILFDWLRQ RI WKH VRIWZDUH $W WKH KLJKHVW OHYHO WKLV PHDQV WKDW WHVWV ZLOO EH GHVLJQHG WR YHULI\ WKDW WKH VRIWZDUH IDLWKIXOO\ LPSOHPHQWV WKH UHTXLUHPHQWV RI WKH 5HTXLUHPHQWV 6SHFLILFDWLRQ $W ORZHU OHYHOV WHVWV ZLOO EH GHVLJQHG WR YHULI\ WKDW LWHPV RI VRIWZDUH LPSOHPHQW DOO GHVLJQ GHFLVLRQV PDGH LQ WKH $UFKLWHFWXUDO 'HVLJQ 6SHFLILFDWLRQ DQG 'HWDLOHG 'HVLJQ 6SHFLILFDWLRQV $V ZLWK DQ\ GHVLJQ SURFHVV HDFK VWDJH RI WKH WHVW GHVLJQ SURFHVV VKRXOG EH VXEMHFW WR LQIRUPDO DQG IRUPDO UHYLHZ 7KH HDVH ZLWK ZKLFK WHVWV FDQ EH GHVLJQHG LV KLJKO\ GHSHQGDQW RQ WKH GHVLJQ RI WKH VRIWZDUH ,W LV LPSRUWDQW WR FRQVLGHU WHVWDELOLW\ DV D NH\ EXW XVXDOO\ XQGRFXPHQWHG UHTXLUHPHQW IRU DQ\ VRIWZDUH GHYHORSPHQW 

7HVW 6WUDWHJ\

7KH ILUVW VWDJH LV WKH IRUPXODWLRQ RI D WHVW VWUDWHJ\ $ WHVW VWUDWHJ\ LV D VWDWHPHQW RI WKH RYHUDOO DSSURDFK WR WHVWLQJ LGHQWLI\LQJ ZKDW OHYHOV RI WHVWLQJ DUH WR EH DSSOLHG DQG WKH PHWKRGV WHFKQLTXHV DQG WRROV WR EH XVHG $ WHVW VWUDWHJ\ VKRXOG LGHDOO\ EH RUJDQLVDWLRQ ZLGH EHLQJ DSSOLFDEOH WR DOO RI DQ RUJDQLVDWLRQV VRIWZDUH GHYHORSPHQWV

'HYHORSLQJ D WHVW VWUDWHJ\ ZKLFK HIILFLHQWO\ PHHWV WKH QHHGV RI DQ RUJDQLVDWLRQ LV FULWLFDO WR WKH VXFFHVV RI VRIWZDUH GHYHORSPHQW ZLWKLQ WKH RUJDQLVDWLRQ 7KH DSSOLFDWLRQ RI D WHVW VWUDWHJ\ WR D VRIWZDUH GHYHORSPHQW SURMHFW VKRXOG EH GHWDLOHG LQ WKH SURMHFWV VRIWZDUH TXDOLW\ SODQ 

7HVW 3ODQV

7KH QH[W VWDJH RI WHVW GHVLJQ ZKLFK LV WKH ILUVW VWDJH ZLWKLQ D VRIWZDUH GHYHORSPHQW SURMHFW LV WKH GHYHORSPHQW RI D WHVW SODQ $ WHVW SODQ VWDWHV ZKDW WKH LWHPV WR EH WHVWHG DUH DW ZKDW OHYHO WKH\ ZLOO EH WHVWHG ZKDW VHTXHQFH WKH\ DUH WR EH WHVWHG LQ KRZ WKH WHVW VWUDWHJ\ ZLOO EH DSSOLHG WR WKH WHVWLQJ RI HDFK LWHP DQG GHVFULEHV WKH WHVW HQYLURQPHQW $ WHVW SODQ PD\ EH SURMHFW ZLGH RU PD\ LQ IDFW EH D KLHUDUFK\ RI SODQV UHODWLQJ WR WKH YDULRXV OHYHOV RI VSHFLILFDWLRQ DQG WHVWLQJ 
‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

• $Q $FFHSWDQFH 7HVW 3ODQ GHVFULELQJ WKH SODQ IRU DFFHSWDQFH WHVWLQJ RI WKH VRIWZDUH 7KLV ZRXOG XVXDOO\ EH SXEOLVKHG DV D VHSDUDWH GRFXPHQW EXW PLJKW EH SXEOLVKHG ZLWK WKH V\VWHP WHVW SODQ DV D VLQJOH GRFXPHQW

• $ 6\VWHP 7HVW 3ODQ GHVFULELQJ WKH SODQ IRU V\VWHP LQWHJUDWLRQ DQG WHVWLQJ 7KLV ZRXOG DOVR XVXDOO\ EH SXEOLVKHG DV D VHSDUDWH GRFXPHQW EXW PLJKW EH SXEOLVKHG ZLWK WKH DFFHSWDQFH WHVW SODQ • $ 6RIWZDUH ,QWHJUDWLRQ 7HVW 3ODQ GHVFULELQJ WKH SODQ IRU LQWHJUDWLRQ RI WHVWHG VRIWZDUH FRPSRQHQWV 7KLV PD\ IRUP SDUW RI WKH $UFKLWHFWXUDO 'HVLJQ 6SHFLILFDWLRQ • 8QLW 7HVW 3ODQ V  GHVFULELQJ WKH SODQV IRU WHVWLQJ RI LQGLYLGXDO XQLWV RI VRIWZDUH 7KHVH PD\ IRUP SDUW RI WKH 'HWDLOHG 'HVLJQ 6SHFLILFDWLRQV

7KH REMHFWLYH RI HDFK WHVW SODQ LV WR SURYLGH D SODQ IRU YHULILFDWLRQ E\ WHVWLQJ WKH VRIWZDUH WKDW WKH VRIWZDUH SURGXFHG IXOILOV WKH UHTXLUHPHQWV RU GHVLJQ VWDWHPHQWV RI WKH DSSURSULDWH VRIWZDUH VSHFLILFDWLRQ ,Q WKH FDVH RI DFFHSWDQFH WHVWLQJ DQG V\VWHP WHVWLQJ WKLV PHDQV WKH 5HTXLUHPHQWV 6SHFLILFDWLRQ 

7HVW &DVH 'HVLJQ

2QFH WKH WHVW SODQ IRU D OHYHO RI WHVWLQJ KDV EHHQ ZULWWHQ WKH QH[W VWDJH RI WHVW GHVLJQ LV WR VSHFLI\ D VHW RI WHVW FDVHV RU WHVW SDWKV IRU HDFK LWHP WR EH WHVWHG DW WKDW OHYHO $ QXPEHU RI WHVW FDVHV ZLOO EH LGHQWLILHG IRU HDFK LWHP WR EH WHVWHG DW HDFK OHYHO RI WHVWLQJ (DFK WHVW FDVH ZLOO VSHFLI\ KRZ WKH LPSOHPHQWDWLRQ RI D SDUWLFXODU UHTXLUHPHQW RU GHVLJQ GHFLVLRQ LV WR EH WHVWHG DQG WKH FULWHULD IRU VXFFHVV RI WKH WHVW 7KH WHVW FDVHV PD\ EH GRFXPHQWHG ZLWK WKH WHVW SODQ DV D VHFWLRQ RI D VRIWZDUH VSHFLILFDWLRQ RU LQ D VHSDUDWH GRFXPHQW FDOOHG D WHVW VSHFLILFDWLRQ RU WHVW GHVFULSWLRQ • $Q $FFHSWDQFH 7HVW 6SHFLILFDWLRQ VSHFLI\LQJ WKH WHVW FDVHV IRU DFFHSWDQFH WHVWLQJ RI WKH VRIWZDUH 7KLV ZRXOG XVXDOO\ EH SXEOLVKHG DV D VHSDUDWH GRFXPHQW EXW PLJKW EH SXEOLVKHG ZLWK WKH DFFHSWDQFH WHVW SODQ • $ 6\VWHP 7HVW 6SHFLILFDWLRQ VSHFLI\LQJ WKH WHVW FDVHV IRU V\VWHP LQWHJUDWLRQ DQG WHVWLQJ 7KLV ZRXOG DOVR XVXDOO\ EH SXEOLVKHG DV D VHSDUDWH GRFXPHQW EXW PLJKW EH SXEOLVKHG ZLWK WKH V\VWHP WHVW SODQ

• 6RIWZDUH ,QWHJUDWLRQ 7HVW 6SHFLILFDWLRQV VSHFLI\LQJ WKH WHVW FDVHV IRU HDFK VWDJH RI LQWHJUDWLRQ RI WHVWHG VRIWZDUH FRPSRQHQWV 7KHVH PD\ IRUP VHFWLRQV RI WKH $UFKLWHFWXUDO 'HVLJQ 6SHFLILFDWLRQ • 8QLW 7HVW 6SHFLILFDWLRQV VSHFLI\LQJ WKH WHVW FDVHV IRU WHVWLQJ RI LQGLYLGXDO XQLWV RI VRIWZDUH 7KHVH PD\ IRUP VHFWLRQV RI WKH 'HWDLOHG 'HVLJQ 6SHFLILFDWLRQV 6\VWHP WHVWLQJ DQG DFFHSWDQFH WHVWLQJ LQYROYH DQ HQRUPRXV QXPEHU RI LQGLYLGXDO WHVW FDVHV ,Q RUGHU WR NHHS WUDFN RI ZKLFK UHTXLUHPHQWV DUH WHVWHG E\ ZKLFK WHVW FDVHV DQ LQGH[ ZKLFK FURVV UHIHUHQFHV EHWZHHQ UHTXLUHPHQWV DQG WHVW FDVHV RIWHQ FRQVWUXFWHG 7KLV LV XVXDOO\ UHIHUUHG WR DV D 9HULILFDWLRQ &URVV 5HIHUHQFH ,QGH[ 9&5, DQG LV DWWDFKHG WR WKH WHVW VSHFLILFDWLRQ &URVV UHIHUHQFH LQGH[HV PD\ DOVR EH XVHG ZLWK XQLW WHVWLQJ DQG VRIWZDUH LQWHJUDWLRQ WHVWLQJ ,W LV LPSRUWDQW WR GHVLJQ WHVW FDVHV IRU ERWK SRVLWLYH WHVWLQJ DQG QHJDWLYH WHVWLQJ 3RVLWLYH WHVWLQJ FKHFNV WKDW WKH VRIWZDUH GRHV ZKDW LW VKRXOG 1HJDWLYH WHVWLQJ FKHFNV WKDW WKH VRIWZDUH GRHVQ
W GR ZKDW LW VKRXOGQ
W 
‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

7KH SURFHVV RI GHVLJQLQJ WHVW FDVHV LQFOXGLQJ H[HFXWLQJ WKHP DV WKRXJKW H[SHULPHQWV ZLOO RIWHQ LGHQWLI\ EXJV EHIRUH WKH VRIWZDUH KDV HYHQ EHHQ EXLOW ,W LV QRW XQFRPPRQ WR ILQG PRUH EXJV ZKHQ GHVLJQLQJ WHVWV WKDQ ZKHQ H[HFXWLQJ WHVWV 

7HVW 3URFHGXUHV

7KH ILQDO VWDJH RI WHVW GHVLJQ LV WR LPSOHPHQW D VHW RI WHVW FDVHV DV D WHVW SURFHGXUH VSHFLI\LQJ WKH H[DFW SURFHVV WR EH IROORZHG WR FRQGXFW HDFK RI WKH WHVW FDVHV 7KLV LV D IDLUO\ VWUDLJKW IRUZDUG SURFHVV ZKLFK FDQ EH OLNHQHG WR GHVLJQLQJ XQLWV RI FRGH IURP KLJKHU OHYHO IXQFWLRQDO GHVFULSWLRQV )RU HDFK LWHP WR EH WHVWHG DW HDFK OHYHO RI WHVWLQJ D WHVW SURFHGXUH ZLOO VSHFLI\ WKH SURFHVV WR EH IROORZHG LQ FRQGXFWLQJ WKH DSSURSULDWH WHVW FDVHV $ WHVW SURFHGXUH FDQQRW OHDYH RXW VWHSV RU PDNH DVVXPSWLRQV 7KH OHYHO RI GHWDLO PXVW EH VXFK WKDW WKH WHVW SURFHGXUH LV GHWHUPLQLVWLF DQG UHSHDWDEOH 7HVW SURFHGXUHV VKRXOG DOZD\V EH VHSDUDWH LWHPV EHFDXVH WKH\ FRQWDLQ D JUHDW GHDO RI GHWDLO ZKLFK LV LUUHOHYDQW WR VRIWZDUH VSHFLILFDWLRQV ,I $GD7(67 RU &DQWDWD DUH XVHG WHVW SURFHGXUHV PD\ EH FRGHG GLUHFWO\ DV $GD7(67 RU &DQWDWD WHVW VFULSWV 

7HVW 5HVXOWV 'RFXPHQWDWLRQ

:KHQ WHVWV DUH H[HFXWHG WKH RXWSXWV RI HDFK WHVW H[HFXWLRQ VKRXOG EH UHFRUGHG LQ D WHVW UHVXOWV ILOH 7KHVH UHVXOWV DUH WKHQ DVVHVVHG DJDLQVW FULWHULD LQ WKH WHVW VSHFLILFDWLRQ WR GHWHUPLQH WKH RYHUDOO RXWFRPH RI D WHVW ,I $GD7(67 RU &DQWDWD DUH XVHG WKLV ILOH ZLOO EH FUHDWHG DQG WKH UHVXOWV DVVHVVHG DXWRPDWLFDOO\ DFFRUGLQJ WR FULWHULD VSHFLILHG LQ WKH WHVW VFULSW

(DFK WHVW H[HFXWLRQ VKRXOG DOVR EH QRWHG LQ D WHVW ORJ 7KH WHVW ORJ ZLOO FRQWDLQ UHFRUGV RI ZKHQ HDFK WHVW KDV EHHQ H[HFXWHG WKH RXWFRPH RI HDFK WHVW H[HFXWLRQ DQG PD\ DOVR LQFOXGH NH\ REVHUYDWLRQV PDGH GXULQJ WHVW H[HFXWLRQ 2IWHQ D WHVW ORJ LV QRW PDLQWDLQHG IRU ORZHU OHYHOV RI WHVWLQJ XQLW WHVW DQG VRIWZDUH LQWHJUDWLRQ WHVW  7HVW UHSRUWV PD\ EH SURGXFHG DW YDULRXV SRLQWV GXULQJ WKH WHVWLQJ SURFHVV $ WHVW UHSRUW ZLOO VXPPDULVH WKH UHVXOWV RI WHVWLQJ DQG GRFXPHQW DQ\ DQDO\VLV $Q DFFHSWDQFH WHVW UHSRUW RIWHQ IRUPV D FRQWUDFWXDO GRFXPHQW ZLWKLQ ZKLFK DFFHSWDQFH RI VRIWZDUH LV DJUHHG 

)XUWKHU 5HVXOWV DQG &RQFOXVLRQ

6RIWZDUH FDQ EH WHVWHG DW YDULRXV VWDJHV RI WKH GHYHORSPHQW DQG ZLWK YDULRXV GHJUHHV RI ULJRXU /LNH DQ\ GHYHORSPHQW DFWLYLW\ WHVWLQJ FRQVXPHV HIIRUW DQG HIIRUW FRVWV PRQH\ 'HYHORSHUV VKRXOG SODQ IRU EHWZHHQ  DQG  RI D SURMHFWV HIIRUW WR EH H[SHQGHG RQ YHULILFDWLRQ DQG YDOLGDWLRQ DFWLYLWLHV LQFOXGLQJ VRIWZDUH WHVWLQJ

)URP DQ HFRQRPLFV SRLQW RI YLHZ WKH OHYHO RI WHVWLQJ DSSURSULDWH WR D SDUWLFXODU RUJDQLVDWLRQ DQG VRIWZDUH DSSOLFDWLRQ ZLOO GHSHQG RQ WKH SRWHQWLDO FRQVHTXHQFHV RI XQGHWHFWHG EXJV 6XFK FRQVHTXHQFHV FDQ UDQJH IURP D PLQRU LQFRQYHQLHQFH RI KDYLQJ WR ILQG D ZRUNURXQG IRU D EXJ WR PXOWLSOH GHDWKV 2IWHQ RYHUORRNHG E\ VRIWZDUH GHYHORSHUV EXW QRW E\ FXVWRPHUV  LV WKH ORQJ WHUP GDPDJH WR WKH FUHGLELOLW\ RI DQ RUJDQLVDWLRQ ZKLFK GHOLYHUV VRIWZDUH WR XVHUV ZLWK EXJV LQ LW DQG WKH UHVXOWLQJ QHJDWLYH LPSDFW RQ 
‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

IXWXUH EXVLQHVV &RQYHUVHO\ D UHSXWDWLRQ IRU UHOLDEOH VRIWZDUH ZLOO KHOS DQ RUJDQLVDWLRQ WR REWDLQ IXWXUH EXVLQHVV

(IILFLHQF\ DQG TXDOLW\ DUH EHVW VHUYHG E\ WHVWLQJ VRIWZDUH DV HDUO\ LQ WKH OLIH F\FOH DV SUDFWLFDO ZLWK IXOO UHJUHVVLRQ WHVWLQJ ZKHQHYHU FKDQJHV DUH PDGH 7KH ODWHU D EXJ LV IRXQG WKH KLJKHU WKH FRVW RI IL[LQJ LW VR LW LV VRXQG HFRQRPLFV WR LGHQWLI\ DQG IL[ EXJV DV HDUO\ DV SRVVLEOH 'HVLJQLQJ WHVWV ZLOO KHOS WR LGHQWLI\ EXJV HYHQ EHIRUH WKH WHVWV DUH H[HFXWHG VR GHVLJQLQJ WHVWV DV HDUO\ DV SUDFWLFDO LQ D VRIWZDUH GHYHORSPHQW LV D XVHIXO PHDQV RI UHGXFLQJ WKH FRVW RI LGHQWLI\LQJ DQG FRUUHFWLQJ EXJV ,Q SUDFWLFH WKH GHVLJQ RI HDFK OHYHO RI VRIWZDUH WHVWLQJ ZLOO EH GHYHORSHG WKURXJK D QXPEHU RI OD\HUV HDFK DGGLQJ PRUH GHWDLO WR WKH WHVWV (DFK OHYHO RI WHVWV VKRXOG EH GHVLJQHG EHIRUH WKH LPSOHPHQWDWLRQ UHDFKHV D SRLQW ZKLFK FRXOG LQIOXHQFH WKH GHVLJQ RI WHVWV LQ VXFK D ZD\ DV WR EH GHWULPHQWDO WR WKH REMHFWLYLW\ RI WKH WHVWV 5HPHPEHU VRIWZDUH VKRXOG EH WHVWHG DJDLQVW ZKDW LW LV VSHFLILHG WR GR QRW DJDLQVW ZKDW LW DFWXDOO\ REVHUYHG WR GR 7KH HIIHFWLYHQHVV RI WHVWLQJ HIIRUW FDQ EH PD[LPLVHG E\ VHOHFWLRQ RI DQ DSSURSULDWH WHVWLQJ VWUDWHJ\ JRRG PDQDJHPHQW RI WKH WHVWLQJ SURFHVV DQG DSSURSULDWH XVH RI WRROV VXFK DV $GD7(67 RU &DQWDWD WR VXSSRUW WKH WHVWLQJ SURFHVV 7KH QHW UHVXOW ZLOO EH DQ LQFUHDVH LQ TXDOLW\ DQG D GHFUHDVH LQ FRVWV ERWK RI ZKLFK FDQ RQO\ EH EHQHILFLDO WR D VRIWZDUH GHYHORSHUV EXVLQHVV

7KH IROORZLQJ OLVW SURYLGHV VRPH UXOHV WR IROORZ DV DQ DLG WR HIIHFWLYH DQG EHQHILFLDO VRIWZDUH WHVWLQJ • $OZD\V WHVW DJDLQVW D VSHFLILFDWLRQ ,I WHVWV DUH QRW GHYHORSHG IURP D VSHFLILFDWLRQ WKHQ LW LV QRW WHVWLQJ +HQFH WHVWLQJ LV WRWDOO\ UHOLDQW XSRQ DGHTXDWH VSHFLILFDWLRQ RI VRIWZDUH • 'RFXPHQW WKH WHVWLQJ SURFHVV VSHFLI\ WHVWV DQG UHFRUG WHVW UHVXOWV • 3ODQ YHULILFDWLRQ DQG YDOLGDWLRQ DFWLYLWLHV SDUWLFXODUO\ WHVWLQJ • 7HVW KLHUDUFKLFDOO\ DJDLQVW HDFK OHYHO RI VSHFLILFDWLRQ )LQGLQJ PRUH HUURUV HDUOLHU ZLOO XOWLPDWHO\ UHGXFH FRVWV • &RPSOHPHQW WHVWLQJ ZLWK WHFKQLTXHV VXFK DV VWDWLF DQDO\VLV DQG G\QDPLF DQDO\VLV

• $OZD\V WHVW SRVLWLYHO\ WKDW WKH VRIWZDUH GRHV ZKDW LW VKRXOG EXW DOVR QHJDWLYHO\ WKDW LW GRHVQ
W GR ZKDW LW VKRXOGQ
W • +DYH WKH ULJKW DWWLWXGH WR WHVWLQJ  LW VKRXOG EH D FKDOOHQJH QRW WKH FKRUH LW VR RIWHQ EHFRPHV 

‹,3/ ,QIRUPDWLRQ 3URFHVVLQJ /WG

Sign up to vote on this title
UsefulNot useful