FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV

PIQ  LG &' ODQJ HV GEODQJ OLE &2&

&RS\ULJKW7KH&RFKUDQH/LEUDU\

3(5,23(5$7,9(&+(025$',27+(5$3<9(568635,0$5<685*(5<)25 2SFLRQHV

5(6(&7$%/($'(12&$5&,120$2)7+(6720$&+*$6752(623+$*($/
ËQGLFH
-81&7,21$1'/2:(5(623+$*86
5RQHOOHQILWVFK8OULFK6FKZDU]EDFK0DWWKLDV+RIKHLQ]5DOI.LHQOH3HWHU YHUVLyQSDUDLPSULPLU
.LHVHU0HLQKDUG6ODQJHU7UDF\(-HQVHQ.DWULQ

5RQHOOHQILWVFK8OULFK6FKZDU]EDFK0DWWKLDV+RIKHLQ]5DOI.LHQOH3HWHU.LHVHU0HLQKDUG6ODQJHU7UDF\(
-HQVHQ.DWULQ
&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV,VVXH6WDWXVLQWKLVLVVXH1(:
&RS\ULJKW‹7KH&RFKUDQH&ROODERUDWLRQ3XEOLVKHGE\-RKQ:LOH\ 6RQV/WG
'2,&'SXE
7KLVUHYLHZVKRXOGEHFLWHGDV5RQHOOHQILWVFK8OULFK6FKZDU]EDFK0DWWKLDV+RIKHLQ]5DOI.LHQOH3HWHU
.LHVHU0HLQKDUG6ODQJHU7UDF\(-HQVHQ.DWULQ3HULRSHUDWLYHFKHPRUDGLRWKHUDS\YHUVXVSULPDU\VXUJHU\IRU
UHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFKJDVWURHVRSKDJHDOMXQFWLRQDQGORZHUHVRSKDJXV&RFKUDQH'DWDEDVH
RI6\VWHPDWLF5HYLHZV,Q7KH&RFKUDQH/LEUDU\,VVXH$UW1R&''2,
&'SXE

$%675$&7

%DFNJURXQG
7KHRXWFRPHRISDWLHQWVZLWKORFDOO\DGYDQFHGJDVWURHVRSKDJHDODGHQRFDUFLQRPDDGHQRFDUFLQRPDRIWKH
HVRSKDJXVJDVWURHVRSKDJHDO*(MXQFWLRQDQGVWRPDFKLVSRRU7KHUHLVFRQIOLFWLQJHYLGHQFHUHJDUGLQJWKH
HIIHFWVRISHULRSHUDWLYHFKHPRWKHUDS\RQVXUYLYDODQGRWKHURXWFRPHV
2EMHFWLYH
7RDVVHVVWKHHIIHFWRISHULRSHUDWLYHFKHPRWKHUDS\IRUJDVWURHVRSKDJHDODGHQRFDUFLQRPDRQVXUYLYDODQGRWKHU
FOLQLFDOO\UHOHYDQWRXWFRPHVLQWKHRYHUDOOSRSXODWLRQRISDUWLFLSDQWVLQUDQGRPL]HGFRQWUROOHGWULDOV5&7VDQGLQ
SUHVSHFLILHGVXEJURXSV
5(9,(:B$%6B27+(5
:HSHUIRUPHGFRPSXWHUL]HGVHDUFKHVLQWKH&RFKUDQH&HQWUDO5HJLVWHURI&RQWUROOHG7ULDOV&(175$/'DWDEDVHRI
$EVWUDFWVRI5HYLHZRI(IIHFWLYHQHVV'$5(WKH&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV&'65IURP7KH
&RFKUDQH/LEUDU\0('/,1(WR0D\(0%$6(WR0D\DQG/,/$&6/LWHUDWXUD
/DWLQRDPHULFDQD\GHO&DULEHHQ&LHQFLDVGHOD6DOXGFRPELQLQJWKH&RFKUDQHKLJKO\VHQVLWLYHVHDUFKVWUDWHJ\
ZLWKVSHFLILFVHDUFKWHUPV0RUHRYHUZHKDQGVHDUFKHGVHYHUDORQOLQHGDWDEDVHVFRQIHUHQFHSURFHHGLQJVDQG
UHIHUHQFHOLVWVRIUHWULHYHGSDSHUV
6HOHFWLRQFULWHULD
:HLQFOXGHG5&7VZKLFKUDQGRPL]HGSDWLHQWVZLWKJDVWURHVRSKDJHDODGHQRFDUFLQRPDLQWKHDEVHQFHRIGLVWDQW
PHWDVWDVHVWRUHFHLYHHLWKHUFKHPRWKHUDS\ZLWKRUZLWKRXWUDGLRWKHUDS\IROORZHGE\VXUJHU\RUVXUJHU\DORQH
'DWDFROOHFWLRQDQGDQDO\VLV
7ZRLQGHSHQGHQWUHYLHZDXWKRUVLGHQWLILHGHOLJLEOHWULDOV:HVROLFLWHGLQGLYLGXDOSDWLHQWGDWD,3'IURPDOOVHOHFWHG
WULDOV:HSHUIRUPHGPHWDDQDO\VHVEDVHGRQLQWHQWLRQWRWUHDWSRSXODWLRQVXVLQJWKHWZRVWDJHPHWKRGWRFRPELQH
,3'ZLWKDJJUHJDWHGDWDIURP5&7VIRUZKLFK,3'ZHUHXQDYDLODEOH:HFRPELQHGGDWDIURPDOOWULDOVSURYLGLQJ,3'
LQD&R[SURSRUWLRQDOKD]DUGVPRGHOWRDVVHVVWKHHIIHFWRIVHYHUDOFRYDULDEOHVRQRYHUDOOVXUYLYDO
0DLQUHVXOWV
:HLGHQWLILHG5&7VZLWKHOLJLEOHSDWLHQWV)RUHLJKW5&7VZLWKSDWLHQWVZHZHUHDEOHWR
REWDLQ,3'3HULRSHUDWLYHFKHPRWKHUDS\ZDVDVVRFLDWHGZLWKVLJQLILFDQWO\ORQJHURYHUDOOVXUYLYDOKD]DUGUDWLR+5
FRQILGHQFHLQWHUYDO&,WR7KLVFRUUHVSRQGVWRDUHODWLYHVXUYLYDOLQFUHDVHRIRUDQ
DEVROXWHVXUYLYDOLQFUHDVHRIDWILYH\HDUV7KLVVXUYLYDODGYDQWDJHZDVFRQVLVWHQWDFURVVPRVWVXEJURXSV
7KHUHZDVDWUHQGWRZDUGVDPRUHSURQRXQFHGWUHDWPHQWHIIHFWIRUWXPRUVRIWKH*(MXQFWLRQFRPSDUHGWRRWKHU
VLWHVDQGIRUFRPELQHGFKHPRUDGLRWKHUDS\DVFRPSDUHGWRFKHPRWKHUDS\LQWXPRUVRIWKHHVRSKDJXVDQG*(
MXQFWLRQ5HVHFWLRQZLWKQHJDWLYHPDUJLQVZDVDVWURQJSUHGLFWRURIVXUYLYDO0XOWLYDULDEOHDQDO\VLVVKRZHGWKDW
WXPRUVLWHSHUIRUPDQFHVWDWXVDQGDJHKDYHDQLQGHSHQGHQWVLJQLILFDQWHIIHFWRQVXUYLYDO0RUHRYHUWKHUHZDVD
VLJQLILFDQWLQWHUDFWLRQRIWKHHIIHFWRISHULRSHUDWLYHFKHPRWKHUDS\ZLWKDJHODUJHUWUHDWPHQWHIIHFWLQ\RXQJHU
SDWLHQWV3HULRSHUDWLYHFKHPRWKHUDS\DOVRVKRZHGDVLJQLILFDQWHIIHFWRQVHYHUDOVHFRQGDU\RXWFRPHV,WZDV
DVVRFLDWHGZLWKORQJHUGLVHDVHIUHHVXUYLYDOKLJKHUUDWHVRI5UHVHFWLRQDQGPRUHIDYRUDEOHWXPRUVWDJHXSRQ
UHVHFWLRQZKLOHWKHUHZDVQRDVVRFLDWLRQZLWKSHULRSHUDWLYHPRUELGLW\DQGPRUWDOLW\
$XWKRUV
FRQFOXVLRQV
3HULRSHUDWLYHFKHPRWKHUDS\IRUUHVHFWDEOHJDVWURHVRSKDJHDODGHQRFDUFLQRPDLQFUHDVHVVXUYLYDOFRPSDUHGWR
VXUJHU\DORQH,WVKRXOGWKXVEHRIIHUHGWRDOOHOLJLEOHSDWLHQWV7KHUHLVDWUHQGWRDODUJHUVXUYLYDODGYDQWDJHIRU

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
WXPRUVRIWKH*(MXQFWLRQDVFRPSDUHGWRRWKHUVLWHVDQGIRUFKHPRUDGLRWKHUDS\DVFRPSDUHGWRFKHPRWKHUDS\LQ
HVRSKDJHDODQG*(MXQFWLRQWXPRUV/LNHZLVHWKHUHLVDQLQWHUDFWLRQEHWZHHQDJHDQGWUHDWPHQWHIIHFWZLWK
\RXQJHUSDWLHQWVKDYLQJDODUJHUVXUYLYDODGYDQWDJHDQGQRVXUYLYDODGYDQWDJHIRUHOGHUO\SDWLHQWV

3/$,1/$1*8$*(6 800$5<

7KLVV\VWHPDWLFUHYLHZXVHVWKHGDWDRILQGLYLGXDOSDWLHQWVIURPHLJKWDQGSXEOLVKHGGDWDIURPDQRWKHUVL[
UDQGRPL]HGFRQWUROOHGWULDOV:HIRXQGWKDWWKHDGPLQLVWUDWLRQRIFKHPRWKHUDS\EHIRUHVXUJHU\OHDGVWRORQJHU
VXUYLYDOLQSDWLHQWVZLWKDGHQRFDUFLQRPDRIWKHHVRSKDJXVWKHMXQFWLRQEHWZHHQHVRSKDJXVDQGVWRPDFKDQGWKH
VWRPDFK7KHILQGLQJVVXJJHVWWKDWSDWLHQWVZKRVHWXPRULVLQWKHMXQFWLRQEHWZHHQHVRSKDJXVDQGVWRPDFKDQG
\RXQJHUSDWLHQWVEHQHILWPRVWIURPWKHFKHPRWKHUDS\0RUHRYHUWKHDGGLWLRQRIUDGLDWLRQWRWKHFKHPRWKHUDS\
VHHPVWR\LHOGDQDGGLWLRQDODGYDQWDJHWRSDWLHQWVDWOHDVWLQWXPRUVRIWKHHVRSKDJXVDQGWKHMXQFWLRQEHWZHHQ
HVRSKDJXVDQGVWRPDFK&KHPRWKHUDS\EHIRUHVXUJHU\GRHVQRWLQFUHDVHWKHULVNRIVXIIHULQJDFRPSOLFDWLRQ
GXULQJRUDIWHUVXUJHU\

% $&.*5281'

2%-(&7,9(6

7KHSULPDU\REMHFWLYHRIWKLVV\VWHPDWLFUHYLHZZDVWRDVVHVVLISHULRSHUDWLYHFKHPRWKHUDS\OHDGVWRDORQJHU
RYHUDOOVXUYLYDODVFRPSDUHGWRVXUJHU\ZLWKRXWSULRUWXPRUVSHFLILFWKHUDS\LQSDWLHQWVZLWKORFRUHJLRQDOO\
DGYDQFHGUHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFK*(MXQFWLRQDQGHVRSKDJXV6HFRQGDU\REMHFWLYHVDUHWR
FRPSDUHGLVHDVHIUHHVXUYLYDOUHVHFWDELOLW\WXPRUVWDJHXSRQUHVHFWLRQSHULRSHUDWLYHPRUELGLW\DQGPRUWDOLW\
DQGWRDVVHVVWKHVDIHW\DQGWR[LFLW\RISHULRSHUDWLYHFKHPRWKHUDS\DVZHOODVUHDVRQVIRUSRVVLEOHQRQ
DGPLQLVWUDWLRQRIWKHSRVWRSHUDWLYHO\SODQQHGF\FOHVRIFKHPRWKHUDS\ZKHUHIRUHVHHQLQWKHVWXG\SURWRFRO

0(7+ 2'6 2)7+ (5(9,(:

&5,7(5,$)25&216 ,'(5,1*6 78',(6 )257+ ,6 5(9,(:

7\SHVRIVWXGLHV

7KHUHYLHZLQFOXGHGRQO\5&7V'XHWRWKHVSHFLILFLQWHUYHQWLRQXQGHUVWXG\EOLQGLQJDQGSODFHERWUHDWPHQWDUH
WHFKQLFDOO\DQGRUHWKLFDOO\GLIILFXOWEHFDXVHWKHXQDYRLGDEOHGHOD\RIVXUJHU\LQDVWXG\DUPZKHUHVXEMHFWV
UHFHLYHD
QHRDGMXYDQW
SODFHERWUHDWPHQWZRXOGLQGXELWDEO\OHDGWRDVLJQLILFDQWZRUVHQLQJRIWKHLUVXUYLYDO
7KHUHIRUHZHGLGQRWFRQVLGHUEOLQGLQJDQGSODFHERWUHDWPHQWDVFULWHULDIRULQFOXVLRQRUH[FOXVLRQ

7\SHVRISDUWLFLSDQWV

7REHLQFOXGHGLQWKHUHYLHZWULDOVQHHGHGWREHFRQGXFWHGRQSDWLHQWVIXOILOOLQJWKHIROORZLQJFULWHULD
KLVWRORJLFDOO\FRQILUPHGDGHQRFDUFLQRPDRIWKHVWRPDFK*(MXQFWLRQRUHVRSKDJXVIRUVWXGLHVZKLFKLQFOXGH
SDWLHQWVZLWKERWKDGHQRFDUFLQRPDDQGRWKHUKLVWRORJLFDOHQWLWLHVOLNHVTXDPRXVFHOOFDUFLQRPDZHVRXJKWWRREWDLQ
,3'RUDJJUHJDWHPHDVXUHVVHHEHORZUHODWLQJWRSDWLHQWVZLWKDGHQRFDUFLQRPDRQO\
SUHYLRXVO\XQWUHDWHG
ORFRUHJLRQDOO\DGYDQFHG8,&&VWDJH,EDQGKLJKHUIRUDGHQRFDUFLQRPDRIWKHVWRPDFK8,&&VWDJH,,IRU
DGHQRFDUFLQRPDRIWKHHVRSKDJXV6RELQ
UHVHFWDEOHEDVHGRQVWDJLQJH[DPV
DEVHQFHRIGLVWDQWRUSHULWRQHDOPHWDVWDVHV

7\SHVRILQWHUYHQWLRQ

7KHH[SHULPHQWDOLQWHUYHQWLRQLQWKHFRQWH[WRIWKLVV\VWHPDWLFUHYLHZZDVGHILQHGDVVXUJHU\ZLWKFXUDWLYH
LQWHQWLRQFRPELQHGZLWKSHULRSHUDWLYHFKHPRWKHUDS\GHILQHGDVDWUHDWPHQWUHJLPHQZLWKDQ\NLQGRI
F\WRWR[LFDQWLQHRSODVWLFGUXJRUDFRPELQDWLRQRIVHYHUDORIWKHVHGUXJV7REHUHJDUGHGDVSHULRSHUDWLYH
FKHPRWKHUDS\QHHGHGWREHDGPLQLVWHUHGLQDQHRDGMXYDQWSUHRSHUDWLYHVHWWLQJDQGRSWLRQDOO\LQDQDGGLWLRQDO
DGMXYDQWSRVWRSHUDWLYHPDQQHU:HDOVRLQFOXGHGVWXGLHVLISDWLHQWVUHFHLYHGSUHRUSRVWRSHUDWLYHUDGLRWKHUDS\
LQDGGLWLRQWRSHULRSHUDWLYHFKHPRWKHUDS\:HGHILQHGWKHFRQWUROLQWHUYHQWLRQDVVXUJHU\ZLWKFXUDWLYHLQWHQWLRQ
ZLWKRXWDQ\SULRUWXPRUVSHFLILFWKHUDS\DQGLQFOXGHGSDWLHQWVXQGHUJRLQJDQ\VXUJHU\ZLWKFXUDWLYHLQWHQWLRQ

7\SHVRIRXWFRPHPHDVXUHV

3ULPDU\RXWFRPHV

7KHSULPDU\RXWFRPHZDVWLPHWRGHDWKPHDVXUHGLQGD\VIURPWKHGDWHRIUDQGRPL]DWLRQEDVHGRQDQLQWHQWLRQ

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
WRWUHDWDQDO\VLV,IFHQVRUHGWLPHWRHYHQWGDWDRUDGHTXDWHVXPPDU\PHDVXUHVRIWLPHWRHYHQWGDWDZHUHQRW
DYDLODEOHIURPWKHVLQJOHWULDOVZHXVHGWKHYLWDOVWDWXVDOLYHRUGHFHDVHGDWWKHHQGRIIROORZXS

6HFRQGDU\RXWFRPHV

6HFRQGDU\RXWFRPHVZHUH
GLVHDVHIUHHVXUYLYDOWLPHGHILQHGDVWKHWLPHIURPD
ODQGPDUN
VL[PRQWKVDIWHUUDQGRPL]DWLRQXQWLOUHFXUUHQFH
ORFDORUGLVWDQWRUGHDWKRIDQ\FDXVHWKHODQGPDUNPHWKRGDFFRXQWVIRUWKHGLIIHUHQFHLQWKHWLPLQJRIVXUJHU\
EHWZHHQWKHWZRWUHDWPHQWJURXSVIRUGHWDLOVVHH'DWDV\QWKHVLV
SUHVHQFHRIDWXPRUIUHHUHVHFWLRQPDUJLQDVDVVHVVHGIURPWKHVXUJLFDOVSHFLPHQE\DSDWKRORJLVWGLFKRWRPRXV
RXWFRPH\HVQR
WXPRUVWDJHDWUHVHFWLRQDVDVVHVVHGIURPWKHVXUJLFDOVSHFLPHQDFFRUGLQJWRWKHYHUVLRQRIWKH8,&&
V7107
10FODVVLILFDWLRQ6RELQSURYLGHGLQWKHUHVSHFWLYHWULDO
V,3'RUDJJUHJDWHGDWD
VDIHW\RIWKHSHULRSHUDWLYHFKHPRWKHUDS\UHJLPHQPHDVXUHGE\WR[LFLW\DFFRUGLQJWRWKHYHUVLRQRIWKH1DWLRQDO
&DQFHU,QVWLWXWH&RPPRQ7HUPLQRORJ\&ULWHULDIRU$GYHUVH(YHQWV&7&$(SURYLGHGLQWKHUHVSHFWLYHWULDO
V,3'RU
DJJUHJDWHGDWD
SHULRSHUDWLYHPRUELGLW\PHDVXUHGE\DVVHVVLQJKRZPDQ\RIWKHIROORZLQJHYHQWVRFFXUUHGDQDVWRPRWLFOHDNDJH
SRVWRSHUDWLYHSQHXPRQLDSRVWRSHUDWLYHZRXQGLQIHFWLRQDQGPRUWDOLW\PHDVXUHGE\DVVHVVLQJLIDSDWLHQWGLHG
GXULQJVXUJHU\RUWKHFRQVHFXWLYHKRVSLWDOVWD\
WKHIUHTXHQF\DQGUHDVRQVIRUSRVVLEOHQRQDGPLQLVWUDWLRQRIWKHSRVWRSHUDWLYHO\SODQQHGF\FOHVRIFKHPRWKHUDS\
ZKHUHIRUHVHHQLQWKHVWXG\SURWRFROIRUWKHSHULRSHUDWLYHFKHPRWKHUDS\DUPV

6 ($5&+ 0(7+ 2'6 )25,'(17,),&$7,212)6 78',(6

6HDUFKPHWKRGVIRULGHQWLILFDWLRQRIVWXGLHV

(OHFWURQLFVHDUFKHV

,Q6HSWHPEHUZHSHUIRUPHGDFRPSXWHUL]HGOLWHUDWXUHVHDUFKLQ
WKH&RFKUDQH&HQWUDO5HJLVWHURI&RQWUROOHG7ULDOV&(175$/'DWDEDVHRI$EVWUDFWVRI5HYLHZRI(IIHFWLYHQHVV
'$5(WKH&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV&'65IURP7KH&RFKUDQH/LEUDU\UG4XDUWHU
0('/,1(WR6HSWZHHN$SSHQGL[
(0%$6(WRZHHNDQG
/,/$&6/LWHUDWXUD/DWLQRDPHULFDQD\GHO&DULEHHQ&LHQFLDVGHOD6DOXGXSWR6HSWHPEHU
:HOLPLWHGRXUVHDUFKWRVWXGLHVLQKXPDQV7KHUHZHUHQRODQJXDJHUHVWULFWLRQVIRUHLWKHUVHDUFKLQJRUWULDO
LQFOXVLRQ:HFRPELQHGWKH&RFKUDQHKLJKO\VHQVLWLYHVHDUFKVWUDWHJ\IRULGHQWLI\LQJUDQGRPL]HGWULDOVLQ0('/,1(
VHQVLWLYLW\PD[LPL]LQJYHUVLRQ2YLGIRUPDW+LJJLQVZLWKVSHFLILFVHDUFKWHUPVWRLGHQWLI\UDQGRPL]HG
FRQWUROOHGWULDOVLQ0('/,1(VHH$SSHQGL[
:HDGDSWHGWKH0('/,1(VHDUFKVWUDWHJ\IRUXVHLQWKHRWKHUGDWDEDVHVVHDUFKHG0RUHRYHUZHVHDUFKHGWKH
IROORZLQJRQOLQHGDWDEDVHVRIRQJRLQJWULDOV
ZZZFOLQLFDOWULDOVJRY
ZZZFHQWHUZDWFKFRP
ZZZFDQFHUJRYFOLQLFDOWULDOV
ZZZWULDOVFHQWUDORUJ
ZZZFDOJERUJ
ZZZFRQWUROOHGWULDOVFRP
ZZZHRUWFEH
ZZZVZRJRUJ9LVLWRUV&OLQLFDO7ULDOVDVS
ZZZFWJTXHHQVXFD
:HH[WHQGHGRXUVHDUFKXVLQJ(0%$6(2YLG0('/,1(DQG(%05HYLHZV&RFKUDQH&HQWUDO5HJLVWHURI&RQWUROOHG
7ULDOVIRUVWXGLHVSXEOLVKHGXQWLO0D\ZKLFKZDVWKHGDWHZKHQRXUGDWDEDVHZDVFORVHGIRUDQDO\VLVVHH
'HDOLQJZLWKPLVVLQJGDWD

6HDUFKLQJRWKHUUHVRXUFHV

:HKDQGVHDUFKHGWKHDEVWUDFWVIURPWRRIWKH$PHULFDQ'LJHVWLYH'LVHDVH:HHN'':SXEOLVKHGLQ

*DVWURHQWHURORJ\WKH8QLWHG(XURSHDQ*DVWURHQWHURORJ\:HHN8(*:SXEOLVKHGLQ*XWDQGWKH$QQXDO0HHWLQJV

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
RIWKH$PHULFDQ6RFLHW\RI&OLQLFDO2QFRORJ\$6&2SXEOLVKHGLQWKH-RXUQDORI&OLQLFDO2QFRORJ\:HVFDQQHG
UHIHUHQFHOLVWVRIUHWULHYHGDUWLFOHVWRLGHQWLI\IXUWKHUUHOHYDQWWULDOV:HFRQWDFWHGH[SHUWVLQWKHILHOGDERXWDQ\
XQSXEOLVKHGRURQJRLQJVWXGLHV:HDVNHGWKHDXWKRUVRIWULDOUHSRUWVSXEOLVKHGRQO\DVDEVWUDFWVRURIRQJRLQJ
VWXGLHVWRFRQWULEXWH,3'RUFRPSOHWHGSDSHUV

'$7$&2//(&7,21$1'$1$/<6,6

'DWDFROOHFWLRQDQGDQDO\VLV

6HOHFWLRQRIVWXGLHV

7ZRLQGHSHQGHQWUHYLHZDXWKRUV8576H[WUDFWHGWKHGDWD7KH\DVVHVVHGWLWOHNH\ZRUGVDQGDEVWUDFWVRIDOO

VWXGLHVUHWULHYHGZLWKWKHVHDUFKVWUDWHJ\GHVFULEHGDERYH,IEDVHGRQWKLVLQIRUPDWLRQWKHDXWKRUVEHOLHYHG
VWXGLHVPHWWKHGHILQHGLQFOXVLRQFULWHULDWKH\UHWULHYHGDQGIXUWKHUDVVHVVHGWKHIXOOWH[WDQGPDGHDILQDOGHFLVLRQ
RQZKHWKHUWRLQFOXGHDWULDO$UELWUDWLRQRIDWKLUGDXWKRUZKLFKZDVIRUHVHHQLQFDVHVZKHUHRQHDXWKRUEHOLHYHGD
VSHFLILFWULDOPHWWKHLQFOXVLRQFULWHULDIRUWKHUHYLHZZKHUHDVWKHRWKHUDXWKRUGLGQRWZDVQRWUHTXLUHG

'DWDH[WUDFWLRQDQGPDQDJHPHQW

7KHUHYLHZDXWKRUVXVHGDVWDQGDUGL]HGGDWDH[WUDFWLRQIRUPWRFRPSLOHDQGGRFXPHQWUHOHYDQWIDFWVRQJHQHUDO
WULDOFKDUDFWHULVWLFVWULDOTXDOLW\SDWLHQWV
FKDUDFWHULVWLFVLQWHUYHQWLRQVDQGRXWFRPHVDVVSHFLILHGDERYH7KLVGDWD
H[WUDFWLRQZDVSHUIRUPHGLQGHSHQGHQWO\7KHGDWDH[WUDFWLRQIRUPFRPSLOHGWKHIROORZLQJLWHPV
*HQHUDOLQIRUPDWLRQRQWKHWULDOWLWOHDXWKRUVFRQWDFWDGGUHVVIXQGLQJVRXUFHVODQJXDJHSXEOLFDWLRQVWDWXV\HDU
RISXEOLFDWLRQSODFHVDQG\HDUVRIWULDOFRQGXFWLRQ
7ULDOGHVLJQLVVXHVLQFOXVLRQDQGH[FOXVLRQFULWHULDUDQGRPL]DWLRQTXDVLUDQGRPL]DWLRQFRQFHDOPHQWRIWUHDWPHQW
DOORFDWLRQDGHTXDWHXQFOHDULQDGHTXDWHQRWXVHGOHQJWKRIWULDOIROORZXSSHULRG
%DVHOLQHFKDUDFWHULVWLFVRISDUWLFLSDQWVVL]HRILQWHUYHQWLRQDQGFRPSDULVRQJURXSDQGIRUHDFKJURXSWKH
GLVWULEXWLRQRIDJHVH[FRPRUELGLW\PHDVXUHGLIJLYHQDV:RUOG+HDOWK2UJDQL]DWLRQ:+2SHUIRUPDQFHVWDWXV
RU$PHULFDQ6RFLHW\RI$QHVWKHVLRORJLVWV$6$FODVVLILFDWLRQWXPRUORFDWLRQHVRSKDJXVJDVWURHVRSKDJHDO
MXQFWLRQVWRPDFKDQGWXPRUVWDJH710DQG8,&&VWDJH
&KDUDFWHULVWLFVRIWKHLQWHUYHQWLRQXVHGFKHPRWKHUDSHXWLFDQWLQHRSODVWLFGUXJVUHJLPHQVIUHTXHQF\RI
FKHPRWKHUDS\WLPLQJLQUHODWLRQWRWKHGDWHRIVXUJHU\DSSOLFDWLRQPRGHFXPXODWLYHGRVHRIFKHPRWKHUDS\
SODQQHGDQGDGPLQLVWHUHGERWKSUHDQGSRVWRSHUDWLYHO\
)UHTXHQF\RIGLIIHUHQWW\SHVRIVXUJHU\DSSURDFKH[WHQWSHUIRUPHGLQWKHLQWHUYHQWLRQDQGFRQWUROJURXSV
/RVVWRIROORZXSLQHDFKJURXS
2XWFRPHVLQHDFKJURXSKD]DUGUDWLRV+5VDQGFRQILGHQFHLQWHUYDOV&,VERWKIRURYHUDOODQGLIDYDLODEOH
GLVHDVHIUHHVXUYLYDOQXPEHURIHYHQWVGHDWKGLVHDVHUHFXUUHQFHLI+5VDUHQRWJLYHQQXPEHURIUHVHFWLRQV
ZLWKWXPRUIUHHPDUJLQVWXPRUVWDJHDWUHVHFWLRQ710DQG8,&&VWDJHWR[LFLW\DFFRUGLQJWR&7&$(QXPEHURI
JUDGHDGYHUVHHYHQWVKRVSLWDOPRUWDOLW\PRUELGLW\DVWKHQXPEHURIWKHIROORZLQJHYHQWVFRPELQHG
DQDVWRPRWLFOHDNDJHSRVWRSHUDWLYHSQHXPRQLDSRVWRSHUDWLYHZRXQGLQIHFWLRQ
:HSLORWWHVWHGWKHGDWDH[WUDFWLRQIRUPRQILYHUHWULHYHGVWXGLHVDQGVOLJKWO\UHYLVHGLW7ZRDXWKRUV8576
SHUIRUPHGGDWDH[WUDFWLRQLQGHSHQGHQWO\&RQVXOWDWLRQRIDWKLUGDXWKRUIRUDUELWUDWLRQZKLFKZDVIRUHVHHQIRU
FDVHVZKHUHQRFRQVHQVXVFRXOGEHUHDFKHGZDVQRWUHTXLUHG

,QGLYLGXDOSDWLHQWGDWD,3'

'DWDUHTXHVWV

)RUHDFKWULDOZHUHTXHVWHG,3'IURPWKHUHVSHFWLYHWULDOLVWV7KHVROLFLWHGYDULDEOHVZHUHDVIROORZV
DJHDWUDQGRPL]DWLRQ
VH[
KLVWRORJLFDOW\SH
DOORFDWHGWUHDWPHQWDUPLQWHUYHQWLRQFRQWURO
GDWHRIUDQGRPL]DWLRQ
FRPRUELGLW\:+2(&2*SHUIRUPDQFHVWDWXV
VLWHRIWXPRUHVRSKDJXV*(MXQFWLRQVWRPDFK
SUHWUHDWPHQWWXPRUVWDJH7107VWDJH
SUHWUHDWPHQWQRGDOVWDJH7101VWDJH
FKHPRWKHUDS\UHJLPHQUHFHLYHGSURWRFRODOWHUQDWLYHQRQH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
GDWHRIVXUJHU\
VXUJLFDODSSURDFK
H[WHQWRIUHVHFWLRQ
UHDVRQVQRVXUJHU\XQGHUWDNHQ
SRVWRSHUDWLYHGHDWK
QRQIDWDOSRVWRSHUDWLYHFRPSOLFDWLRQVW\SH
WR[LFLW\RISUHRSHUDWLYHWUHDWPHQWW\SHJUDGH
WXPRUVWDJHDWUHVHFWLRQ710\7VWDJH
QRGDOVWDWXVDWUHVHFWLRQ710\1VWDJH
GDWHRIGHDWKRUODVWYLVLW
YLWDOVWDWXV
FDXVHRIGHDWK
GDWHRIILUVWUHFXUUHQFH
GDWHRISURJUHVVLRQ
QDWXUHRIILUVWIDLOXUHUHFXUUHQFH
ORVWWRIROORZXS\HVQR
:HUHTXHVWHGGDWDIRUDOOUDQGRPL]HGSDWLHQWVLQWKHWULDOLQWHQWLRQWRWUHDWSRSXODWLRQ:HVROLFLWHGWULDOLVWVWR
SURYLGHWKHPRVWFRPSOHWHDQGXSGDWHGIROORZXSGDWDZKLFKZHUHDYDLODEOHHYHQLIWKHIROORZXSZDVORQJHUWKDQ
WKDWXVHGIRUWKHSHUWLQHQWSXEOLFDWLRQ:HHQWHUHGGDWDLQDGHGLFDWHGGDWDEDVH

4XDOLW\FRQWURO

:HDVVHVVHGWKHTXDOLW\RIWKHVXEPLWWHG,3'IURPWKHVLQJOHWULDOVLQVHYHUDOZD\V
:HFRPSDUHGWKHQXPEHURILQGLYLGXDOSDWLHQWGDWDVHWVZLWKWKHLQWHQWLRQWRWUHDWSRSXODWLRQUHSRUWHGLQ
SXEOLFDWLRQV:HVFUHHQHGGDWDVHWVIRUREYLRXVGXSOLFDWHVRURPLVVLRQVHJE\FKHFNLQJSDWLHQW,'V
:HFKHFNHGSODXVLELOLW\RIWKHYDOXHVVXSSOLHGIRUHDFKYDULDEOHE\ORRNLQJIRUH[WUHPHRXWOLHUV
:HFRPSDUHGVXPPDU\PHDVXUHVFDOFXODWHGIURPWKHGDWDVHWZLWKGDWDUHSRUWHGLQSXEOLFDWLRQV
:HGHULYHGRYHUDOOVXUYLYDODQGGLVHDVHIUHHVXUYLYDORIWKHGLIIHUHQWWUHDWPHQWJURXSVLQHDFKWULDOXVLQJWKH
.DSODQ0HLHUPHWKRGDQGVWDQGDUG&R[UHJUHVVLRQDQDO\VLVDQGFRPSDUHGZLWKSXEOLVKHGVXUYLYDOHVWLPDWHV
:HFKHFNHGFRPSOHWHQHVVDQGHTXDOLW\RIIROORZXSLQWKHWZRWULDODUPVE\SORWWLQJD
UHYHUVH
.DSODQ0HLHUFXUYH
FRQVLGHULQJFHQVRUHGSDWLHQWVDVSDWLHQWVZKRLQFXUUHGWKHRXWFRPH6WHZDUW,QDGGLWLRQIRUWKH
UHYHUVH

.DSODQ0HLHUFXUYHVZHHYDOXDWHGWKHPHGLDQIROORZXSWLPH
:HDWWHPSWHGWRFODULI\DQGVROYHDQ\GHWHFWHGLQFRQVLVWHQFLHVZLWKWKHUHVSHFWLYHWULDOLVWV

$VVHVVPHQWRIULVNRIELDVLQLQFOXGHGVWXGLHV

%RWKLQGHSHQGHQWUHYLHZDXWKRUVDVVHVVHGWULDOTXDOLW\ZLWKUHJDUGWRELDVLQWKHGRPDLQVVHOHFWLRQELDV
SHUIRUPDQFHELDVGHWHFWLRQELDVDWWULWLRQELDVUHSRUWLQJELDVDQGRWKHUELDV7KHDVVHVVLQJDXWKRUVWDWHGWKH
OHYHORIELDV
ORZ

KLJK

XQFOHDU
WKDWZDVDVVXPHGIRUHDFKLWHP%DVHGRQWKLVDVVHVVPHQWWKHDXWKRUDVVLJQHG
DQRYHUDOOOHYHORIULVNRIH[LVWLQJELDVWRHDFKWULDO
ORZ
LI
ORZ
ELDVZDVDVVXPHGIRUDOOLWHPV
PRGHUDWH
LI
KLJK

RU
XQFOHDU
ELDVZDVDVVXPHGIRURQHRUWZRLWHPV
KLJK
LI
KLJK
RU
XQFOHDU
ELDVZDVDVVXPHGIRUDWOHDVWWKUHH
LWHPV:HXVHGWKLVELDVOHYHODVDPHDVXUHPHQWRIWKHTXDOLW\RIHDFKWULDOLQVHQVLWLYLW\DQGVXEJURXSDQDO\VHV
VHHEHORZ,QFDVHVZKHUHWKHWZRUHYLHZDXWKRUVFDPHWRGLIIHUHQWFRQFOXVLRQVUHJDUGLQJWKHULVNRIELDVLQWKH
VLQJOHGRPDLQVDWKLUGDXWKRUDFWHGDVDQDUELWHUDQGDFRQVHQVXVZDVUHDFKHG6WDWHPHQWVHJTXRWDWLRQVIURP
SXEOLFDWLRQVVXSSRUWLQJWKHMXGJPHQWRIWKHDXWKRUVZHUHWREHJLYHQDQGSUHVHQWHGLQD
5LVNRIELDV
WDEOHIRU
HDFKWULDO

0HDVXUHVRIWUHDWPHQWHIIHFW

:HPHDVXUHGWKHHIIHFWRIWKHLQWHUYHQWLRQRQRYHUDOODQGGLVHDVHIUHHVXUYLYDOZLWKKD]DUGUDWLRV+5,ISRVVLEOH
WKH+5ZDVEDVHGRQ,3',I,3'ZHUHQRWDYDLODEOHZHFDOFXODWHGWKH+5LIURPWKHSXEOLVKHGUHSRUWVXVLQJ
PHWKRGVGHVFULEHGLQ3DUPDUHWDO3DUPDUDQG7LHUQH\HWDO7LHUQH\LLIURPELQDU\PRUWDOLW\
GDWD)RUWKHODWWHUPHWKRGDUHODWLYHULVNEDVHGRQYLWDOVWDWXVDOLYHRUGHFHDVHGDWWKHHQGRIIROORZXSDQG
VDPSOHVL]HVZDVFDOFXODWHGDQGLPSXWHGLQWKHFRUUHVSRQGLQJVHFWLRQLQ5HY0DQ:KHUHLWZDVIHDVLEOHZHXVHG
YDULRXVPHWKRGVWRLQGLUHFWO\HVWLPDWHWKHWULDO+5WRFKHFNLWVUHOLDELOLW\
)RUHDFKWULDOZHHVWLPDWHGORJ+5VDQGWKHVWDQGDUGHUURUVRIORJ+5XVLQJWKHIROORZLQJPHWKRGVEDVHGRQWKRVH
UHSRUWHGE\3DUPDU7LHUQH\DQG:LOOLDPVRQ3DUPDU7LHUQH\:LOOLDPVRQOLVWHGLQRUGHURI

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
SUHIHUHQFH
+5DQGFRQILGHQFHLQWHUYDOFDOFXODWHGGLUHFWO\IURP,3'
2(DQGYDULDQFHRIWKHORJKD]DUGUDWLRORJKD]DUGUDWLRDQGLWVVWDQGDUGHUURUHVWLPDWHGGLUHFWO\
+5UHSRUWHGZLWKFRQILGHQFHLQWHUYDORUORJUDQN3YDOXHVWDQGDUGHUURUHVWLPDWHGIURPFRQILGHQFHLQWHUYDORU3
YDOXHFRQILGHQFHLQWHUYDOXVHGLIERWKDYDLODEOH7KLVLVWKHSUHIHUUHGLQGLUHFWPHWKRGVLQFHWKH+5LVGLUHFWO\
H[WUDFWHGDQGWKHVWDQGDUGHUURULVHVWLPDWHGYHU\DFFXUDWHO\
$GMXVWHG+5UHSRUWHGZLWKFRQILGHQFHLQWHUYDORU&R[SURSRUWLRQDOKD]DUGV3YDOXHVWDQGDUGHUURUHVWLPDWHGIURP
FRQILGHQFHLQWHUYDORU3YDOXHFRQILGHQFHLQWHUYDOXVHGLIERWKDYDLODEOH7KLVZLOOJHQHUDOO\JLYHDQHVWLPDWHFORVH
WRWKHXQDGMXVWHG+5EXWGLIIHUHQWVWXGLHVDGMXVWIRUGLIIHUHQWIDFWRUVDQGWKHFKRLFHRIDGMXVWPHQWIDFWRUVFRXOG
EHGDWDGULYHQOHDGLQJWRELDV
1XPEHUVRIHYHQWVUHSRUWHGZLWKORJUDQN3YDOXH+5HVWLPDWHGIURPQXPEHUVRIHYHQWVVWDQGDUGHUURU
HVWLPDWHGIURPWKLVHVWLPDWHG+5DQG3YDOXH7KLVJLYHVDLQGLUHFWHVWLPDWHRIWKH+5VLQFHDOOHYHQWVDUH
FRQVLGHUHGEXWPD\QRWEHFORVHWRWKHDFWXDO+5SDUWLFXODUO\LIWKHKD]DUGVDUHQRWSURSRUWLRQDO
.DSODQ0HLHUVXUYLYDOFXUYH
$FWXDULDOUDWHVDWIL[HGIROORZXSDQGORJUDQN3YDOXH7KLVJLYHVDQHVWLPDWHRIWKH+5VLPLODUWRWKDWRIPHWKRG
EXWRQO\HYHQWVXSWRWKHIL[HGIROORZXSWLPHDUHFRQVLGHUHG
)RUWKHHIIHFWRIWKHLQWHUYHQWLRQRQGLVHDVHIUHHVXUYLYDOZHFDOFXODWHGWKH+5VXVLQJWKHVHPHWKRGVLQWKHLUOLVWHG
RUGHURISUHIHUHQFHEXWIRUDODQGPDUNWLPHRIVL[PRQWKVDIWHUGDWHRIUDQGRPL]DWLRQIRUGHWDLOVVHH'DWD
V\QWKHVLV7KLVODQGPDUNDQDO\VLVDFFRXQWVIRUWKHGLIIHUHQFHLQWKHWLPLQJRIVXUJHU\EHWZHHQWKHWZRWUHDWPHQW
JURXSV
:HPHDVXUHGWKHLQWHUYHQWLRQ
VHIIHFWRQWKHSUHVHQFHRIWXPRUIUHHUHVHFWLRQPDUJLQVDELQDU\RXWFRPHZLWKDQ
RGGVUDWLR25:HWUHDWHGWXPRUVWDJHXSRQUHVHFWLRQDVELQDU\GDWDE\GLFKRWRPL]LQJ7VWDJHYHUVXV
DQG1VWDJHYHUVXVDQGFDOFXODWLQJ25V:HPHDVXUHGWKHLQWHUYHQWLRQ
VWR[LFLW\E\WKHWRWDOQXPEHURI
&7&$(JUDGHDGYHUVHHYHQWVDVZHOODVRIWKHVLQJOHHYHQWV:HFRPSDUHGSRVWRSHUDWLYHPRUWDOLW\DVZHOODV
SRVWRSHUDWLYHPRUELGLW\PHDVXUHGDVWKHQXPEHURIHYHQWVVSHFLILHGDERYHE\FDOFXODWLQJULVNGLIIHUHQFHV

'HDOLQJZLWKPLVVLQJGDWD

:HSHUIRUPHGDQDO\VHVZLWKWKHUHVXOWVRIWKHLQWHQWLRQWRWUHDWDQDO\VLVLISURYLGHGLQWKHVLQJOHVWXGLHV)RU
PLVVLQJGDWDZHWULHGWRFRQWDFWWKHDXWKRUVRIWKHVLQJOHVWXGLHVDQGDVNHGWKHPIRUWKHVSHFLILFYDOXHV
2XUGDWDEDVHZDVFORVHGRQ0D\$Q\GDWDQRWDYDLODEOHDWWKDWGDWHHLWKHUEHFDXVHLWZDVQRWSURYLGHG
E\WKHWULDOLVWVDV,3'RUEHFDXVHUHVXOWVRIWKHUHVSHFWLYHWULDOKDGQRWEHHQSXEOLVKHGDVIXOOPDQXVFULSWVZHUHQRW
LQFOXGHGLQRXUDQDO\VHV

$VVHVVPHQWRIKHWHURJHQHLW\

:HDVVHVVHGKHWHURJHQHLW\FOLQLFDOO\E\WKHMXGJPHQWRIWKHWZRLQGHSHQGHQWUHYLHZDXWKRUVDVZHOODVWKURXJK

WKHFDOFXODWLRQRIDQ,ðVWDWLVWLFZKLFKLVDPHDVXUHIRUWKHSHUFHQWDJHRIWKHYDULDELOLW\LQHIIHFWHVWLPDWHV
DWWULEXWHGWRKHWHURJHQHLW\UDWKHUWKDQVDPSOLQJHUURU,IKHWHURJHQHLW\EHWZHHQWKHHIIHFWVIRXQGLQVLQJOHWULDOV
ZDVVKRZQWREHWRRODUJHLHUHOHYDQWFOLQLFDOGLIIHUHQFHVRUDQ,ðRIDERYHZHGLGQRWGRDSRROHGDQDO\VLV
LQFOXGLQJDOOWULDOV

$VVHVVPHQWRIUHSRUWLQJELDVHV

7RDVVHVVSRVVLEOHSXEOLFDWLRQELDVLIWKHQXPEHURILQFOXGHGVWXGLHVZDVVXIILFLHQWZHFUHDWHGDIXQQHOSORWXVLQJ
WKHGLIIHUHQWRXWFRPHVDQGHYDOXDWHGIXQQHODV\PPHWU\ZLWK%HJJ
VDQG(JJHU
VWHVWV%HJJ(JJHU
ZLWKUHVSHFWWRFRQWLQXRXVGDWDRU3HWHUV
WHVW3HWHUVZLWKUHVSHFWWRELQDU\GDWD

'DWDV\QWKHVLV

)RUDOORXWFRPHVZHFRPELQHG,3'DQGDJJUHJDWHGDWDDFFRUGLQJWRDYDLODELOLW\IURPWKHVLQJOHVWXGLHVXVLQJWKH
WZRVWDJHPHWKRG5LOH\7KLVLPSOLHVWKDWIURPWKRVHVWXGLHVIRUZKLFK,3'ZHUHDYDLODEOHZHFDOFXODWHG
WKHRXWFRPHPHDVXUHDVGHILQHGDERYHIURPWKHSURYLGHGGDWD)RUVWXGLHVZKHUH,3'ZHUHQRWDYDLODEOHZH
XVHGWKHDJJUHJDWHRXWFRPHPHDVXUHGHULYHGIURPWKHSHUWLQHQWSXEOLFDWLRQ,IIRUDJLYHQRXWFRPHDVXPPDU\
PHDVXUHZDVQRWDYDLODEOHIURPHLWKHU,3'RUSXEOLFDWLRQVWKHUHVSHFWLYHWULDOZDVQRWLQFOXGHGLQWKHDQDO\VLVRI
WKDWHQGSRLQW
:HSHUIRUPHGGDWDV\QWKHVLVZLWKUHVXOWVEDVHGRQLQWHQWLRQWRWUHDWDQDO\VLVLIDYDLODEOHIRUWKHVLQJOHVWXGLHV7KH
HVWLPDWHGORJ+5VZHUHFRPELQHGXVLQJWKHJHQHULFLQYHUVHYDULDQFHPHWKRGWKHUHVXOWRIZKLFKLVSUHVHQWHGDV
SRROHG+5ZLWKFRQILGHQFHLQWHUYDOVRQDORJDULWKPLFVFDOH7KHSRROHG+5UHSUHVHQWVWKHRYHUDOOULVNRIDQ
HYHQWIRUSHULRSHUDWLYHFKHPRWKHUDS\YHUVXVVXUJHU\DORQH:HFDOFXODWHGDEVROXWHHIIHFWVRQVXUYLYDOIURPWKH
SURSRUWLRQRIHYHQWIUHHSDWLHQWVLQWKHFRQWUROJURXSDQGWKHHVWLPDWHG+5H[S>OQSURSRUWLRQHYHQWIUHH[+5@
:HXVHGDUDQGRPHIIHFWVPRGHOIRUDOOPHWDDQDO\VHV7KHXVDJHRIDUDQGRPHIIHFWVPRGHOZDVSUHIHUUHGWRWKDW
RIDIL[HGHIIHFWPRGHOEHFDXVHZHDVVXPHGWKHH[LVWHQFHRIQRQH[SODLQDEOHKHWHURJHQHLW\EHWZHHQWKH
WUXH

HIIHFWVRIWKHGLIIHUHQWWUHDWPHQWUHJLPHQVLPSOLHGLQWKHVWXGLHV+RZHYHUZHUHFDOFXODWHGDOODQDO\VHVZLWKD

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
IL[HGHIIHFWPRGHOLQRUGHUWRGHWHFWSRWHQWLDOGLIIHUHQFHVGXHWRWKHPHWKRGRORJLFDODSSURDFK,QDOOWHVWVRI
VLJQLILFDQFHZHFDOFXODWHGDWZRVLGHG3YDOXH
)RUWKHVHFRQGDU\RXWFRPHGLVHDVHIUHHVXUYLYDOZHRQO\SRROHGWKH+5VRIWKRVHWULDOVZKLFKSURYLGHGGLVHDVH
IUHHVXUYLYDOFDOFXODWHGIURPDODQGPDUNWLPHRIVL[PRQWKVIURPUDQGRPL]DWLRQHLWKHUREWDLQHGE\,3'RUE\
DJJUHJDWHGGDWD,QWKLVDQDO\VLVUHFXUUHQFHORFDODQGGLVWDQWDQGGHDWKRFFXUULQJZLWKLQVL[PRQWKVRI
UDQGRPL]DWLRQZHUHUHJDUGHGDVHYHQWVDWWKLVODQGPDUNWLPHWKXVGHILQLQJWKHUHVSHFWLYHSDWLHQW
VGLVHDVHIUHH
VXUYLYDODV]HUR/LNHZLVHDQDO\]LQJ,3'SDWLHQWVGLVFRYHUHGWREHQHYHUGLVHDVHIUHHGXULQJWKHILUVWVL[PRQWKV
DIWHUUDQGRPL]DWLRQLQFOXGLQJSDWLHQWVZLWK5UHVHFWLRQSDWLHQWVZKRZHUHRSHUDWHGRQZLWKRXWDQ\UHVHFWLRQ
SHUIRUPHGDQGSDWLHQWVZKRZHUHQRWRSHUDWHGZHUHDOVRUHJDUGHGDVHYHQWVDWWKLVODQGPDUNWLPH
,QWKHDQDO\VHVRIWKHVHFRQGDU\RXWFRPHVSRVWRSHUDWLYHPRUELGLW\DQGPRUWDOLW\WKHGHQRPLQDWRULQFOXGHGRQO\
SDWLHQWVZKRXQGHUZHQWVXUJHU\,QWKHDQDO\VHVRIWKHVHFRQGDU\RXWFRPHWXPRUVWDJHDWUHVHFWLRQS7VWDJHDQG
S1VWDJHWKHGHQRPLQDWRUZDVIRUPHGE\WKH,77SRSXODWLRQRIWKHUHVSHFWLYHWULDOVLQRUGHUWRWUHDWSDWLHQWVZKR
ZHUHQRWUHVHFWHGDV
WUHDWPHQWIDLOXUHV
DVWKH\ZHUHDQDO\]HGLQWKHJURXSRIWKHPRUHXQIDYRUDEOHS7DQGS1
VWDJH
:HSHUIRUPHGDQDO\VHVXVLQJ5HYLHZ0DQDJHU5HY0DQ:HXVHGWKHVWDWLVWLFDOVRIWZDUHSDFNDJHV5DQG
6$656$6IRUDGGLWLRQDODQDO\VHVWKDWFRXOGQRWEHGRQHZLWK5HY0DQ

6XEJURXSDQDO\VLVDQGLQYHVWLJDWLRQRIKHWHURJHQHLW\

)RUWKHSULPDU\RXWFRPHZHFRQGXFWHGVXEJURXSDQDO\VHVVWUDWLILHGIRU
WXPRUVLWHHVRSKDJXV*(MXQFWLRQVWRPDFKIRUVWUDWLI\LQJSDWLHQWVDFFRUGLQJWRWXPRUVLWHZHXVHGWKH
GHILQLWLRQIURPWKHVLQJOHWULDOHLWKHUDVYDULDEOHLQ,3'GDWDEDVHVRUIURPDVXEJURXSDQDO\VLVLQWKHUHVSHFWLYH
SXEOLFDWLRQ
VHTXHQFHRISODQQHGSHULRSHUDWLYHWKHUDS\LQWKHLQWHUYHQWLRQDUPSUHRSHUDWLYHRQO\YHUVXVSUHRSHUDWLYHDQG
SRVWRSHUDWLYHFRPELQHG
FKHPRWKHUDSHXWLFDJHQWVXVHGLQSUHRSHUDWLYHFKHPRWKHUDS\SODWLQXPEDVHGQRQDQWKUDF\FOLQHUHJLPHQVYHUVXV
DQWKUDF\FOLQHEDVHGQRQSODWLQXPUHJLPHQVYHUVXVUHJLPHQVFRQWDLQLQJERWKSODWLQXPDQGDQWKUDF\FOLQHYHUVXV
RWKHUUHJLPHQV
UHJLPHQVLQFOXGLQJUDGLRWKHUDS\YHUVXVFKHPRWKHUDS\RQO\VFKHPHV
SHUIRUPDQFHVWDWXV36YHUVXVYHUVXVRUKLJKHU
DJHXSRQUDQGRPL]DWLRQ\HDUVWR\HDUV!\HDUV
VH[PDOHYHUVXVIHPDOH
2WKHUVXEJURXSDQDO\VHVZHUHGHILQHGEDVHGRQH[SORUDWRU\DQDO\VHVRIWKHDYDLODEOHGDWD
)RUWULDOVSHFLILFVXEJURXSDQDO\VHVVXFKDVWKRVHVWUDWLILHGDFFRUGLQJWRVHTXHQFHRISHULRSHUDWLYHWKHUDS\
FKHPRWKHUDSHXWLFDJHQWVDQGUHJLPHQZHFDOFXODWHGSRROHG+5VIRUHYHU\SUHVSHFLILHGWULDOJURXS)RUSDWLHQW
VSHFLILFVXEJURXSDQDO\VHVVXFKDVWKRVHVWUDWLILHGDFFRUGLQJWRSHUIRUPDQFHVWDWXVDJHDQGVH[ZHXQGHUWRRN
&R[UHJUHVVLRQVLQFOXGLQJWKHUHOHYDQWWUHDWPHQWE\VXEJURXSLQWHUDFWLRQWHUPZLWKLQHDFKWULDODQGSRROHGWKH
LQWHUDFWLRQFRHIILFLHQWVDFURVVWULDOV)RUWKLV3:7SRROLQJRIZLWKLQWULDOFRYDULDWHLQWHUDFWLRQVDSSURDFKZH
IROORZHG)LVKHUE\DVVHVVLQJKHWHURJHQHLW\ZLWK,ðVWDWLVWLFVDQGUHSRUWLQJLIWKHIL[HGHIIHFWDQGUDQGRP
HIIHFWVUHVXOWVDUHFRQVLVWHQW
$OOSDWLHQWVZHUHLQFOXGHGLQWKHDQDO\VHVDVRULJLQDOO\UDQGRPL]HGLQWKHUHVSHFWLYHWULDOLHDFFRUGLQJWRWKH
LQWHQWLRQWRWUHDWSULQFLSOHUHJDUGOHVVRIZKHWKHUWKH\ZHUHDQDO\]HGLQWKHWULDOSXEOLFDWLRQ,QFDVHVZKHUH
VSHFLILFGDWDZHUHPLVVLQJWKHUHVSHFWLYHSDWLHQWVZHUHH[FOXGHGIURPWKHDQDO\VLV

,QYHVWLJDWLRQRILPSRUWDQWFRYDULDWHV

,QDVHFRQGVWHSZHFRPELQHGGDWDIURPDOOWULDOVSURYLGLQJ,3'IRUWKHSULPDU\RXWFRPH
RYHUDOOVXUYLYDO
LQD&R[
SURSRUWLRQDOKD]DUGVPRGHOIRUFOXVWHUHGGDWD:HXVHGDVKDUHGIUDLOW\PRGHOIRULQFRUSRUDWLQJWKHWULDOZKLFK
UHSUHVHQWVDFOXVWHUDVUDQGRPHIIHFWV%\WKLVZHH[DPLQHGKRZWKHDVVRFLDWLRQRIWUHDWPHQWZLWKVXUYLYDOZDV
DOWHUHGZKHQFRYDULDWHVZHUHDFFRXQWHGIRU7KHFRYDULDWHVDFFRXQWHGIRUZHUHWUHDWHGDVIL[HGHIIHFWWKHWULDODV
UDQGRPHIIHFWV7KHIROORZLQJFRYDULDWHVZHUHFRQVLGHUHG
WUHDWPHQWFKHPRWKHUDS\RQO\FKHPRUDGLRWKHUDS\VXUJHU\DORQH
WXPRUVLWHHVRSKDJXV*(MXQFWLRQVWRPDFK
7VWDJHYHUVXV
1VWDJHYHUVXV
SHUIRUPDQFHVWDWXV36YHUVXVRUKLJKHU
DJHXSRQUDQGRPL]DWLRQDVFRQWLQXRXVYDULDEOH
VH[

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
6HQVLWLYLW\DQDO\VLV

)RUDOORXWFRPHVZHFRQGXFWHGVHQVLWLYLW\DQDO\VHVEDVHGRQWKHULVNRIELDVDVVLJQHGWRVWXGLHVDVGHVFULEHGLQ
$VVHVVPHQWRIULVNRIELDVLQLQFOXGHGVWXGLHVORZPRGHUDWHKLJK)XUWKHUPRUHZHFRPSDUHGUHVXOWVIURP
DJJUHJDWHGDWDIRUWKHSULPDU\HQGSRLQWDQGWKHVHFRQGDU\HQGSRLQWGLVHDVHIUHHVXUYLYDOZLWKUHVXOWVIURPSRROHG
,3'3LJQRQ

0(7+ 2'2/2*,&$/48$/,7<

5(6 8/76

5HVXOWV

'HVFULSWLRQRIVWXGLHV

5HVXOWVRIWKHVHDUFK

$IWHUH[FOXGLQJGXSOLFDWHVWKHSUHVSHFLILHGHOHFWURQLFVHDUFKRIOLWHUDWXUHGDWDEDVHV\LHOGHGUHVXOWV$Q
DGGLWLRQDOWZRWULDOVIRUZKLFKILQDOHIILFDF\UHVXOWVZHUHDOUHDG\DYDLODEOHZHUHLGHQWLILHGE\PDQXDOVHDUFKHVLQ
FRQIHUHQFHSURFHHGLQJVDQGUHIHUHQFHOLVWV)XOOSDSHUVRIWKHVHWULDOV$&&25'(257&
ZHUHSXEOLVKHGDIWHURXUHOHFWURQLFVHDUFKZDVFRQGXFWHGEXWEHIRUHRXUGDWDEDVHZDVFORVHGIRUDQDO\VLV
7KHH[WHQVLRQRIWKHVHDUFKXQWLOWKHFORVXUHGDWHRIRXUGDWDEDVH0D\VHH(OHFWURQLFVHDUFKHV\LHOGHG
UHVXOWVDIWHUH[FOXVLRQRIGXSOLFDWHV1RQHRIWKHVHZHUHLQFOXGHGLQRXUDQDO\VLV2QHWULDOLQFOXGHGRQO\RQH
SDWLHQWZLWKDGHQRFDUFLQRPDDQGZDVSXEOLVKHGRQO\DVFRQIHUHQFHDEVWUDFW2QHDEVWUDFWZDVDGXSOLFDWHRIDIXOO\
SXEOLVKHGVWXG\LQFOXGHGLQRXUDQDO\VLV:DOVK:HDVVHVVHGWKHIXOOWH[WSDSHURIRQHWULDO,WVKRZHGWKDW
WKLVWULDOIRUPDOO\PHWRXULQFOXVLRQFULWHULD+RZHYHUVLQFHSDWLHQWVUHFHLYHGFKHPRWKHUDS\IRUDYHU\VKRUWSHULRG
LPPHGLDWHO\SULRUWRVXUJHU\VWDUWLQJDQGKRXUVDQGILQLVKLQJDQGKRXUVEHIRUHVXUJHU\
UHVSHFWLYHO\ZHGHFLGHGQRWWRLQFOXGHWKLVWULDOLQRXUDQDO\VLVDVVXFKDQXQFRQYHQWLRQDOVFKHPHLVKLJKO\
GRXEWIXOWRLQIOXHQFHRXUSULPDU\RXWFRPHRYHUDOOVXUYLYDO7ZRRWKHUWULDOVZHUHQRWLQFOXGHGEHFDXVHWKHIXOOWH[W
SXEOLFDWLRQVZHUHHLWKHUXQDYDLODEOHRUDYDLODEOHRQO\LQ&KLQHVHIRUZKLFKDSRVVLELOLW\RIWUDQVODWLRQZDVQRW
DYDLODEOHDWWKHWLPHRIWKHOLWHUDWXUHVHDUFKDQGEHFDXVHIURPWKHDEVWUDFWVLWUHPDLQHGXQFOHDULIWKHWULDOV
LQFOXGHGDQ\SDWLHQWVZLWKDGHQRFDUFLQRPD2QHWULDOZDVQRWLQFOXGHGLQRXUDQDO\VLVDVLWZDVRQO\DYDLODEOHDVD
FRQIHUHQFHDEVWUDFWDQGEHFDXVHLWLQFOXGHGRQO\VHYHQSDWLHQWVZLWKDGHQRFDUFLQRPDVHH&KDUDFWHULVWLFVRI
H[FOXGHGVWXGLHV
$VXPPDU\RIDOOVHDUFKHGLQFOXGHGDQGH[FOXGHGVWXGLHV35,60$GLDJUDPLVJLYHQLQ

,QFOXGHGVWXGLHV

)URPWKHVHDUFKUHVXOWVZHLGHQWLILHG5&7VWRWDOQXPEHURISDWLHQWVLQ,77SRSXODWLRQVDQDO\]HGIRURYHUDOO
VXUYLYDOQ PHHWLQJRXULQFOXVLRQFULWHULD$&&25'&$/*%(257&
)$07;)HQJ.RED\DVKL0$*,&2(572*752*$*,7*
8UED:DOVK:DQJ=KDR)LYHRIWKHWULDOVWRWDOQ LQFOXGHGERWKSDWLHQWVZLWK
DGHQRFDUFLQRPDDQGVTXDPRXVFHOOFDUFLQRPDRIWKHHVRSKDJXV&$/*%2(572*
752*$*,7*8UED7KHVHWULDOVFRPSULVHGQ SDWLHQWVZLWKVTXDPRXVFHOOFDUFLQRPD
DQGQ SDWLHQWVZLWKDGHQRFDUFLQRPD7KXVWKHWRWDOQXPEHURISDWLHQWVZLWKDGHQRFDUFLQRPDLQDOOLQFOXGHG
WULDOVZDVQ 2QHWULDOZDVDWKUHHDUPHG5&7FRPSDULQJWZRGLIIHUHQWSUHRSHUDWLYHFKHPRWKHUDS\
UHJLPHQVZLWKRQHFRQWUROJURXSQRWUHFHLYLQJFKHPRWKHUDS\=KDR)RUWKLVWULDOWRWDOQ ZH
FRPELQHGWKHFKHPRWKHUDS\WUHDWPHQWDUPVLQWRRQHQ DQGFRPSDUHGWKLVFRPELQHGWUHDWPHQWDUPWRWKH
FRQWUROJURXSQ &RQVHTXHQWO\RXUILQDODQDO\VLVZDVEDVHGRQGDWDIURPQ SDWLHQWV7KHLQFOXGHG
5&7VZHUHFDUULHGRXWEHWZHHQILUVWSDWLHQWUDQGRPL]HGDQGODVWSDWLHQWUDQGRPL]HG7KHQXPEHURI
LQFOXGHGSDWLHQWVSHUWULDOUDQJHVIURP&$/*%WR2($FURVVDOOLQFOXGHGWULDOV
SDWLHQWVZLWKDGHQRFDUFLQRPDKDGRULJLQDOO\EHHQUDQGRPL]HGRXWRIZKLFKDQGDQXQNQRZQQXPEHUIURP
2(FRXOGQRWEHLQFOXGHGLQRXUPHWDDQDO\VLVHLWKHUEHFDXVHWKH\ZHUHQRWLQFOXGHGLQWKHWULDODQDO\VLV
SUHVHQWHGLQWKHUHVSHFWLYHSXEOLFDWLRQRUEHFDXVHWKH\ZHUHQRWFRQWDLQHGLQWKHSURYLGHG,3'GDWDVHWVIRU
GHWDLOVVHH&KDUDFWHULVWLFVRILQFOXGHGVWXGLHV
)RUDOOWULDOVGDWDRQWKHSULPDU\RXWFRPHRYHUDOOVXUYLYDOZHUHDYDLODEOHHLWKHUDV+5VFDOFXODWHGIURPLQGLYLGXDO
SDWLHQWGDWD,3'SURYLGHGE\WKHLQYHVWLJDWRUVHLJKWWULDOVQ SDWLHQWVDV+5VLQGLUHFWO\HVWLPDWHGIURP
DJJUHJDWHGDWDSUHVHQWHGLQWKHRULJLQDOSXEOLFDWLRQVWKUHHWULDOVQ SDWLHQWVDV+5VHVWLPDWHGIURP
.DSODQ0HLHUVXUYLYDOFXUYHVRQHWULDOQ SDWLHQWVRUDV+5VHVWLPDWHGIURPELQDU\PRUWDOLW\GDWDWZR
WULDOVQ SDWLHQWVFRPSDUH0HWKRGV)RUIRXUWULDOVLQFOXGLQJSDWLHQWVZLWKERWKDGHQRFDUFLQRPDDQG
VTXDPRXVFHOOFDUFLQRPD&$/*%572*752*$*,7*8UED+5VIRUWKH
SULPDU\RXWFRPHZHUHFDOFXODWHGIRUSDWLHQWVZLWKDGHQRFDUFLQRPDEDVHGRQ,3')RUVRPHVHFRQGDU\RXWFRPHV
GDWDZHUHQRWDYDLODEOHIURPDOOLQFOXGHGVWXGLHV7KXVUHVSHFWLYHDQDO\VHVDUHEDVHGRQDVPDOOHUQXPEHURI
VWXGLHVVHH(IIHFWVRILQWHUYHQWLRQV

([FOXGHGVWXGLHV

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
0DULHWWHDQGYDQ+DJHQZHUHSXEOLVKHGDIWHUFORVXUHRIRXUGDWDEDVHDQGZHUHQRWLQFOXGHG

5LVNRIELDVLQLQFOXGHGVWXGLHV

4XDOLW\RIVLQJOHVWXGLHV

5LVNRIELDVZDVORZLQWKUHHVWXGLHVPRGHUDWHLQVHYHQVWXGLHVDQGKLJKLQIRXUVWXGLHVVHHDQG

,3'TXDOLW\

1XPEHURISDWLHQWVLQ,3'GDWDVHWVFRPSDUHGZLWKWKHLQWHQWLRQWRWUHDWSRSXODWLRQUHSRUWHGLQSXEOLFDWLRQV
7KHQXPEHURISDWLHQWVFRQWDLQHGLQ,3'GDWDVHWVZHUHLQDOOEXWRQHWULDOLGHQWLFDOZLWKWKHLQWHQWLRQWRWUHDW
SRSXODWLRQUHSRUWHGLQWKHFRUUHVSRQGLQJSXEOLFDWLRQV2QO\LQWKHGDWDVHWEHORQJLQJWR8UEDZDVWKHUHRQH
DGGLWLRQDOSDWLHQWLQWKHVXUJHU\DORQHWUHDWPHQWJURXS7KHILUVWDXWKRURI8UEDFODULILHGWKLVDVDFRGLQJHUURU
LQWKHGDWDVHWWKHSXEOLFDWLRQZDVEDVHGRQ
([WUHPHRXWOLHUV"
:HFRXOGQRWLGHQWLI\DQ\H[WUHPHDQGLPSODXVLEOHRXWOLHUVLQWKH,3'SURYLGHG
$Q\GHYLDWLRQVLQVXPPDU\PHDVXUHVFDOFXODWHGIURP,3'FRPSDUHGZLWKGDWDUHSRUWHGLQSXEOLFDWLRQV
:HFRPSDUHGWKHQXPEHURISDWLHQWVLQWKHGLIIHUHQWVWUDWDRIWXPRUVLWHUHVHFWLRQPDUJLQ7VWDJH1VWDJH
SHUIRUPDQFHVWDWXVPHGLDQRUPHDQDJHDJHUDQJHDQGVH[EHWZHHQ,3'DQGSXEOLVKHGGDWDIRUWKHVLQJOH
VWXGLHV
8UED,QWKHSXEOLFDWLRQGDWDZHUHRQO\SUHVHQWHGIRUWKHZKROHWULDOSRSXODWLRQSDWLHQWVZLWKERWK
VTXDPRXVFHOOFDUFLQRPDDQGDGHQRFDUFLQRPDQRVHSDUDWHGDWDZHUHDYDLODEOHIRUSDWLHQWVZLWKDGHQRFDUFLQRPD
:DOVK,QWKH,3'SDWLHQWVLQWKHSHULRSHUDWLYHFKHPRDQGSDWLHQWVLQWKHVXUJHU\DORQHJURXSKDG
QRGDOPHWDVWDVLVLQWKHSXEOLFDWLRQSDWLHQWVLQWKHSHULRSHUDWLYHFKHPRDQGSDWLHQWVLQWKHVXUJHU\DORQH
JURXSKDGQRGDOPHWDVWDVLV
)$07;,QWKH,3'SDWLHQWVLQWKHSHULRSHUDWLYHFKHPRDQGSDWLHQWVLQWKHVXUJHU\DORQHJURXSKDG5
UHVHFWLRQLQWKHSXEOLFDWLRQSDWLHQWVLQWKHSHULRSHUDWLYHFKHPRDQGSDWLHQWVLQWKHVXUJHU\DORQHJURXSKDG
5UHVHFWLRQ
752*$*,7*,QWKHSXEOLFDWLRQGDWDZHUHRQO\SUHVHQWHGIRUWKHZKROHWULDOSRSXODWLRQSDWLHQWVZLWKERWK
VTXDPRXVFHOOFDUFLQRPDDQGDGHQRFDUFLQRPDQRVHSDUDWHGDWDZHUHDYDLODEOHIRUSDWLHQWVZLWKDGHQRFDUFLQRPD
572*,QWKHSXEOLFDWLRQGDWDZHUHRQO\SUHVHQWHGIRUWKHZKROHWULDOSRSXODWLRQSDWLHQWVZLWKERWK
VTXDPRXVFHOOFDUFLQRPDDQGDGHQRFDUFLQRPDQRVHSDUDWHGDWDZHUHDYDLODEOHIRUSDWLHQWVZLWKDGHQRFDUFLQRPD
&$/*%,QWKHSXEOLFDWLRQGDWDZHUHRQO\SUHVHQWHGIRUWKHZKROHWULDOSRSXODWLRQSDWLHQWVZLWKERWK
VTXDPRXVFHOOFDUFLQRPDDQGDGHQRFDUFLQRPDQRVHSDUDWHGDWDZHUHDYDLODEOHIRUSDWLHQWVZLWKDGHQRFDUFLQRPD
(257&1RGLIIHUHQFHVEHWZHHQ,3'DQGSXEOLVKHGGDWD
$&&25'1RGLIIHUHQFHEHWZHHQ,3'DQGSXEOLVKHGGDWDZLWKUHVSHFWWRWXPRUVLWHUHVHFWLRQPDUJLQ
SHUIRUPDQFHVWDWXVPHDQDJHDJHUDQJHDQGVH[7KHDJJUHJDWHGGDWDRI7VWDJHDQG1VWDJHXSRQUHVHFWLRQ
FRXOGQRWEHGLUHFWO\FRPSDUHGEHWZHHQ,3'DQGDJJUHJDWHGDWDDVWKHILJXUHVJLYHQLQWKHSXEOLFDWLRQZHUHEDVHG
RQDGLIIHUHQWGHQRPLQDWRU
'HYLDWLRQVLQRYHUDOOVXUYLYDODQGGLVHDVHIUHHVXUYLYDORIWKHGLIIHUHQWWUHDWPHQWJURXSVLQHDFKWULDOGHULYHGIURP
,3'XVLQJ.DSODQ0HLHUPHWKRGDQGVWDQGDUG&R[UHJUHVVLRQDQDO\VLVDVFRPSDUHGZLWKSXEOLVKHGVXUYLYDO
HVWLPDWHV
,Q)$07;DQHVWLPDWHRIWKHKD]DUGUDWLRDQGLWVVWDQGDUGHUURUUHVXOWHGLQFRQILGHQFHLQWHUYDO
WRLQIDYRURIVXUJHU\DORQHXVLQJPHWKRGGHVFULEHGLQ0HDVXUHVRIWUHDWPHQWHIIHFW7KHKD]DUGUDWLR
HVWLPDWHEDVHGRQWKHFRUUHVSRQGLQJGDWDEDVHZDVFRQILGHQFHLQWHUYDOWR7KLVGLVFUHSDQF\
LQWKHKD]DUGUDWLRVUHVXOWHGIURPDORQJHUIROORZXSRIWKHSDWLHQWVLQWKH,3'GDWDVHWFRPSDUHGWRWKHGDWDVHW
XVHGIRUDQDO\VLVLQWKHSHUWLQHQWSXEOLFDWLRQ
7KHOHJHQGLQ752*$*,7*)LJXUH%DQG'ZDVQRWFRUUHFW7KHODEHORIWKHSDWLHQWVDWULVNZRXOGQHHGWR
EHVZDSSHGFRQILUPHGE\WKHDXWKRUV
,Q$&&25'WKHHVWLPDWHG+5VDQGWKHLUFRQILGHQFHLQWHUYDOVIRUWKHWKUHHWXPRUVLWHVHVRSKDJXV
JDVWURHVRSKDJHDOMXQFWLRQDQGVWRPDFKEDVHGRQWKH,3'GLIIHUHGIURPWKRVHJLYHQLQ)LJXUH$LQWKH
FRUUHVSRQGLQJSXEOLFDWLRQ,QDGLVFXVVLRQZLWKWKHDXWKRUVLWKDVEHHQILJXUHGRXWWKDWWKHGLVFUHSDQFLHVDUHGXHWR
WKHIDFWWKDWWKH,3'KDVDORQJHUIROORZXSWKDQWKHGDWDWKHSXEOLFDWLRQZDVEDVHGRQ
&RPSOHWHQHVVDQGHTXDOLW\RIIROORZXSLQWKHWZRWULDODUPVZHUHFKHFNHGE\SORWWLQJD
UHYHUVH
.DSODQ0HLHU
FXUYHFRQVLGHULQJFHQVRUHGSDWLHQWVDVSDWLHQWVZKRLQFXUUHGWKHRXWFRPH6WHZDUW,QDGGLWLRQIRUWKH

UHYHUVH
.DSODQ0HLHUFXUYHVWKHPHGLDQIROORZXSWLPHZDVHYDOXDWHG
)RUHDFKWULDOZLWK,3'WKHFXPXODWLYHDFFUXDOUDWHZDVFRPSDUHGEHWZHHQWKHWZRWUHDWPHQWDUPV1RUHOHYDQW
GLIIHUHQFHVRFFXUUHG%\FKHFNLQJWKHFRPSOHWHQHVVDQGHTXDOLW\RIIROORZXSLQWKHWZRWUHDWPHQWDUPVE\SORWWLQJ
WKHUHYHUVH.DSODQ0HLHUFXUYHVQRWVKRZQKHUHDJDLQQRUHOHYDQWGLIIHUHQFHVEHFDPHREYLRXVVXPPDUL]HVWKH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
PHGLDQSRWHQWLDOIROORZXSWLPHIRUHDFKWULDOZLWK,3'

(IIHFWVRILQWHUYHQWLRQV

6HH6XPPDU\RIILQGLQJVIRUWKHPDLQFRPSDULVRQ3HULRSHUDWLYHFKHPRWKHUDS\FRPSDUHGWRSULPDU\VXUJHU\IRU
UHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFKJDVWURHVRSKDJHDOMXQFWLRQDQGORZHUHVRSKDJXV6XPPDU\RI
ILQGLQJV3HULRSHUDWLYHFKHPRWKHUDS\FRPSDUHGWRSULPDU\VXUJHU\IRUUHVHFWDEOHDGHQRFDUFLQRPDRIWKH
VWRPDFKJDVWURHVRSKDJHDOMXQFWLRQDQGORZHUHVRSKDJXV

3ULPDU\RXWFRPHRYHUDOOVXUYLYDO

2YHUDOOVXUYLYDOZDVUHSRUWHGE\DOOLQFOXGHGVWXGLHV7KHPHWDDQDO\VLV$QDO\VLV\LHOGHGDSRROHGKD]DUG

UDWLR+5RIFRQILGHQFHLQWHUYDO&,WR3IRUSDWLHQWVZKRUHFHLYHGSUHRSHUDWLYH
FKHPRWKHUDS\RUFKHPRUDGLRWKHUDS\DVFRPSDUHGWRWKRVHZKRXQGHUZHQWVXUJHU\DORQH7KLVFRUUHVSRQGVWRD
UHODWLYHLQFUHDVHLQVXUYLYDORI7KHVLPSOHQRQVWUDWLILHGRYHUDOOVXUYLYDOFXUYHVRISHULRSHUDWLYH
FKHPRWKHUDS\SOXVVXUJHU\YHUVXVVXUJHU\DORQHVKRZHGDQDEVROXWHLPSURYHPHQWLQVXUYLYDORIDWILYH\HDUV
LQFUHDVLQJVXUYLYDOIURPIRUSDWLHQWVXQGHUJRLQJSULPDU\VXUJHU\WRIRUSDWLHQWVUHFHLYLQJSHULRSHUDWLYH
FKHPRWKHUDS\7KHUHVXOWVRIWKHVLQJOHVWXGLHVVKRZHGGLIIHUHQFHVLQWKHPDJQLWXGHRIWKHWUHDWPHQWHIIHFWEXW
WKH,ðZDVDQGWKHWHVWIRUKHWHURJHQHLW\ZDVQRWVLJQLILFDQW+5VUDQJHGIURPIRU&$/*%WR
IRU)$07;7KHODWWHUWRJHWKHUZLWK.RED\DVKLZHUHWKHRQO\VWXGLHVVKRZLQJDWUHQGWRZDUGV
ORQJHURYHUDOOVXUYLYDOLQWKHVXUJHU\DORQHDUP7KHFRUUHVSRQGLQJIXQQHOSORWVXJJHVWVSRVVLEOHUHSRUWLQJELDV
DVWKHUHDUHWZRVPDOOSRVLWLYHVWXGLHVEXWQRVPDOOQHJDWLYHVWXGLHVSXEOLVKHG1HYHUWKHOHVV%HJJ
VDQG(JJHU
V
WHVWUHYHDOHGQRHYLGHQFHIRUIXQQHOSORWDV\PPHWU\%HJJ
VWHVW3 (JJHU
VWHVW3 WULPDQGILOO
PHWKRG+5ZLWK&,WR
7KHSRROHG+5RILVPLUURUHGLQWKHFXPXODWLYHVXUYLYDOFXUYHZKLFKVKRZVDVXVWDLQHGVXUYLYDODGYDQWDJHIRU
SDWLHQWVLQWKHSUHRSHUDWLYHFKHPRWKHUDS\DUPVVWDUWLQJDWDERXWPRQWKVDIWHUWUHDWPHQWRQVHWDQGODVWLQJDV
ORQJDV\HDUV

6XEJURXSDQDO\VHV

7XPRUVLWH

'HILQLWLRQVRIWXPRUVLWHVGLIIHUHGEHWZHHQWULDOVEXWWKH\ZHUHXVXDOO\VWUDWLILHGLQWRHVRSKDJXV
FDUGLDJDVWURHVRSKDJHDO*(MXQFWLRQDQGVWRPDFK2QHWULDO752*$*,7*LQFOXGHGRQO\SDWLHQWVZLWK
HVRSKDJHDOWXPRUV)LYHWULDOV&$/*%2(572*8UED:DOVK
LQFOXGHGSDWLHQWVZLWKHVRSKDJHDODQG*(MXQFWLRQWXPRUV2QHWULDO:DQJLQFOXGHGRQO\SDWLHQWVZLWK
JDVWURHVRSKDJHDOMXQFWLRQWXPRUV)RXUVWXGLHV)$07;)HQJ.RED\DVKL:DQJ=KDR
LQFOXGHGRQO\SDWLHQWVZLWKJDVWULFWXPRUV2QHWULDO(257&LQFOXGHGSDWLHQWVZLWKJDVWULFDQG
*(MXQFWLRQWXPRUV7ZRVWXGLHV$&&25'0$*,&LQFOXGHGSDWLHQWVZLWKDOOWXPRUVLWHV)RU2(
VLWHVSHFLILFUHVXOWVZHUHQRWSUHVHQWHGLQWKHSXEOLFDWLRQDQG,3'ZDVQRWSURYLGHG)RU&$/*%
DQG8UEDVLWHVSHFLILFUHVXOWVZHUHDYDLODEOHQHLWKHUIURPSXEOLFDWLRQVQRUIURPSURYLGHG,3'DQGWKXVWKHVH
VWXGLHVFRXOGQRWEHLQFOXGHGLQWKHVXEJURXSDQDO\VHVIRUWXPRUVLWHZKLFKFRXOGEHSHUIRUPHGIRUWKHWKUHH
WXPRUVLWHVHVRSKDJXV*(MXQFWLRQDQGVWRPDFKEDVHGRQGDWDIURPILYHVL[DQGVHYHQVWXGLHVUHVSHFWLYHO\
$QDO\VLV7KHUHVXOWVVKRZHGDPRUHSURQRXQFHGVXUYLYDODGYDQWDJHIRUSHULRSHUDWLYHFKHPRWKHUDS\LQ
SDWLHQWVZLWKWXPRUVRIWKH*(MXQFWLRQSRROHG+5&,WRFRPSDUHGWRWKHHVRSKDJXVSRROHG
+5&,WRDQGVWRPDFKSRROHG+5&,WREXWWKHLQWHUDFWLRQWHVWGLGQRW
UHDFKVWDWLVWLFDOVLJQLILFDQFH3 
,QWKLVVXEJURXSDQDO\VLVWKHHIIHFWRIWULDOFKDUDFWHULVWLFVDQGSDWLHQWFKDUDFWHULVWLFVDUHPL[HGDVVRPHWULDOV
LQFOXGHRQO\FHUWDLQWXPRUVLWHV7KHUHIRUHZHLQYHVWLJDWHGWKHLQWHUDFWLRQEHWZHHQWUHDWPHQWDQGWXPRUVLWHLQ
WKRVHWULDOVZKHUHWKLVZDVSRVVLEOHLH,3'WULDOV$QDO\VLV7KHKHWHURJHQHLW\FRHIILFLHQWRI,ð ZDVQRW
VLJQLILFDQW

6HTXHQFHRISODQQHGSHULRSHUDWLYHWKHUDS\LQWKHLQWHUYHQWLRQDUP

7KHUHZHUHQRUHOHYDQWGLIIHUHQFHVLQWKHHIIHFWRISUHRSHUDWLYHFKHPRWKHUDS\RQRYHUDOOVXUYLYDOEHWZHHQWKHQLQH
WULDOVZKHUHRQO\SUHRSHUDWLYHFKHPRWKHUDS\ZDVVWLSXODWHGDQGWKHILYHWULDOVZKHUHERWKSUHDQGSRVWRSHUDWLYH
FKHPRWKHUDS\ZHUHIRUHVHHQ$QDO\VLV+RZHYHULWPXVWEHQRWHGWKDWHYHQLQWKHWULDOVZKHUH
SRVWRSHUDWLYHFKHPRWKHUDS\ZDVSODQQHG$&&25')HQJ.RED\DVKL0$*,&572*
RQO\EHWZHHQ$&&25'DQG0$*,&RISDWLHQWVUHFHLYHGWKHIXOOQXPEHU
RISODQQHGSRVWRSHUDWLYHF\FOHVVHHEHORZ

&KHPRWKHUDSHXWLFDJHQWVXVHGLQSUHRSHUDWLYHFKHPRWKHUDS\

7HQRIWKHLQFOXGHGWULDOVUHOLHGRQDSODWLQXPEDVHGQRQDQWKUDF\FOLQHUHJLPHQ7KHUHIRUHWKLVSUHSODQQHG
VXEJURXSDQDO\VLVZDVRIOLPLWHGYDOXHDVWKHRWKHUVXEJURXSVDQWKUDF\FOLQHEDVHGQRQSODWLQXPUHJLPHQV
UHJLPHQVFRQWDLQLQJERWKSODWLQXPDQGDQWKUDF\FOLQHDQGRWKHUUHJLPHQVFRQVLVWHGRIRQHRQHDQGWZRWULDOV
)RUSODWLQXPEDVHGQRQDQWKUDF\FOLQHUHJLPHQVWKHSRROHG+5ZDV&,WRDQGWKXVDOPRVW
LGHQWLFDOWRWKHSRROHG+5RIDOOLQFOXGHGWULDOV$QDO\VLV

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
5HJLPHQVLQFOXGLQJUDGLRWKHUDS\YHUVXVFKHPRWKHUDS\RQO\VFKHPHV

,QWULDOV$&&25'(257&)$07;)HQJ.RED\DVKL0$*,&
2(572*:DQJ=KDRWKHLQWHUYHQWLRQDUPVWLSXODWHGDUHJLPHQZKLFK
LQFOXGHGFKHPRWKHUDS\RQO\,QIRXUWULDOV&$/*%752*$*,7*8UED:DOVKWKH
LQWHUYHQWLRQZDVFKHPRUDGLRWKHUDS\$QDO\VLV$OORIWKHODWWHUFRPSULVHGH[FOXVLYHO\SDWLHQWVZLWKWXPRUVRI
WKHHVRSKDJXVRU*(MXQFWLRQ3RROHGVXEJURXSDQDO\VHVVKRZHGDVLJQLILFDQWEHQHILWLQWHUPVRIRYHUDOOVXUYLYDO
IRUERWKPRGDOLWLHV7KHPDJQLWXGHRIWKHHIIHFWZDVVWURQJHUIRUFKHPRUDGLRWKHUDS\EXWWKHFRQILGHQFHLQWHUYDORI
WKHSRROHG+5ZDVZLGHUGXHWRWKHORZHUDEVROXWHQXPEHURISDUWLFLSDQWVLQWKLVVXEJURXS7KHLQWHUDFWLRQWHVWZDV
QRWVLJQLILFDQW2IQRWHWKHUHZDVFRQVLGHUDEO\KLJKHUKHWHURJHQHLW\DPRQJUHVXOWVRIWULDOVXVLQJ
FKHPRUDGLRWKHUDS\ZLWKWKHFRUUHVSRQGLQJ,ðYDOXHMXVWDWWKHERUGHURIZKDWZHFRQVLGHUHGPHDQLQJIXOIRUD
SRROHGDQDO\VLV

3HUIRUPDQFHVWDWXV

1RSXEOLFDWLRQSURYLGHGVXIILFLHQWLQIRUPDWLRQUHJDUGLQJRYHUDOOVXUYLYDOVWUDWLILHGE\SHUIRUPDQFHVWDWXVXSRQ
UDQGRPL]DWLRQ7ZR,3'GDWDVHWV8UED:DOVKGLGQRWFRQWDLQLQIRUPDWLRQRQSHUIRUPDQFHVWDWXV
)LYH$&&25'&$/*%(257&)$07;752*$*,7*RXWRIWKH
VL[UHPDLQLQJ,3'GDWDVHWVPHDVXUHGSHUIRUPDQFHVWDWXVDFFRUGLQJWR(&2*:+2ZKHUHDV572*
XVHGWKH.DUQRIVN\VFRUH7KLVZDVFRQYHUWHGWRWKH(&2*:+2FODVVLILFDWLRQDFFRUGLQJWR9HUJHU
,QDOOWULDOVZLWKGDWDRQSHUIRUPDQFHVWDWXVRQO\ILYHSDWLHQWVZLWKDSHUIRUPDQFHVWDWXVRIRUKLJKHUZHUH
LQFOXGHG7KXVWKLVVPDOOJURXSZDVQRWLQFOXGHGLQWKHVXEJURXSDQDO\VLV7KHWUHDWPHQWE\SHUIRUPDQFHVWDWXV
LQWHUDFWLRQHIIHFWHVWLPDWHVIURPHDFKWULDOZHUHFRQVLVWHQW,ð 3 IJð SRROHGLQWHUDFWLRQHIIHFW
XQGHU5(0DQG)(0ZLWK&,WR$QDO\VLV7KHZLWKLQWULDO+5VIRURYHUDOOVXUYLYDOLQHDFK
VXEJURXSDUHSUHVHQWHGLQ$QDO\VLV

$JH

1RSXEOLFDWLRQSURYLGHGVXIILFLHQWLQIRUPDWLRQUHJDUGLQJRYHUDOOVXUYLYDOVWUDWLILHGE\DJHXSRQUDQGRPL]DWLRQ7KLV
LQIRUPDWLRQZDVKRZHYHUDYDLODEOHLQDOO,3'GDWDVHWV2QO\SDWLHQWVZLWKDQDJHRIPRUHWKDQ\HDUVZHUH
UDQGRPL]HGLQDQ\RIWKHLQFOXGHGWULDOVZKLFKSUHFOXGHGDQDO\VLVLQWKDWVXEJURXS7KHUHZDVQRHYLGHQFHRI
VXEJURXSGLIIHUHQFHVZLWKUHVSHFWWRWKHWUHDWPHQWE\DJHLQWHUDFWLRQHIIHFWHVWLPDWHV7KHODWWHUZHUHFRQVLVWHQW
RYHUDOOWULDOV,ð 3 IJð SRROHGLQWHUDFWLRQHIIHFWXQGHU5(0ZLWK&,WR
SRROHGLQWHUDFWLRQHIIHFWXQGHU)(0ZLWK&,WR$QDO\VLV7KHZLWKLQWULDO+5VIRURYHUDOO
VXUYLYDODUHSUHVHQWHGLQ$QDO\VLV

6H[

1RSXEOLFDWLRQSURYLGHGVXIILFLHQWLQIRUPDWLRQUHJDUGLQJRYHUDOOVXUYLYDOVWUDWLILHGE\VH[7KLVLQIRUPDWLRQZDV
KRZHYHUDYDLODEOHLQDOO,3'GDWDVHWV$ERXWRISDUWLFLSDQWVLQWKHWULDOVZHUHPDOH3RROLQJRIZLWKLQWULDO
FRYDULDWHLQWHUDFWLRQVUHYHDOHGQRVXEJURXSGLIIHUHQFHEHWZHHQPDOHVDQGIHPDOHV,ð 3 IJð 
SRROHGLQWHUDFWLRQHIIHFWXQGHU5(0DQG)(0ZLWK&,WR$QDO\VLV7KHZLWKLQWULDO+5V
IRURYHUDOOVXUYLYDODUHSUHVHQWHGLQ$QDO\VLV

3UHWUHDWPHQWWXPRUVWDJH

3RVWKRFVXEJURXSDQDO\VHVDFFRUGLQJWRSUHWUHDWPHQW7VWDJH7YHUVXV7DQGSUHWUHDWPHQW1VWDJH1

YHUVXV1ZHUHGRQHIRUDOO,3'GDWDVHWVZLWKDYDLODEOHLQIRUPDWLRQ$QDO\VLV$QDO\VLV7KUHH
&$/*%(257&572*RXWRIHLJKWWULDOVZLWK,3'SURYLGHGLQIRUPDWLRQRQ
SUHWUHDWPHQW7VWDJHEXWRQO\RQH572*KDGLQFOXGHGHQRXJKSDWLHQWVZLWKSUHWUHDWPHQWVWDJH7
WRLQYHVWLJDWHDQLQWHUDFWLRQEHWZHHQWUHDWPHQWDQG7VWDJH$QDO\VLV)RXUWULDOVSURYLGHGLQIRUPDWLRQRQ
SUHWUHDWPHQW1VWDJH&$/*%(257&572*752*$*,7*3RROLQJ
RIZLWKLQWULDOFRYDULDWHLQWHUDFWLRQVUHYHDOHGQRVXEJURXSGLIIHUHQFHEHWZHHQ1DQG1,ð 3 IJð
SRROHGLQWHUDFWLRQHIIHFWXQGHU5(0DQG)(0ZLWK&,WR$QDO\VLV

5HVHFWLRQVWDWXV

,QRUGHUWRDVVHVVWKHLQIOXHQFHRIUHVHFWLRQVWDWXV5RQVXUYLYDOZHFRQGXFWHGDSRROHGVXUYLYDODQDO\VLV

ZLWKSDWLHQWVIURPERWKDUPVRIDOOILYHWULDOVIRUZKLFKUHVSHFWLYHGDWDZHUHDYDLODEOH$&&25'(257&
)$07;572*752*$*,7*$VXEJURXSDQDO\VLVDFFRUGLQJWRUHVHFWLRQ
VWDWXVFRPSDULQJRYHUDOOVXUYLYDOIRUSDWLHQWVZKRUHFHLYHGSHULRSHUDWLYHFKHPRWKHUDS\DQGWKRVHZKRXQGHUZHQW
SULPDU\VXUJHU\ZDVQRWDSSURSULDWHDVWKHGLVWULEXWLRQRIUHVHFWLRQVWDWXVZDVVLJQLILFDQWO\GLIIHUHQWEHWZHHQ
WUHDWPHQWDUPVSUREDEO\EHFDXVHLWZDVGLUHFWO\LQIOXHQFHGE\WKHWUHDWPHQWDSDWLHQWUHFHLYHG)RUWKHVDPH
UHDVRQWKHYDULDEOHUHVHFWLRQVWDWXVZDVQRWLQFOXGHGLQWKH&R[PRGHOVHHEHORZ7KH.DSODQ0HLHUFXUYHVVKRZ
WKDWUHVHFWLRQVWDWXVLVDVWURQJSUHGLFWRUIRURYHUDOOVXUYLYDOZLWKSDWLHQWVZLWK5RU5UHVHFWLRQKDYLQJD
VXEVWDQWLDOO\SRRUHUSURJQRVLVWKDQSDWLHQWVZLWK5UHVHFWLRQ)LYH\HDUVXUYLYDOSUREDELOLWLHVZHUH
&,WRLQWKH5JURXS&,WRLQWKH5JURXSDQGLQWKH5JURXS7KH
FRUUHVSRQGLQJ+5VZHUH&,WRIRU5YHUVXV5DQG&,WRIRU5YHUVXV
5

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
6HQVLWLYLW\DQDO\VHV

$VHQVLWLYLW\DQDO\VLVZKLFKFRPSDUHGWULDOVIURPZKLFKRQO\DJJUHJDWHGDWDZHUHDYDLODEOHZLWKWKRVHIURPZKLFK
,3'ZHUHDYDLODEOHUHYHDOHGQRGLIIHUHQFHVZLWKERWKSRROHG+5VEHLQJDOPRVWLGHQWLFDO$QDO\VLV$PHWD
DQDO\VLVH[FOXGLQJWULDOVZLWKKLJKULVNRIELDV\LHOGHGD+5RI&,WRZKLFKLVYLUWXDOO\LGHQWLFDO
WRWKHUHVXOWRIWKHPHWDDQDO\VLVRIDOOWULDOV$PHWDDQDO\VLVLQFOXGLQJRQO\WKHWKUHHWULDOVZLWKORZULVNRIELDV
SDWLHQWV\LHOGHGD+5RI&,WR$PHWDDQDO\VLVH[FOXGLQJWKHWZRWULDOVIURPZKLFKRQO\
GDWDRQµYLWDOVWDWXVDWHQGRIIROORZXS¶DQGQRWLPHWRHYHQWGDWDZHUHDYDLODEOH\LHOGHGD+5RI&,
WR

,QYHVWLJDWLRQRILPSRUWDQWFRYDULDWHV

$&R[SURSRUWLRQDOKD]DUGVPRGHOZLWKRXWDQ\FRYDULDWHVEXWWKHWUHDWPHQWDUPFKHPRUDGLRWKHUDS\YHUVXV

VXUJHU\DORQHDVIL[HGHIIHFWDQGWULDODVUDQGRPHIIHFWVDSSOLHGWRDOOHLJKW,3'GDWDVHWVVXPPDUL]HGLQDVLQJOH
GDWDEDVHZLWKSDWLHQWVUHVXOWHGLQD+5RI&,WRVHHDOVR
7ZR&$/*%8UEDRXWRIHLJKWWULDOVZLWKDYDLODEOH,3'SURYLGHGQRLQIRUPDWLRQRQH[DFWWXPRU
VLWHJDVWURHVRSKDJHDOMXQFWLRQRUHVRSKDJXV)RUILYH$&&25')$07;752*$*,7*
8UED:DOVKRXWRIHLJKWWULDOVZLWKDYDLODEOH,3'QRLQIRUPDWLRQRQSUHWUHDWPHQW7VWDJHZDV
DYDLODEOHIRUIRXU$&&25')$07;8UED:DOVKWULDOVQRLQIRUPDWLRQRQ
SUHWUHDWPHQW1VWDJHZDVDYDLODEOH)RUWZRWULDOV8UED:DOVKLQIRUPDWLRQRQSHUIRUPDQFHVWDWXV
ZDVPLVVLQJ$VWKHLPSXWDWLRQRIDFRYDULDWHIRUDZKROHWULDOGDWDVHWQRWMXVWDIHZSDWLHQWVLQDWULDOZDVQRW
UHDVRQDEOHQRLPSXWDWLRQPHWKRGVIRUPLVVLQJGDWDZHUHXVHGDQGDQDO\VHVZHUHRQO\FRQGXFWHGDVFRPSOHWH
FDVHDQDO\VHV
,QDILUVWVWHSZHDQDO\]HGWKHLQIOXHQFHRIHDFKVLQJOHSUHVSHFLILHGFRYDULDWHRQWKHWUHDWPHQWHIIHFWRI
FKHPRUDGLRWKHUDS\YHUVXVVXUJHU\DORQHE\D&R[SURSRUWLRQDOKD]DUGVPRGHOZLWKWUHDWPHQWDQGFRYDULDWHDV
IL[HGHIIHFWDQGWKHWULDODVUDQGRPHIIHFWVEDVHGRQDOOHOLJLEOHSDWLHQWV7KHPDJQLWXGHRIWKHHIIHFWRI
SHULRSHUDWLYHFKHPRUDGLRWKHUDS\RQVXUYLYDOUHPDLQHGODUJHO\XQFKDQJHGZKHQDGMXVWLQJIRUWKHVHSDUDWH
FRYDULDWHV
,QDVHFRQGVWHSZHGLGDFRPSOHWHFDVHPXOWLYDULDEOHDQDO\VLVZLWKUHVSHFWWRWKHWKUHHWUHDWPHQWDUPV
FKHPRWKHUDS\RQO\FKHPRUDGLRWKHUDS\DQGVXUJHU\DORQHDQGDOOSUHVSHFLILHGFRYDULDWHVH[FHSWSUHWUHDWPHQW7
DQG1VWDJH)RU&R[SURSRUWLRQDOKD]DUGVUHJUHVVLRQDQDO\VHVZHILUVWWHVWHGWKHDVVXPSWLRQRISURSRUWLRQDO
KD]DUGVE\SORWWLQJORJORJVXUYLYDOSUREDELOLW\YHUVXVORJRIVXUYLYDOWLPHVWUDWLILHGE\WUHDWPHQWDQGE\
LQFOXGLQJWLPHGHSHQGHQWFRYDULDEOHVLQWKHZKROHPRGHO+RZHYHUZHGHWHFWHGQRPDMRUYLRODWLRQVRIWKH
SURSRUWLRQDOKD]DUGVDVVXPSWLRQ3UHWUHDWPHQW7DQG1VWDJHZHUHQRWLQFOXGHGDVFRYDULDWHVEHFDXVHRWKHUZLVH
WKHFRPSOHWHFDVHVDPSOHVL]HZRXOGKDYHGURSSHGWR2QO\WKUHHSDWLHQWVKDGDSHUIRUPDQFHVWDWXVRU
KLJKHU7KHUHIRUHWKH&R[PRGHOGHYLDWHGIURPWKHSODQQHGDQDO\VLVE\GLFKRWRPL]LQJWKHSHUIRUPDQFHVWDWXVLQWR
YHUVXVRUKLJKHU7KHUHVXOWVRIWKHPXOWLYDULDEOHDQDO\VLVEDVHGRQSDWLHQWVWDNLQJLQWRDFFRXQW
WUHDWPHQWDUPWXPRUVLWHSHUIRUPDQFHFODVVDJHDQGJHQGHUDVFRYDULDWHVDUHVXPPDUL]HGLQ
$IWHUDGMXVWLQJIRUWKHYDULRXVFRYDULDWHVWKHHIIHFWRISHULRSHUDWLYHFKHPRWKHUDS\RQVXUYLYDOGHFUHDVHGVOLJKWO\
LQPDJQLWXGHDQGZDVQRORQJHUVWDWLVWLFDOO\VLJQLILFDQW7KHUHVHHPHGWREHQRHIIHFWRISHULRSHUDWLYH
FKHPRUDGLRWKHUDS\RQVXUYLYDOEXWZHZHUHDEOHWRLQFOXGHRQO\DVLQJOHWULDOZKLFKZDVQHJDWLYHLQWKHPRGHO
752*$*,7*ZKHUHDVWKUHHSRVLWLYHWULDOV&$/*%8UED:DOVKFRXOGQRWEH
LQFOXGHGGXHWRXQDYDLODELOLW\RIWKHYDULDEOHVUHTXLUHGIRUWKHPRGHO7XPRUVLWHSHUIRUPDQFHVWDWXVDQGDJHKDG
DVLJQLILFDQWHIIHFWRQVXUYLYDOHYHQDIWHUPXOWLYDULDEOHDGMXVWPHQW
:HLQYHVWLJDWHGLQWHUDFWLRQVEHWZHHQWUHDWPHQWDQGRQHFRYDULDWHDWDWLPHLQWKHPXOWLYDULDEOH&R[UHJUHVVLRQ
PRGHO$QLQWHUDFWLRQEHWZHHQWUHDWPHQWDQGDJHZDVVLJQLILFDQWPXOWLYDULDEOH3 QRWVKRZQLQWDEOH
7KLVVXJJHVWVWKDWDJHPD\SOD\DUROHLQZKHWKHUSHULRSHUDWLYHFKHPRWKHUDS\LVPRUHHIIHFWLYHWKDQSULPDU\
VXUJHU\,QFOXGLQJDQLQWHUDFWLRQWHUPEHWZHHQWUHDWPHQWDQGDJHLQWKHPXOWLYDULDEOHDQDO\VLVUHYHDOHGDWUHQGRI
DQLQFUHDVLQJ+5ZLWKLQFUHDVLQJDJHZLWKWKHFRQILGHQFHLQWHUYDOLQFOXGLQJDWDJHDQGZLWKWKHSRLQWHVWLPDWH
RIWKH+5EHLQJODUJHUWKDQDWDJH:KLOH\RXQJHUSDWLHQWVKDGDPRUHSURQRXQFHGVXUYLYDOEHQHILWIRU
SHULRSHUDWLYHFKHPRWKHUDS\WKHWUHDWPHQWHIIHFWVHHPHGWRGHFUHDVHRUHYHQGLVDSSHDULQROGHUSDWLHQWV
$OWKRXJKDQLQWHUDFWLRQEHWZHHQWUHDWPHQWDQGWXPRUVLWHZDVQRWVLJQLILFDQWPXOWLYDULDEOH3 QRWVKRZQ
LQWDEOHZHUHSRUWWKHWXPRUVLWHVSHFLILF+5VIRUWKHWUHDWPHQWHIIHFWHVRSKDJXV+5&,WR
*(MXQFWLRQ+5&,WRVWRPDFK+5&,WR7KH+5IRUSDWLHQWVZLWKD
UHVHFWDEOHDGHQRFDUFLQRPDRIWKHHVRSKDJXVDQGRI*(MXQFWLRQDUHOHVVH[WUHPHLQFRPSDULVRQWRWKHIRUHVWSORW
$QDO\VLVZKHUHDVWKH+5IRUSDWLHQWVZLWKDUHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFKLVUHYHUVHGEXWGRHV
QRWUHDFKVWDWLVWLFDOVLJQLILFDQFH

6HFRQGDU\RXWFRPHV

'LVHDVHIUHHVXUYLYDO

$VZHFKRVHWRFDOFXODWHGLVHDVHIUHHVXUYLYDODFFRUGLQJWRWKH
ODQGPDUN
PHWKRGVHH0HWKRGVDQGZLWKWKH
H[FHSWLRQRI$&&25'QRSXEOLFDWLRQLQFOXGHGWKHUHVSHFWLYHUHVXOWVZHFRXOGFRQGXFWWKLVDQDO\VLV
H[FOXVLYHO\IRUVWXGLHVIRUZKLFK,3'ZHUHSURYLGHG+RZHYHUWKHLQIRUPDWLRQLQRQH,3'GDWDVHW:DOVK
ZDVQRWVXIILFLHQWWRXVHWKHODQGPDUNPHWKRGDVGDWDRQGLVHDVHIUHHVXUYLYDOZHUHQRWSURYLGHG7KXVRXU
ODQGPDUNDQDO\VLVRIGLVHDVHIUHHVXUYLYDOLVEDVHGRQVHYHQVWXGLHVFRPSULVLQJSDWLHQWV$&&25'
&$/*%(257&)$07;572*752*$*,7*8UED7KH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
UHVXOWV$QDO\VLVUHVHPEOHWKRVHRIWKHSRROHGDQDO\VLVRIRYHUDOOVXUYLYDOZLWKYHU\VPDOOGLIIHUHQFHV
EHWZHHQ+5VIRURYHUDOODQGGLVHDVHIUHHVXUYLYDO7KHSRROHG+5IRUGLVHDVHIUHHVXUYLYDOLV&,WR
DQGWKXVVOLJKWO\KLJKHUWKDQIRURYHUDOOVXUYLYDODQGQRVWDWLVWLFDOVLJQLILFDQFHLVUHDFKHG3 *LYHQ
WKHUHODWLYHO\VPDOOQXPEHURILQFOXGHGWULDOVWKHFRUUHVSRQGLQJIXQQHOSORWLVGLIILFXOWWRLQWHUSUHWEXWGRHVQRW
VXJJHVWSXEOLFDWLRQELDV%HJJ
VWHVW3 (JJHU
VWHVW3 WULPDQGILOOPHWKRGDGGHGQRVWXGLHV
$VRQO\VWXGLHVZLWK,3'ZHUHDEOHWRSURYLGHGDWDIRUWKHPHWDDQDO\VLVRIGLVHDVHIUHHVXUYLYDOZHFRXOGQRW
SHUIRUPDVHQVLWLYLW\DQDO\VLVFRPSDULQJWULDOVZLWKDQGZLWKRXWDYDLODEOH,3'1RQHRIWKHVHYHQWULDOVXVHGLQWKH
PHWDDQDO\VLVKDGDKLJKULVNRIELDV:KHQH[FOXGLQJWKHWKUHHWULDOVZLWKPRGHUDWHULVNRIELDVWKHPDJQLWXGHRI
WKHHIIHFWIRXQGLQWKHPHWDDQDO\VLVUHPDLQHGODUJHO\XQFKDQJHGZLWKD+5RI&,WR

3UHVHQFHRIWXPRUIUHHUHVHFWLRQPDUJLQ

'DWDRQWKHSUHVHQFHRIDWXPRUIUHHUHVHFWLRQPDUJLQZHUHDYDLODEOHIURPVWXGLHV$QDO\VLV7KHPHWD

DQDO\VLVVKRZHGDKLJKHUOLNHOLKRRGRIWXPRUIUHHUHVHFWLRQPDUJLQLQSDWLHQWVZKRKDGUHFHLYHGSHULRSHUDWLYH
FKHPRWKHUDS\EXWWKHDVVRFLDWLRQZDVMXVWQRWVWDWLVWLFDOO\VLJQLILFDQWRGGVUDWLR25&,WR
7KHUHZDVKHWHURJHQHLW\EHWZHHQWKHVLQJOHVWXGLHV,ð 7KHFRUUHVSRQGLQJIXQQHOSORWGLGQRWVXJJHVW
UHOHYDQWSXEOLFDWLRQELDV3HWHUV
WHVW3 WULPDQGILOOPHWKRG25&,WR
7KHVHQVLWLYLW\DQDO\VLVVKRZHGDQ25RI&,WRZKHQH[FOXGLQJWZRWULDOVZLWKKLJKULVNRI
ELDVDQGRI&,WRZKHQH[FOXGLQJDQRWKHUILYHWULDOVZLWKPRGHUDWHULVNRIELDV

7XPRUVWDJHDWUHVHFWLRQ

'DWDRQ7VWDJHXSRQUHVHFWLRQZHUHDYDLODEOHIURPVHYHQVWXGLHV$QDO\VLV7KHPHWDDQDO\VLVVKRZHGWKDW

D7VWDJHZDVVLJQLILFDQWO\PRUHIUHTXHQWLQSDWLHQWVZKRKDGUHFHLYHGSHULRSHUDWLYHFKHPRWKHUDS\WKDQLQ
WKRVHZKRXQGHUZHQWVXUJHU\DORQH25&,WR7KHUHZDVKHWHURJHQHLW\EHWZHHQUHVXOWVRI
WKHVLQJOHVWXGLHVEXWDOOH[FHSWWZRVWXGLHV.RED\DVKL572*VKRZHGDKLJKHUIUHTXHQF\RI
7VWDJHVLQWKHSHULRSHUDWLYHFKHPRWKHUDS\JURXS7KHFRUUHVSRQGLQJIXQQHOSORWGLGQRWVXJJHVWUHOHYDQW
SXEOLFDWLRQELDV3HWHUV
WHVW3 WULPDQGILOOPHWKRGDGGHGQRVWXGLHV
7KHVHQVLWLYLW\DQDO\VLVVKRZHGDQ25RI&,WRZKHQH[FOXGLQJRQHWULDOZLWKKLJKULVNRIELDV
DQGRI&,WRZKHQH[FOXGLQJDQRWKHUWKUHHWULDOVZLWKPRGHUDWHULVNRIELDV
'DWDRQ1VWDJHXSRQUHVHFWLRQZHUHDYDLODEOHIURPHLJKWVWXGLHV$QDO\VLV7KHPHWDDQDO\VLVVKRZHGWKDWD
1VWDJHZDVVLJQLILFDQWO\PRUHIUHTXHQWLQSDWLHQWVZKRKDGUHFHLYHGSHULRSHUDWLYHFKHPRWKHUDS\25
&,WR7KHUHZDVFRQVLGHUDEOHKHWHURJHQHLW\EHWZHHQUHVXOWVRIWKHVLQJOHVWXGLHV,ð ZLWKDQ
25DVKLJKDVLQ8UED$OOEXWRQHWULDOVKRZHGDKLJKHUIUHTXHQF\RIDQ1VWDJHLQWKHLQWHUYHQWLRQ
JURXS7KHFRUUHVSRQGLQJIXQQHOSORWVXJJHVWHGSXEOLFDWLRQELDVDVWKHWULPDQGILOOPHWKRGDGGHGWKUHHVWXGLHV
LQWKHRSSRVLWHGLUHFWLRQRI(257&8UEDDQG:DOVKDQGUHVXOWHGLQDFRQVLGHUDEO\ORZHU
253HWHUV
WHVW3 WULPDQGILOOPHWKRG25&,WR
7KHVHQVLWLYLW\DQDO\VLVVKRZHGDQ25RI&,WRZKHQH[FOXGLQJILYHWULDOVZLWKPRGHUDWHULVN
RIELDV

3RVWRSHUDWLYHPRUELGLW\

'DWDRQSRVWRSHUDWLYHPRUELGLW\ZHUHDYDLODEOHIURPQLQHVWXGLHV$QDO\VLV7KHUHZDVFRQVLGHUDEOHYDULDWLRQ

LQDEVROXWHUHSRUWHGPRUELGLW\EHWZHHQWKHVLQJOHVWXGLHVZLWKUDWHVLQWKHVLQJOHDUPVUDQJLQJIURP:DQJ
ERWKDUPVWR:DOVKSULPDU\VXUJHU\DUP7KHPHWDDQDO\VLVGLGQRWVKRZDQ\VLJQLILFDQW
GLIIHUHQFHVLQSRVWRSHUDWLYHPRUELGLW\EHWZHHQWULDODUPVULVNGLIIHUHQFH&,WR7KHUHZDV
QRUHOHYDQWKHWHURJHQHLW\EHWZHHQUHVXOWVRIWKHVLQJOHVWXGLHVDQGDOOFRQILGHQFHLQWHUYDOVLQFOXGHGHTXLW\7KH
FRUUHVSRQGLQJIXQQHOSORWGLGQRWVXJJHVWUHOHYDQWSXEOLFDWLRQELDV3HWHUV
WHVW3 WULPDQGILOOPHWKRG
DGGHGQRVWXGLHV
7KHVHQVLWLYLW\DQDO\VLVVKRZHGDQDEVROXWHULVNGLIIHUHQFHRI&,WRZKHQH[FOXGLQJWKUHH
WULDOVZLWKKLJKULVNRIELDVDQGRI&,WRZKHQH[FOXGLQJDQRWKHUWKUHHWULDOVZLWKPRGHUDWH
ULVNRIELDV

3RVWRSHUDWLYHPRUWDOLW\

'DWDRQSRVWRSHUDWLYHPRUWDOLW\ZHUHDYDLODEOHIURPVWXGLHV$QDO\VLV2YHUDOOPRUWDOLW\UDWHVUDQJHG

EHWZHHQ8UED:DQJ=KDRERWKDUPVDQG)$07;SHULRSHUDWLYH
FKHPRWKHUDS\DUPLQWKHVLQJOHWULDODUPV7KHPHWDDQDO\VLVGLGQRWVKRZDQ\VLJQLILFDQWGLIIHUHQFHVLQ
SRVWRSHUDWLYHPRUWDOLW\EHWZHHQWULDODUPVULVNGLIIHUHQFH&,WR7KHUHZDVQRUHOHYDQW
KHWHURJHQHLW\EHWZHHQUHVXOWVRIWKHVLQJOHVWXGLHVDQGDOOFRQILGHQFHLQWHUYDOVLQFOXGHGHTXLW\7KHFRUUHVSRQGLQJ
IXQQHOSORWVXJJHVWHGDUHOHYDQWSXEOLFDWLRQELDVDOWKRXJKWKHWULPDQGILOOPHWKRGDGGHGRQO\RQHWULDOZLWKQR
UHOHYDQWFKDQJHLQWKHRYHUDOOULVNGLIIHUHQFH3HWHUV
WHVW3WULPDQGILOOPHWKRG5'ZLWK&,
WR
7KHVHQVLWLYLW\DQDO\VLVVKRZHGDQDEVROXWHULVNGLIIHUHQFHRI&,WRZKHQH[FOXGLQJWKUHH
WULDOVZLWKKLJKULVNRIELDVDQGRI&,WRZKHQH[FOXGLQJDQRWKHUILYHWULDOVZLWKPRGHUDWH
ULVNRIELDV

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
6DIHW\

'DWDRQWKHLQFLGHQFHRIJUDGHWR[LFLWLHVGXULQJSUHRSHUDWLYHFKHPRWKHUDS\ZHUHDYDLODEOHIURPVL[VWXGLHV
$QDO\VLV7KHLQFLGHQFHUDQJHGEHWZHHQ]HUR.RED\DVKLDQG572*HYHQWVSHU
SDWLHQW
$IRUPDOVHQVLWLYLW\DQDO\VLVDFFRUGLQJWRULVNRIELDVZDVQRWSRVVLEOH2QHWULDOZLWKDKLJKULVNRIELDV.RED\DVKL
UHSRUWHGWKDWQRWR[LFLW\RFFXUUHGGXULQJWKHSUHRSHUDWLYHFKHPRWKHUDS\ZKHUHDVDOOWULDOVZLWKPRGHUDWH
RUORZULVNRIELDVIURPZKLFKGDWDZHUHDYDLODEOHUHSRUWHGVRPHGHJUHHRIWR[LFLW\7KHWZRWULDOVZLWKORZULVNRI
ELDV$&&25')$07;UHSRUWHGDQLQFLGHQFHRIDQGHYHQWVSHUSDWLHQWUHVSHFWLYHO\

1RQDGPLQLVWUDWLRQRISRVWRSHUDWLYHWKHUDS\

)LYHWULDOV$&&25')HQJ.RED\DVKL0$*,&572*VWLSXODWHG

SRVWRSHUDWLYHFRQWLQXDWLRQRIFKHPRWKHUDS\LQWKHLULQWHUYHQWLRQDUP)RURQO\WKUHHRIWKRVHWULDOV$&&25'
0$*,&572*VXIILFLHQWLQIRUPDWLRQZDVDYDLODEOHUHJDUGLQJIUHTXHQF\RIQRQ
DGPLQLVWUDWLRQRISODQQHGSRVWRSHUDWLYHWKHUDS\,QWKH$&&25'WULDOSDWLHQWVUHFHLYHG
DOOIRXUSRVWRSHUDWLYHFKHPRWKHUDS\F\FOHVDVSODQQHG,QWKH0$*,&WULDOSDWLHQWV
UHFHLYHGDOOWKUHHSRVWRSHUDWLYHFKHPRWKHUDS\F\FOHVDVSODQQHG,QWKH572*WULDO
SDWLHQWVUHFHLYHGERWKSRVWRSHUDWLYHFKHPRWKHUDS\F\FOHVDVSODQQHG

)L[HGHIIHFWPRGHOV

:HUHSHDWHGDOODQDO\VHVXVLQJIL[HGHIIHFWPRGHOV7KHRQO\DSSUHFLDEOHGLIIHUHQFHVQRWHGZHUHWKDWWKH&,
IRUGLVHDVHIUHHVXUYLYDOQDUURZHGWRWRDQGUHDFKHGVWDWLVWLFDOVLJQLILFDQFHDW3 WKDWWKH25IRU
WXPRUIUHHPDUJLQFKDQJHGWR&,WRDQGWKDWWKH25IRUSRVWRSHUDWLYH1YHUVXV1
VWDJHFKDQJHGWR&,WR

',6 &86 6 ,21

'LVFXVVLRQ

7KHSUHVHQWPHWDDQDO\VLVXVHV,3'WRDVVHVVSRWHQWLDOWKHUDSHXWLFEHQHILWVRISHULRSHUDWLYHFKHPRWKHUDS\IRU
JDVWURHVRSKDJHDODGHQRFDUFLQRPD8QOLNHSUHYLRXVPHWDDQDO\VHV6MRTXLVW7KLULRQ:XLW
LQFOXGHVDOOWXPRUORFDWLRQVLHHVRSKDJXVJDVWURHVRSKDJHDO*(MXQFWLRQDQGVWRPDFK'XHWRWKHDYDLODELOLW\RI
LQGLYLGXDOSDWLHQWGDWD,3'IURPVHYHUDOWULDOVLQHVRSKDJHDOFDQFHULWZDVSRVVLEOHWRLQFOXGHSDWLHQWVZLWK
DGHQRFDUFLQRPDIURPWULDOVZLWKPL[HGKLVWRORJ\ZKLOHH[FOXGLQJSDWLHQWVZLWKVTXDPRXVFHOOFDUFLQRPDZKLFKLV
WKRXJKWWRKDYHDGLIIHUHQWELRORJLFDOEHKDYLRU&KDX
7KHSULQFLSDODQGFOLQLFDOO\PRVWLPSRUWDQWILQGLQJRIRXUPHWDDQDO\VLVLVWKDWSHULRSHUDWLYHFKHPRWKHUDS\ZLWKRU
ZLWKRXWUDGLRWKHUDS\IRUJDVWURHVRSKDJHDODGHQRFDUFLQRPDZDVDVVRFLDWHGZLWKSURORQJHGRYHUDOOVXUYLYDO7KH
FXPXODWLYHVXUYLYDOFXUYHEDVHGRQ,3'IURPPRUHWKDQSDWLHQWVVKRZHGDVXVWDLQHGEHQHILWIRUSDWLHQWV
ZKRUHFHLYHGSHULRSHUDWLYHFKHPRWKHUDS\VWDUWLQJDWDERXWPRQWKVDIWHUVXUJHU\DQGODVWLQJDVORQJDV
\HDUV7KHPDJQLWXGHRIWKLVEHQHILWZDVURXJKO\)RUH[DPSOHILYH\HDUVXUYLYDOZDVLQWKHVXUJHU\
DORQHJURXSDQGLQWKHSHULRSHUDWLYHFKHPRWKHUDS\JURXS*LYHQWKHYHU\SRRURYHUDOOORQJWHUPSURJQRVLVRI
WKHGLVHDVHWKLVGLIIHUHQFHPXVWEHFRQVLGHUHGDVFOLQLFDOO\KLJKO\UHOHYDQW$YHU\VLPLODUDVVRFLDWLRQZDVIRXQG
IRUGLVHDVHIUHHVXUYLYDOZKLFKVWUHQJWKHQVWKHYDOLGLW\RIRXUUHVXOWV7KHUHIRUHSHULRSHUDWLYHFKHPRWKHUDS\
VKRXOGEHRIIHUHGWRDOOSDWLHQWVZLWKORFRUHJLRQDOO\DGYDQFHGJDVWURHVRSKDJHDODGHQRFDUFLQRPDXQOHVVPHGLFDO
FRQWUDLQGLFDWLRQVDUHSUHVHQW
6HYHUDOSRWHQWLDOPHFKDQLVPVRIKRZSHULRSHUDWLYHFKHPRUDGLRWKHUDS\FRXOGOHDGWRSURORQJHGVXUYLYDOLQWKLV
WXPRUHQWLW\KDYHEHHQGLVFXVVHG(JXFKL0$*,&6RPHRIWKHVHK\SRWKHVHVDUHVXSSRUWHGE\RXU
UHVXOWV7KHRGGVRIFRPSOHWHUHVHFWLRQLQSDWLHQWVWUHDWHGZLWKSHULRSHUDWLYHFKHPRWKHUDS\ZHUHDERXWWLPHV
KLJKHUWKDQLQXQWUHDWHGSDWLHQWVZLWKERUGHUOLQHVWDWLVWLFDOVLJQLILFDQFHLQWKHPHWDDQDO\VLV$SRROHGDQDO\VLVRI
SDWLHQWVIURPERWKWUHDWPHQWDUPVRIWULDOVIRUZKLFKUHVSHFWLYHGDWDZHUHDYDLODEOHVKRZHGWKDWFRPSOHWH
UHVHFWLRQLVLQIDFWDYHU\VWURQJSUHGLFWRURIVXUYLYDO5HJDUGLQJGRZQVWDJLQJRI7DQG1VWDJHVDQG
KLVWRSDWKRORJLFUHVSRQVHWKHUHZHUHLQVXIILFLHQWGLUHFWGDWDDYDLODEOHIURPWKHVLQJOHWULDOV:HZHUHKRZHYHUDEOH
WRFRPSDUH7DQG1VWDJHVXSRQUHVHFWLRQEHWZHHQWUHDWPHQWDUPVDQGIRXQGDFRQVLGHUDEO\KLJKHULQFLGHQFHRI
PRUHDGYDQFHGVWDJHVLQSDWLHQWVZKRZHUHQRWSUHWUHDWHGZLWKSHULRSHUDWLYHFKHPRWKHUDS\$VWKHUHLVQRUHDVRQ
WRDVVXPHUHOHYDQWEDVHOLQHGLIIHUHQFHVLQ7DQG1VWDJHLQWKHLQFOXGHGUDQGRPL]HGFRQWUROOHGWULDOV5&7VWKLV
ILQGLQJLVDQLQGLUHFWSURRIRIGRZQVWDJLQJ1RGDWDZHUHDYDLODEOHWRXVRQWKHHIIHFWRISHULRSHUDWLYH
FKHPRWKHUDS\RQFDQFHUV\PSWRPVDQGRQSRWHQWLDOLPSURYHPHQWRISDWLHQWV
SHUIRUPDQFHVWDWXVDQGTXDOLW\RI
OLIHZKLFKLQLWVHOIVHHPVWREHSRVLWLYHO\DVVRFLDWHGZLWKVXUYLYDODQGEHWWHUVXUJLFDORXWFRPH&KDX'MDUY
0F&XOORFKGXULQJSUHRSHUDWLYHWUHDWPHQW
7KHUHZHUHQRWDQJLEOHGLIIHUHQFHVLQSHULRSHUDWLYHPRUELGLW\DQGPRUWDOLW\EHWZHHQWUHDWHGDQGXQWUHDWHG
SDWLHQWVZKLFKODUJHO\H[FOXGHVUHOHYDQWGHWULPHQWDOHIIHFWVRIWKHWUHDWPHQWRQWKHLQFLGHQFHRISHULRSHUDWLYH
FRPSOLFDWLRQV7KXVIHDUVWKDWSUHWUHDWLQJSDWLHQWVZLWKFKHPRWKHUDS\EHIRUHUHVHFWLRQRIJDVWURHVRSKDJHDO
PDOLJQDQFLHVMHRSDUGL]HVWKHLUSHULRSHUDWLYHVDIHW\GRQRWVHHPWREHMXVWLILHG6SHFLILFDOO\ZHFRXOGQRWILQGDQ\
HYLGHQFHIRUH[FHVVLYHSRVWRSHUDWLYHPRUWDOLW\DIWHUSUHRSHUDWLYHFKHPRUDGLRWKHUDS\IURPWKHWKUHHWULDOVIRU
ZKLFKVXFKGDWDZHUHDYDLODEOH6SHFLILFUHJLPHQVRUVFKHPHVPLJKWEHPRUHIDYRUDEOHZLWKUHJDUGWR
SHULRSHUDWLYHRXWFRPHVWKDQRWKHUVDQDVVXPSWLRQZKLFKFRXOGQRWEHIXUWKHUDVVHVVHGLQRXUGDWDGXHWRWKH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
KHWHURJHQHLW\RIDSSOLHGWUHDWPHQWSURWRFROVLQWKHVLQJOHWULDOV,QIRUPDWLRQRQKRZZHOOSHULRSHUDWLYH
FKHPRWKHUDS\LWVHOIZDVWROHUDWHGZDVDYDLODEOHRQO\IURPIHZWULDOVDQGVKRZHGUHOHYDQWKHWHURJHQHLW\ZLWK
UHSRUWHGLQFLGHQFHVRIJUDGHWR[LFLWLHVUDQJLQJIURPDVORZDVRQHLQSDWLHQWVWRDVKLJKDVWZRSHUSDWLHQW
$VWUHQJWKRIRXU,3'EDVHGDQDO\WLFDODSSURDFKLVWKDWZHZHUHDEOHWRDVVHVVVXUYLYDOHIIHFWVRISHULRSHUDWLYH
FKHPRWKHUDS\LQYDULRXVFOLQLFDOO\UHOHYDQWSUHVSHFLILHGVXEJURXSVERWKDFFRUGLQJWRSDWLHQWDQGWUHDWPHQW
FKDUDFWHULVWLFV$VDQRWHRIFDXWLRQLWPXVWEHNHSWLQPLQGWKDWWKHVHVXEJURXSDQDO\VHVZHUHQRWSODQQHGIRULQ
PRVWLQGLYLGXDOWULDOV'XHWRVPDOOQXPEHUVRISDWLHQWVLQWKHVLQJOHVXEJURXSVVRPHRIWKHDQDO\VHVODFNWKH
VWDWLVWLFDOSRZHUWRGHWHFWDVVRFLDWLRQVRIVPDOOPDJQLWXGH/LNHZLVHGLUHFWFRPSDULVRQVRIWUHDWPHQWHIIHFWV
EHWZHHQVLQJOHVXEJURXSVQHHGWREHSUXGHQWO\DSSUHFLDWHGDVWKHUHPLJKWEHVXEVWDQWLDOFRQIRXQGLQJ3UREDEO\
WKHPRVWLPSRUWDQWILQGLQJZDVWKDWWKHEHQHILFLDOHIIHFWRISHULRSHUDWLYHFKHPRWKHUDS\RQRYHUDOOVXUYLYDOZDV
ODUJHO\FRQVLVWHQWDFURVVPRVWVXEJURXSVZKLFKVXSSRUWVWKHEURDGDSSOLFDWLRQRIWKLVPRGDOLW\LQSDWLHQWVZLWK
JDVWURHVRSKDJHDODGHQRFDUFLQRPD2IQRWHKRZHYHUDJHVKRZHGDQLQWHUDFWLRQZLWKWKHHIIHFWRISHULRSHUDWLYH
FKHPRWKHUDS\LQWKHPXOWLYDULDEOHDQDO\VLVZLWKWKHHIIHFWRQRYHUDOOVXUYLYDOEHLQJPXFKPRUHSURQRXQFHGLQ
SDWLHQWVRI\RXQJHUDJHDQGZLWKQRDSSDUHQWHIIHFWLQROGHUSDWLHQWV$OWKRXJKLWFDQQRWEHVKRZQZLWKRXUGDWD
WR[LFLW\PLJKWSOD\DQLPSRUWDQWUROHLQWKLVLQWHUDFWLRQ7KHILQGLQJVXSSRUWVWKHFRPPRQFOLQLFDOSUDFWLFHRI
FULWLFDOO\HYDOXDWLQJWKHGHFLVLRQIRUSHULRSHUDWLYHFKHPRWKHUDS\DERYHDFHUWDLQDJH2EYLRXVO\FKURQRORJLFDODJH
LVDPHUHSUR[\IRUELRORJLFDODJHDQGDSHUVRQ
VRYHUDOOKHDOWKVWDWXVDQGWKHUHVKRXOGQRWEHDQ\VWULFWDJHOLPLWV
UHJDUGLQJHOLJLELOLW\IRUSHULRSHUDWLYHFKHPRWKHUDS\
:LWKUHVSHFWWRWXPRUVLWHWKHWUHDWPHQWHIIHFWVHHPVWREHODUJHVWIRU*(MXQFWLRQWXPRUVIROORZHGE\HVRSKDJHDO
DQGJDVWULFWXPRUV2WKHUWKDQH[SHFWLQJSRWHQWLDOELDVLQKHUHQWWRWKHDQDO\WLFDODSSURDFKDQGH[SODLQHGDERYH
WKHVHUHVXOWVQHHGWREHLQWHUSUHWHGZLWKDGGLWLRQDOFDXWLRQEHFDXVHGLVWLQFWLRQRIWKHSUHFLVHWXPRUVLWHEHWZHHQ
GLVWDOHVRSKDJXV*(MXQFWLRQDQGSUR[LPDOVWRPDFKXVXDOO\GRQHDFFRUGLQJWRWKH6LHZHUWFODVVLILFDWLRQ6LHZHUW
LVVRPHWLPHVGLIILFXOWLQWKHSUHWKHUDSHXWLFVHWWLQJHVSHFLDOO\ZKHQHQGRVFRSLFFRQGLWLRQVDUHVXERSWLPDO
,QWKHGLIIHUHQWWULDOVLQFOXGHGLQRXUPHWDDQDO\VLVLQFOXVLRQFULWHULDDQGH[DFWFODVVLILFDWLRQRIWXPRUVLWHYDULHG
DQGZHUHQRWDOZD\VVSHFLILHGLQGHWDLOLQWKHUHVSHFWLYHSXEOLFDWLRQVZKLFKPLJKWLQWURGXFHDGGLWLRQDO
KHWHURJHQHLW\
5HJDUGLQJZKLFKVSHFLILFSHULRSHUDWLYHFKHPRWKHUDS\UHJLPHQLVPRVWHIIHFWLYHRXUPHWDDQDO\VLVFDQRQO\
SURYLGHOLPLWHGLQIRUPDWLRQ7KHYDVWPDMRULW\RILQFOXGHG5&7V$&&25'&$/*%(257&
)HQJ2(572*752*$*,7*8UED:DOVK=KDR
XVHGSODWLQXPEDVHGQRQDQWKUDF\FOLQHUHJLPHQVXVXDOO\DFRPELQDWLRQRI)8DQGFLVSODWLQLQYDU\LQJ
LQWHQVLW\7KHLUUHVXOWVZHUHYHU\KRPRJHQHRXV:LWKWKHH[FHSWLRQRIRQHWULDO752*$*,7*DOORIWKHVH
5&7V\LHOGHGDKD]DUGUDWLR+5VPDOOHUWKDQRQHZKLFKVSHDNVLQIDYRURIWKHHIILFDF\RIWKLVFRPELQDWLRQ2QH
ODUJHWULDO0$*,&DGGHGHSLUXELFLQWRWKH)8FLVSODWLQGRXEOHWZKLFK\LHOGHGDVOLJKWO\ORZHU+5
+RZHYHUVXFKDQLQGLUHFWFRPSDULVRQLVLQVXIILFLHQWWRVWDWHWKDWWKLVWULSOHWUHJLPHQLVLQGHHGPRUHHIIHFWLYH7KH
WZRVWXGLHVSUHRSHUDWLYHO\XVLQJRQO\DIOXRURXUDFLOGHULYDWH.RED\DVKL:DQJVKRZHGPL[HGUHVXOWV
EXWZHUHDOVRVPDOO7KHRQO\WULDOZKLFKXVHGDQDQWKUDF\FOLQHEDVHGQRQSODWLQXPUHJLPHQLH)$07;VKRZHGD
WUHQGWRZDUGVSRRUHUVXUYLYDOLQWKHLQWHUYHQWLRQDUPDQGZDVWKXVVWRSSHGHDUO\)$07;2QWKHVH
JURXQGVWKHUHJLPHQKDVEHHQGLVFDUGHGIRUIXUWKHUXVHLQJDVWURHVRSKDJHDODGHQRFDUFLQRPD5HFHQWO\WD[DQH
EDVHGVFKHPHVKDYHJDLQHGSRSXODULW\DOVRLQJDVWURHVRSKDJHDODGHQRFDUFLQRPD2QHRIWKHLQFOXGHG5&7V)HQJ
XVHGDFRPELQDWLRQRIGRFHWD[HOFLVSODWLQDQG)8DQG\LHOGHGD+5RI+RZHYHULWVVWDWLVWLFDOSRZHU
ZDVWRRVPDOOWRUHDFKVWDWLVWLFDOVLJQLILFDQFH$QRQJRLQJSKDVHWKUHHWULDO1&7FRPSDUHVWKH(&)
VFKHPHWKDWZDVXVHGLQWKH0$*,&WULDOWRWKHGRFHWD[HOEDVHG)/27VFKHPHZLWKSDWKRORJLFFRPSOHWHUHVSRQVH
DVSULPDU\HQGSRLQW7RZKDWH[WHQWWKHDGGLWLRQRISRVWRSHUDWLYHFKHPRWKHUDS\WRSUHRSHUDWLYHWUHDWPHQWLV
EHQHILFLDOPXVWUHPDLQRSHQ)LYHRIWKHLQFOXGHGWULDOV$&&25')HQJ.RED\DVKL
0$*,&572*IRUHVDZSRVWRSHUDWLYHFKHPRWKHUDS\7KHVXEJURXSFRPSDULVRQZLWKWULDOVLQ
ZKLFKSDWLHQWVZHUHWUHDWHGRQO\SUHRSHUDWLYHO\VKRZHGQRUHOHYDQWGLIIHUHQFHV,WPXVWEHQRWHGWKDWRQO\D
PLQRULW\RISDWLHQWVLQIDFWUHFHLYHGWKHSODQQHGSRVWRSHUDWLYHWUHDWPHQWWRLWVIXOOH[WHQW7KHUHIRUHLWVUROH
UHPDLQVGHEDWDEOH+RZHYHUVLQFHWZRODUJHSRVLWLYHWULDOV$&&25'0$*,&KDGXVHGD
WUHDWPHQWVFKHPHLQFOXGLQJSRVWRSHUDWLYHFKHPRWKHUDS\LWUHPDLQVFRPPRQFOLQLFDOSUDFWLFHWRRIIHUSRVWRSHUDWLYH
FRQWLQXDWLRQRIFKHPRWKHUDS\WRHOLJLEOHSDWLHQWV
,QWKHVXEJURXSDQDO\VLVRISHULRSHUDWLYHVFKHPHVZLWKRUZLWKRXWLQFOXVLRQRIUDGLRWKHUDS\WKHWUHDWPHQWHIIHFW
VHHPVWREHODUJHUIRUFRPELQHGFKHPRUDGLRWKHUDS\+RZHYHUDOOLQFOXGHGWULDOVXVLQJFKHPRUDGLRWKHUDS\
FRPSULVHGH[FOXVLYHO\SDWLHQWVZLWKHVRSKDJHDORU*(MXQFWLRQWXPRUVZKLFKLQHYLWDEO\OHDGVWRVXEVWDQWLDO
FRQIRXQGLQJ,QRXUPXOWLYDULDEOHPRGHOFKHPRUDGLRWKHUDS\LVQRWDVVRFLDWHGZLWKLPSURYHGRYHUDOOVXUYLYDO
FRPSDUHGWRVXUJHU\DORQH7KLVUHVXOWLVKRZHYHUEDVHGRQDVLQJOHQHJDWLYHWULDO752*$*,7*DQG
GLVUHJDUGVWKUHHSRVLWLYHWULDOVIURPZKLFKWKHYDULDEOHVUHTXLUHGIRUWKHPRGHOZHUHXQDYDLODEOH&$/*%
8UED:DOVKZKLFKPDNHVLWVLQWHUSUHWDWLRQGLIILFXOW$IWHUFORVXUHRIRXUGDWDEDVHWZRRWKHU
5&7VFRPSDULQJSUHRSHUDWLYHFKHPRUDGLRWKHUDS\IROORZHGE\VXUJHU\ZLWKVXUJHU\DORQHZHUHSXEOLVKHG7KH
&5266WULDOVKRZHGDVLJQLILFDQWVXUYLYDODGYDQWDJHLQWKHFKHPRUDGLRWKHUDS\DUPZLWKD+5RIIRUWKH
VXEJURXSRISDWLHQWVZLWKDGHQRFDUFLQRPDZKLFKPDGHXSIRURISDWLHQWVLQWKHWULDOYDQ+DJHQ7KH
))&'WULDOZKLFKKDVVRIDURQO\EHHQSXEOLVKHGLQDEVWUDFWIRUP0DULHWWHIRXQGQRVXUYLYDO
DGYDQWDJHIRUSDWLHQWVLQWKHFKHPRUDGLRWKHUDS\DUP+RZHYHULWGLGQRWLQFOXGH*(MXQFWLRQWXPRUVRI
SDWLHQWVKDGVTXDPRXVFHOOFDUFLQRPDDQGWZRWKLUGVRISDWLHQWVKDGDQRGHQHJDWLYHWXPRUVWDJH7KHUHIRUHWKH
LQWHUSUHWDWLRQRILWVUHVXOWVZLWKUHJDUGWRWKHVHWWLQJRIRXUPHWDDQDO\VLVORFRUHJLRQDOO\DGYDQFHG
JDVWURHVRSKDJHDODGHQRFDUFLQRPDLVGLIILFXOW
7RGHPRQVWUDWHVXSHULRULW\RIHLWKHUSHULRSHUDWLYHFKHPRUDGLRWKHUDS\RUFKHPRWKHUDS\ZDVQRWZLWKLQWKHVFRSHRI
WKLVPHWDDQDO\VLV7RGDWHWKHUHDUHRQO\WZRUDQGRPL]HGWULDOVGLUHFWO\FRPSDULQJWKHWZRPRGDOLWLHV
%XUPHLVWHU6WDKO%RWKWULDOVVWLSXODWHGFLVSODWLQEDVHGFKHPRWKHUDS\VFKHPHVLQFOXGHGHVRSKDJHDO
DQG*(MXQFWLRQWXPRUVDQGFORVHGHDUO\GXHWRVORZUHFUXLWPHQW,QD*HUPDQSKDVHWKUHHWULDO6WDKOWKH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
WDUJHWHGVWDWLVWLFDOSRZHUIRUDQDO\VLVRIWKHSULPDU\RXWFRPHRYHUDOOVXUYLYDOZDVQRWDFKLHYHG1RQHWKHOHVV
SDWLHQWVLQWKHFKHPRUDGLRWKHUDS\DUPRIWKHWULDOKDGDVXUYLYDODGYDQWDJHRIDWWKUHH\HDUVZLWKERUGHUOLQH
VWDWLVWLFDOVLJQLILFDQFH3 7KH$XVWUDOLDQWULDO%XUPHLVWHUZDVDUDQGRPL]HGSKDVHWZRWULDOZKLFK
SULPDULO\DVVHVVHGUHVSRQVHDQGWROHUDELOLW\1RVLJQLILFDQWVXUYLYDOGLIIHUHQFHVZHUHIRXQG2IQRWHERWKWULDOV
VKRZHGDPDUNHGO\KLJKHUOLNHOLKRRGRISDWKRORJLFDOUHVSRQVHLQWKHFKHPRUDGLRWKHUDS\JURXSV$UHFHQWPHWD
DQDO\VLVLQFOXGHGERWKWULDOVDQGXVHGVSHFLILFWHFKQLTXHVIRUDQLQGLUHFWFRPSDULVRQEHWZHHQSHULRSHUDWLYH
FKHPRWKHUDS\DQGFKHPRUDGLRWKHUDS\IRUHVRSKDJHDOFDUFLQRPDRIERWKKLVWRORJLFVXEW\SHV6MRTXLVW,W
VKRZHGDFRPELQHG+5RIZKLFKZDVERUGHUOLQHVLJQLILFDQW3 ,QVXPPDU\WKHDYDLODEOHHYLGHQFH
VXJJHVWVDEHQHILWIURPDGGLQJUDGLRWKHUDS\WRSHULRSHUDWLYHFKHPRWKHUDS\IRUDGHQRFDUFLQRPDRIWKHHVRSKDJXV
DQG*(MXQFWLRQ+RZHYHUGXHWROLPLWDWLRQVLQWKHHYLGHQFHOHYHOQRFOHDUFRQFOXVLRQFDQEHPDGHDQGIXUWKHU
5&7VGLUHFWO\FRPSDULQJWKHWZRPRGDOLWLHVDUHVWURQJO\UHTXLUHG7RZKDWH[WHQWSHULRSHUDWLYHFKHPRUDGLRWKHUDS\
PLJKWEHDQDSSURSULDWHWUHDWPHQWDOWHUQDWLYHIRUJDVWULFDGHQRFDUFLQRPDUHPDLQVDQRSHQTXHVWLRQDVWKHUHLVQR
KLJKHUOHYHOHYLGHQFH$QXPEHURISKDVHWZRWULDOVVKRZHGSURPLVLQJSDWKRORJLFUHVSRQVHUDWHVDQGDGHTXDWH
WROHUDELOLW\$MDQL$MDQL$MDQLEXWDVRIWRGD\WKHFRQFHSWKDVQRWEHHQLQYHVWLJDWHGLQSKDVH
WKUHHWULDOV
,QDPXOWLYDULDEOHDQDO\VLVZHDLPHGWRDVVHVVWKHLQGHSHQGHQWLQIOXHQFHRISHULRSHUDWLYHFKHPRWKHUDS\DQGRWKHU
FRYDULDWHVRQRYHUDOOVXUYLYDO,QWHUHVWLQJO\LQWKHILQDOPRGHOWKHHIIHFWRISHULRSHUDWLYHFKHPRWKHUDS\LVVOLJKWO\
GLPLQLVKHGLQLWVPDJQLWXGHDQGORVHVVWDWLVWLFDOVLJQLILFDQFH2WKHUIDFWRUVVSHFLILFDOO\WXPRUVLWHDJHDQG
SHUIRUPDQFHVWDWXVUHWDLQDVLJQLILFDQWHIIHFWRQRYHUDOOVXUYLYDO)URPDFOLQLFDOYLHZSRLQWWKLVLVYHU\SODXVLEOH
DQGLQWXLWLYH,WVKRXOGKRZHYHUQRWGHWHUIURPUHFRPPHQGLQJSHULRSHUDWLYHFKHPRWKHUDS\WRHOLJLEOHSDWLHQWVDV
WKHDFKLHYDEOHVXUYLYDOEHQHILWLVRIDKLJKO\UHOHYDQWPDJQLWXGHLQDGLVHDVHZLWKDVWLOOXQDFFHSWDEO\SRRU
RQFRORJLFDORXWFRPH
$SRROHGDQDO\VLVLQFOXGLQJDOOSDWLHQWVIRUZKRPUHVSHFWLYHLQIRUPDWLRQZDVDYDLODEOHVKRZHGWKDWSDWLHQWVZLWK5
DQG5UHVHFWLRQKDYHDVXEVWDQWLDOO\VKRUWHUVXUYLYDOWKDQWKRVHZLWKFRPSOHWHUHVHFWLRQ7KLVHPSKDVL]HVWKDW
PLFURVFRSLFDOO\FRPSOHWHUHVHFWLRQVKRXOGDOZD\VEHWKHJRDOZKHQSODQQLQJVXUJHU\LQDSDWLHQWZLWK
JDVWURHVRSKDJHDODGHQRFDUFLQRPD)RUSDWLHQWVLQZKRPFRPSOHWHUHVHFWLRQVHHPVGRXEWIXOEDVHGRQSUHRSHUDWLYH
VWDJLQJWKHLQGLFDWLRQIRUUHVHFWLRQPXVWEHFULWLFDOO\HYDOXDWHG*LYHQWKHQRQQHJOLJLEOHSRVWRSHUDWLYHPRUELGLW\
DQGWKHFRPPRQHDUO\SRVWRSHUDWLYHGHFUHDVHLQTXDOLW\RIOLIH'MDUY0XQHQHSDOOLDWLYHUHVHFWLRQ
VKRXOGEHUHVHUYHGIRUSDWLHQWVZLWKVXEVWDQWLDOWXPRUV\PSWRPVZKLFKFDQEHH[SHFWHGWRLPSURYHDIWHUVXUJHU\
3HULRSHUDWLYHFKHPRWKHUDS\FRPSHWHVZLWKH[FOXVLYHO\DGMXYDQWLHSRVWRSHUDWLYHWUHDWPHQWPRGDOLWLHVIRU
JDVWURHVRSKDJHDODGHQRFDUFLQRPD%RWKDGMXYDQWFKHPRWKHUDS\DQGFKHPRUDGLRWKHUDS\KDYHEHHQHYDOXDWHGLQ
UDQGRPL]HGWULDOV%DVHGRQSRVLWLYHUHVXOWVIURPDODUJHSKDVHWKUHHWULDO0DFGRQDOGDGMXYDQW
FKHPRUDGLRWKHUDS\IRUDGHQRFDUFLQRPDRIWKHVWRPDFKDQG*(MXQFWLRQKDVJDLQHGZLGHSRSXODULW\LQWKH8QLWHG
6WDWHV,Q(XURSHWKHPRGDOLW\KDVQRWEHHQZLGHO\DGRSWHGDVWKHWULDOLQFOXGHGDODUJHSURSRUWLRQRISDWLHQWV
ZKRKDGUHFHLYHGRQO\'O\PSKDGHQHFWRP\ZKLFKLVGHHPHGLQVXIILFLHQWDFFRUGLQJWR(XURSHDQVWDQGDUGV7KH
RQJRLQJ'XWFK6ZHGLVKPXOWLFHQWHU&5,7,&6WULDOHYDOXDWHVLIWKHDGGLWLRQRISRVWRSHUDWLYHFKHPRUDGLRWKHUDS\WR
SHULRSHUDWLYHFKHPRWKHUDS\FRQIHUVDVXUYLYDOEHQHILWLQDVHWWLQJZKHUHDKLJKUDWHRI'O\PSKDGHQHFWRPLHVLV
H[SHFWHG'LNNHQ$GMXYDQWFKHPRWKHUDS\LVWKHVWDQGDUGRIFDUHIRUDGYDQFHGJDVWULFDGHQRFDUFLQRPDLQ
$VLDZKHUHSUHRSHUDWLYHWUHDWPHQWLVXQFRPPRQ$UHFHQW,3'PHWDDQDO\VLVLQFOXGLQJ5&7VFRPSDULQJ
SRVWRSHUDWLYHFKHPRWKHUDS\ZLWKVXUJHU\DORQHIRUJDVWULFDGHQRFDUFLQRPDVKRZHGDEHQHILWLQ\HDU
RYHUDOOVXUYLYDOIRUSDWLHQWVUHFHLYLQJSRVWRSHUDWLYHFKHPRWKHUDS\3DROHWWL$VXIILFLHQWO\SRZHUHG
UDQGRPL]HGGLUHFWFRPSDULVRQEHWZHHQSUHRSHUDWLYHDQGSRVWRSHUDWLYHFKHPRWKHUDS\KDVQRWEHHQFRQGXFWHG
DQGWKXVVXSHULRULW\RIRQHRUWKHRWKHUPRGDOLW\FDQQRWEHGHGXFWHG2QHIDFWRURIWHQKDPSHULQJSRVWRSHUDWLYH
PRGDOLWLHVLQFOLQLFDOSUDFWLFHLVWKDWRQO\DVPDOOSHUFHQWDJHRIHOLJLEOHSDWLHQWVUHFHLYHWKHSODQQHGWKHUDS\PRVWO\
EHFDXVHRISRRUSHUIRUPDQFHVWDWXVRUORZFRPSOLDQFHLQWKHSRVWRSHUDWLYHSHULRGGXULQJZKLFKDGMXYDQWWUHDWPHQW
VKRXOGFRPPHQFH,QDSUHPDWXUHO\KDOWHG5&7FRPSDULQJSUHRSHUDWLYHZLWKSRVWRSHUDWLYHWD[DQHEDVHG
FKHPRWKHUDS\IRUJDVWULFDGHQRFDUFLQRPDSHUFHQWRISDWLHQWVUDQGRPL]HGIRUSUHRSHUDWLYHWUHDWPHQWUHFHLYHG
FKHPRWKHUDS\ZKHUHDVWKLVZDVWKHFDVHRQO\IRUSHUFHQWRISDWLHQWVUDQGRPL]HGIRUSRVWRSHUDWLYHWUHDWPHQW
%LIIL7KHH[WHQWRIWKLVSUREOHPLVHPSKDVL]HGE\RXUILQGLQJVZKLFKVKRZWKDWLQWKHWKUHHWULDOVVWLSXODWLQJ
SRVWRSHUDWLYHFKHPRWKHUDS\LQWKHLUSURWRFRORQO\WRSHUFHQWRISDWLHQWVDFWXDOO\UHFHLYHGDOOSODQQHG
F\FOHV&RQYHUVHO\RQHDUJXPHQWRIWHQUDLVHGDJDLQVWSUHRSHUDWLYHWUHDWPHQWQDPHO\WKHIHDURIHOHYDWHG
SRVWRSHUDWLYHPRUELGLW\LVQRWVXSSRUWHGE\RXUUHVXOWVZKLFKGRQRWVKRZDKLJKHUULVNRIFRPSOLFDWLRQVLQ
SUHWUHDWHGSDWLHQWV
7KHVWUHQJWKRIRXUPHWDDQDO\VLVLVLWVULJRURXVPHWKRGRORJ\%\DGKHULQJWR&RFKUDQHVWDQGDUGVZHDUH
FRQILGHQWWKDWDOODYDLODEOHVWXGLHVPHHWLQJRXULQFOXVLRQFULWHULDKDYHEHHQLGHQWLILHGDQGLQFOXGHGLQWKHDQDO\VHV
:HLQFOXGHGRQO\5&7VLQRXUPHWDDQDO\VLVZKLFKUHVXOWVLQWKHKLJKHVWSRVVLEOHHYLGHQFHOHYHO,3'PHWDDQDO\VLV
LVFRQVLGHUHGWRKDYHQXPHURXVDGYDQWDJHVRYHUPHWDDQDO\VLVRIDJJUHJDWHGDWD5LOH\,WDOORZVIRU
XQLIRUPLQFOXVLRQFULWHULDDFURVVWULDOVWRYHULI\GDWDFRQVLVWHQF\DQGWRXVHXSGDWHGIROORZXSGDWDIURPWKHVLQJOH
WULDOV0RVWLPSRUWDQWO\LQRXUVSHFLILFFDVHWKHDYDLODELOLW\RI,3'HQDEOHGXVWRLQFOXGHSDWLHQWVZLWK
DGHQRFDUFLQRPDIURPWULDOVZLWKFDUFLQRPDVRIPL[HGKLVWRORJ\LQRXUPHWDDQDO\VLVRIWKHSULPDU\DQGVHFRQGDU\
RXWFRPHVDVZHOODVLQWKHVXEJURXSDQDO\VHV&$/*%572*8UED:HVROLFLWHG
,3'IURPDOOWULDOLVWVDQGUHSHDWHGO\IROORZHGXSRXUUHTXHVWVLQFDVHRIQRRUHYDVLYHUHSO\%\GRLQJVRZHZHUH
DEOHWRUHFHLYH,3'IURPDERXWSHUFHQWRIWULDOV8QIRUWXQDWHO\ZHZHUHXQDEOHWRREWDLQ,3'IURPWKHWZR
ODUJHVWWULDOV0$*,&2(DQGWKXV,3'ZHUHDYDLODEOHIRURQO\DERXWSHUFHQWRISDWLHQWV7KLV
UDWKHUORZ\LHOGVHHPVDWILUVWGLVDSSRLQWLQJEXWLVDSUREOHPQRWXQIDPLOLDUWR,3'PHWDDQDO\VWV,QVWHDGRI
OLPLWLQJRXUDQDO\VHVWRWULDOVZKLFKKDGSURYLGHG,3'ZHFKRVHWRFRPELQH,3'DQGDJJUHJDWHGDWDZLWKWKHVR
FDOOHGWZRVWDJHPHWKRG5LOH\:HEHOLHYHWKDWWKLVDSSURDFKGUDZVWKHPRVWFRPSUHKHQVLYHSLFWXUHE\
LQFRUSRUDWLQJDOODYDLODEOHHYLGHQFHDQGOHQGLQJVXIILFLHQWVWDWLVWLFDOSRZHUWRWKHDQDO\VHV$VHQVLWLYLW\DQDO\VLV
VKRZHGWKDWWKHUHZHUHQRWDQJLEOHGLIIHUHQFHVZKHQDQDO\]LQJ,3'DQGDJJUHJDWHGDWDVHSDUDWHO\ZKLFKVXSSRUWV
WKHXVHRIWKHWZRVWDJHPHWKRGLQWKLVFDVH

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
,QFOXGLQJWULDOVRQSDWLHQWVZLWKDGHQRFDUFLQRPDRIWKUHHDQDWRPLFDOO\GLIIHUHQWORFDWLRQVHVRSKDJXV*(MXQFWLRQ
DQGVWRPDFKLQWRRQHMRLQWPHWDDQDO\VLVEHDUVDULVNRIKHWHURJHQHLW\7KLVULVNLVDXJPHQWHGE\WKHIDFWWKDW
VXUJLFDODSSURDFKHVDUHGLIIHUHQWEHWZHHQVWRPDFK*(MXQFWLRQDQGHVRSKDJHDOWXPRUVDQGWKDWSDUWLFXODUO\IRU
*(MXQFWLRQDQGHVRSKDJHDOWXPRUVVXUJLFDOWHFKQLTXHVGLIIHUHGYDVWO\EHWZHHQWULDOVDQGHYHQEHWZHHQ
SDUWLFLSDWLQJFHQWHUVRUVLQJOHSDWLHQWVZLWKLQVSHFLILFWULDOV6LPLODUO\WKHGHILQLWLRQVXVHGIRUVWUDWLI\LQJWXPRUVLQWR
GLIIHUHQWORFDWLRQVHVRSKDJXV*(MXQFWLRQVWRPDFKGLIIHUHGEHWZHHQWULDOV7KHUHIRUHDOWKRXJKVWDWLVWLFDO
KHWHURJHQHLW\ZDVUDWKHUORZIRUPRVWRXWFRPHVDQGVXEJURXSDQDO\VHVWKHUHPLJKWEHUHOHYDQWFOLQLFDO
KHWHURJHQHLW\,QIDFWRXUUHVXOWVVXJJHVWWUHDWPHQWHIIHFWVGLIIHUEHWZHHQWKHWKUHHWXPRUORFDWLRQV1HYHUWKHOHVV
JLYHQWKDWJDVWURHVRSKDJHDODGHQRFDUFLQRPDLVIUHTXHQWO\WUHDWHGDFFRUGLQJWRWKHVDPHFKHPRWKHUDSHXWLFDO
SURWRFROLUUHVSHFWLYHRIWKHH[DFWWXPRUORFDWLRQZHGHHPLWDYDOLGDSSURDFKWRLQFOXGHDOOWXPRUORFDWLRQVLQWRRQH
MRLQWPHWDDQDO\VLV7KLVDSSURDFKLVVXSSRUWHGE\WKHILQGLQJWKDWWXPRUVLWHGRHVQRWSUHGLFWVXUYLYDORXWFRPHIRU
SDWLHQWVZLWKJDVWURHVRSKDJHDODGHQRFDUFLQRPDWUHDWHGZLWKFKHPRWKHUDS\LQWKHSDOOLDWLYHVHWWLQJ&KDX
7KHVXEJURXSDQDO\VLVZHFRQGXFWHGKHOSVLQLGHQWLI\LQJSDWLHQWSRSXODWLRQVLQZKLFKWUHDWPHQWHIIHFWVDUH
SDUWLFXODUO\SURQRXQFHGRUGLPLQLVKHG

$87+ 256
&21&/86 ,216

,PSOLFDWLRQVIRUSUDFWLFH

3HULRSHUDWLYHFKHPRWKHUDS\DQGFKHPRUDGLRWKHUDS\DSSHDUWROHDGWRSURORQJHGVXUYLYDOLQSDWLHQWVZLWK
JDVWURHVRSKDJHDODGHQRFDUFLQRPD,WVKRXOGWKXVEHFRQVLGHUHGVWDQGDUGRIFDUHDQGRIIHUHGWRDOOHOLJLEOH
SDWLHQWV7KHUHLVDWUHQGWRDODUJHUVXUYLYDODGYDQWDJHIRUWXPRUVRIWKHJDVWURHVRSKDJHDOMXQFWLRQDVFRPSDUHG
WRRWKHUVLWHVDQGIRUFKHPRUDGLRWKHUDS\DVFRPSDUHGWRFKHPRWKHUDS\/LNHZLVHWKHUHLVDQLQWHUDFWLRQEHWZHHQ
DJHDQGWUHDWPHQWHIIHFWZLWK\RXQJHUSDWLHQWVH[SHULHQFLQJDODUJHUVXUYLYDODGYDQWDJHDQGQRVXUYLYDO
DGYDQWDJHIRUHOGHUO\SDWLHQWV)HDUVRIHOHYDWHGSRVWRSHUDWLYHPRUELGLW\DQGPRUWDOLW\IROORZLQJSHULRSHUDWLYH
FKHPRWKHUDS\GRQRWVHHPWREHMXVWLILHG

,PSOLFDWLRQVIRUUHVHDUFK

7KHUHVXOWVRIRXUVXEJURXSDQDO\VHVVXFKDVWKHPRUHSURQRXQFHGVXUYLYDODGYDQWDJHIRXQGIRUWXPRUVRIWKH
JDVWURHVRSKDJHDOMXQFWLRQDVFRPSDUHGWRRWKHUVLWHVLQ\RXQJHUSDWLHQWVFRPSDUHGWRROGHURQHVDQGIRU
FKHPRUDGLRWKHUDS\FRPSDUHGWRFKHPRWKHUDS\QHHGWREHYDOLGDWHGLQSURVSHFWLYHWULDOV

$&.12:/('*(0(176

$FNQRZOHGJHPHQWV

:HWKDQN-HDQ3LHUUH3LJQRQ0HWD$QDO\VLV8QLW'HSDUWPHQWRI%LRVWDWLVWLFVDQG(SLGHPLRORJ\,QVWLWXWGH
&DQFpURORJLH*XVWDYH5RXVV\9LOOHMXLI)UDQFHIRUUHYLHZLQJRXUSURWRFRODQGJLYLQJYDOXDEOHVWDWLVWLFDODGYLFH

127(6

5()(5(1&(6

5HIHUHQFHVWRVWXGLHVLQFOXGHGLQWKLVUHYLHZ
$&&25'^SXEOLVKHGGDWDRQO\`

<FKRX0%RLJH93LJQRQ-3&RQUR\7%RXFKH2/HEUHWRQ*3HULRSHUDWLYHFKHPRWKHUDS\
FRPSDUHGZLWKVXUJHU\DORQHIRUUHVHFWDEOHJDVWURHVRSKDJHDODGHQRFDUFLQRPDDQ)1&/&&DQG))&'
PXOWLFHQWHUSKDVH,,,WULDO-RXUQDORI&OLQLFDO2QFRORJ\

&$/*%^SXEOLVKHGGDWDRQO\`

7HSSHU-.UDVQD0-1LHG]ZLHFNL'+ROOLV'5HHG&(*ROGEHUJ53KDVH,,,WULDORIWULPRGDOLW\
WKHUDS\ZLWKFLVSODWLQIOXRURXUDFLOUDGLRWKHUDS\DQGVXUJHU\FRPSDUHGZLWKVXUJHU\DORQHIRU
HVRSKDJHDOFDQFHU&$/*%-RXUQDORI&OLQLFDO2QFRORJ\

(257&^SXEOLVKHGGDWDRQO\`

6FKXKPDFKHU&*UHWVFKHO6/RUGLFN)5HLFKDUGW3+RKHQEHUJHU:(LVHQEHUJHU&)1HRDGMXYDQW
FKHPRWKHUDS\FRPSDUHGZLWKVXUJHU\DORQHIRUORFDOO\DGYDQFHGFDQFHURIWKHVWRPDFKDQGFDUGLD
(XURSHDQ2UJDQLVDWLRQIRU5HVHDUFKDQG7UHDWPHQWRI&DQFHUUDQGRPL]HGWULDO-RXUQDORI
&OLQLFDO2QFRORJ\

)$07;^SXEOLVKHGGDWDRQO\`

+DUWJULQN++YDQGH9HOGH&-3XWWHU+6RQJXQ,7HVVHODDU0(.UDQHQEDUJ(.1HRDGMXYDQW
FKHPRWKHUDS\IRURSHUDEOHJDVWULFFDQFHUORQJWHUPUHVXOWVRIWKH'XWFKUDQGRPLVHG)$07;WULDO
(XURSHDQ-RXUQDORI6XUJLFDO2QFRORJ\

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
)HQJ^SXEOLVKHGGDWDRQO\`

)HQJ/0/L*6XQ;&=KX6*7UHDWPHQWRXWFRPHRIQHRDGMXYDQWFKHPRWKHUDS\IRU%RUPDQQ
V
W\SH,9JDVWULFFDQFHU&KLQHVH-RXUQDORI&DQFHU3UHYHQWLRQDQG7UHDWPHQW

.RED\DVKL^SXEOLVKHGGDWDRQO\`

.RED\DVKL7/RQJWHUPRXWFRPHRISUHRSHUDWLYHFKHPRWKHUDS\ZLWK
GHR[\IOXRURXULGLQH

')85IRUJDVWULFFDQFHU*DQWR.DJDNX5\RKR

0$*,&^SXEOLVKHGGDWDRQO\`

&XQQLQJKDP'$OOXP:+6WHQQLQJ637KRPSVRQ-19HOGH&-1LFROVRQ03HULRSHUDWLYH
FKHPRWKHUDS\YHUVXVVXUJHU\DORQHIRUUHVHFWDEOHJDVWURHVRSKDJHDOFDQFHU1HZ(QJODQG-RXUQDORI
0HGLFLQH

2(^SXEOLVKHGGDWDRQO\`

$OOXP:+6WHQQLQJ63%DQFHZLF]-&ODUN3,/DQJOH\5(/RQJWHUPUHVXOWVRIDUDQGRPL]HGWULDORI
VXUJHU\ZLWKRUZLWKRXWSUHRSHUDWLYHFKHPRWKHUDS\LQHVRSKDJHDOFDQFHU-RXUQDORI&OLQLFDO
2QFRORJ\

572*^SXEOLVKHGGDWDRQO\`

.HOVHQ'3:LQWHU.$*XQGHUVRQ//0RUWLPHU-(VWHV1&+DOOHU'*/RQJWHUPUHVXOWVRI572*WULDO
86$,QWHUJURXSDUDQGRPDVVLJQPHQWWULDOFRPSDULVRQRIFKHPRWKHUDS\IROORZHGE\
VXUJHU\FRPSDUHGZLWKVXUJHU\DORQHIRUHVRSKDJHDOFDQFHU-RXUQDORI&OLQLFDO2QFRORJ\


752*$*,7*^SXEOLVKHGGDWDRQO\`

%XUPHLVWHU%+6PLWKHUV%0*HEVNL9)LW]JHUDOG/6LPHV5-'HYLWW36XUJHU\DORQHYHUVXV
FKHPRUDGLRWKHUDS\IROORZHGE\VXUJHU\IRUUHVHFWDEOHFDQFHURIWKHRHVRSKDJXVDUDQGRPLVHG
FRQWUROOHGSKDVH,,,WULDO/DQFHW2QFRORJ\

8UED^SXEOLVKHGGDWDRQO\`

8UED6*2UULQJHU0%7XUULVL$,DQQHWWRQL0)RUDVWLHUH$6WUDZGHUPDQ05DQGRPL]HGWULDORI
SUHRSHUDWLYHFKHPRUDGLDWLRQYHUVXVVXUJHU\DORQHLQSDWLHQWVZLWKORFRUHJLRQDOHVRSKDJHDO
FDUFLQRPD-RXUQDORI&OLQLFDO2QFRORJ\

:DOVK^SXEOLVKHGGDWDRQO\`

:DOVK71*UHQQHOO00DQVRRU6.HOO\$1HRDGMXYDQWWUHDWPHQWRIDGYDQFHGVWDJHHVRSKDJHDO
DGHQRFDUFLQRPDLQFUHDVHVVXUYLYDO'LVHDVHVRIWKH(VRSKDJXV

:DQJ^SXEOLVKHGGDWDRQO\`

:DQJ;/:X*;=KDQJ0'*XR0=KDQJ+6XQ;)$IDYRUDEOHLPSDFWRISUHRSHUDWLYH)3/&
FKHPRWKHUDS\RQSDWLHQWVZLWKJDVWULFFDUGLDFDQFHU2QFRORJ\5HSRUWV

=KDR^SXEOLVKHGGDWDRQO\`

=KDR:+:DQJ6)'LQJ:6KHQJ-00D=07HQJ/6$SRSWRVLVLQGXFHGE\SUHRSHUDWLYHRUDO

')85DGPLQLVWUDWLRQLQJDVWULFDGHQRFDUFLQRPDDQGLWVPHFKDQLVPRIDFWLRQ:RUOG-RXUQDORI
*DVWURHQWHURORJ\

LQGLFDWHVWKHPDMRUSXEOLFDWLRQIRUWKHVWXG\
5HIHUHQFHVWRVWXGLHVH[FOXGHGIURPWKLVUHYLHZ
%RNK\DQ^SXEOLVKHGGDWDRQO\`

%RNK\DQ96WLOLGL,0DOLNKRYD27U\DNLQ$1HRDGMXYDQWFKHPRWKHUDS\IROORZHGE\WUDQVWKRUDFLF
UHVHFWLRQIRUORFDOO\DGYDQFHGFDUFLQRPDRIWKHHVRSKDJXV$UDQGRPL]HGVWXG\

)XUORQJ^SXEOLVKHGGDWDRQO\`

)XUORQJ+*LODQL1$WLH0%DVV*0XOOLJDQ(.HHOLQJ1,VWKHVKRUWWHUPVXUYLYDODGYDQWDJHIRU
QHRDGMXYDQWFKHPRUDGLRWKHUDS\LQRHVRSKDJHDOFDQFHUVXVWDLQHG"/RQJWHUPIROORZXSRIWZR
UDQGRPLVHGWULDOV$

-LQ^SXEOLVKHGGDWDRQO\`

-LQ0*-LDQJ6&&KHQ=::DQJ=4&OLQLFDOWULDORISUHRSHUDWLYHFRQFXUUHQWFKHPRUDGLDWLRQ
IROORZHGE\VXUJHU\YHUVXVVXUJHU\DORQHIRUDGYDQFHGHVRSKDJHDOFDUFLQRPD&KLQHVH-RXUQDORI
&DQFHU3UHYHQWLRQDQG7UHDWPHQW

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
-LQ^SXEOLVKHGGDWDRQO\`

-LQ)/+X=/0D+)7UHDWPHQWHIIHFWRIQHRDGMXYDQWFKHPRUDGLRWKHUDS\IROORZHGE\VXUJHU\YHUVXV
VXUJHU\DORQHLQORFDODGYDQFHGHVRSKDJHDOFDUFLQRPD

0DULHWWH^SXEOLVKHGGDWDRQO\`

0DULHWWH&6HLW]-)0DLOODUG(0RUQH[)7KRPDV3$5DRXO-6XUJHU\DORQHYHUVXV
FKHPRUDGLRWKHUDS\IROORZHGE\VXUJHU\IRUORFDOL]HGHVRSKDJHDOFDQFHU$QDO\VLVRIDUDQGRPL]HG
FRQWUROOHGSKDVH,,,WULDO))&'$6&20HHWLQJ$EVWUDFWV

3RNDWDHY^SXEOLVKHGGDWDRQO\`

3RNDWDHY,7U\DNLQ$6WLOLGL,.RQRQHWV33RORWVNL\%0DOLNKRYD23UHRSHUDWLYHFKHPRWKHUDS\
IROORZHGE\VXUJHU\YHUVXVVXUJHU\DORQHLQUHVHFWDEOHHVRSKDJHDOFDQFHU$VLQJOHLQVWLWXWHSKDVH
,,,75,$/YLLL

YDQ+DJHQ^SXEOLVKHGGDWDRQO\`

+DJHQ3+XOVKRI0&&0/DQVFKRW--%6WH\HUEHUJ(:+HQHJRXZHQ0,:LMQKRYHQ%3/3UHRSHUDWLYH
FKHPRUDGLRWKHUDS\IRUHVRSKDJHDORUMXQFWLRQDOFDQFHU1HZ(QJODQG-RXUQDORI0HGLFLQH


$GGLWLRQDOUHIHUHQFHV
$MDQL

$MDQL-$0D\HU5-2WD'06WHHOH*'(YDQV'5RK03UHRSHUDWLYHDQGSRVWRSHUDWLYHFRPELQDWLRQ
FKHPRWKHUDS\IRUSRWHQWLDOO\UHVHFWDEOHJDVWULFFDUFLQRPD-RXUQDORIWKH1DWLRQDO&DQFHU,QVWLWXWH


$MDQL

$MDQL-$0DQVILHOG3)2WD'03RWHQWLDOO\UHVHFWDEOHJDVWULFFDUFLQRPDFXUUHQWDSSURDFKHVWR
VWDJLQJDQGSUHRSHUDWLYHWKHUDS\:RUOG-RXUQDORI6XUJHU\

$MDQL

$MDQL-$0DQVILHOG3)-DQMDQ10RUULV-3LVWHUV3:/\QFK300XOWLLQVWLWXWLRQDOWULDORI
SUHRSHUDWLYHFKHPRUDGLRWKHUDS\LQSDWLHQWVZLWKSRWHQWLDOO\UHVHFWDEOHJDVWULFFDUFLQRPD-RXUQDORI
&OLQLFDO2QFRORJ\

$MDQL

$MDQL-$0DQVILHOG3)&UDQH&+:X77/XQDJRPH]6/\QFK303DFOLWD[HOEDVHG
FKHPRUDGLRWKHUDS\LQORFDOL]HGJDVWULFFDUFLQRPDGHJUHHRISDWKRORJLFUHVSRQVHDQGQRWFOLQLFDO
SDUDPHWHUVGLFWDWHGSDWLHQWRXWFRPH-RXUQDORI&OLQLFDO2QFRORJ\

$MDQL

$MDQL-$:LQWHU.2NDZDUD*6'RQRKXH-+3LVWHUV3:&UDQH&+3KDVH,,WULDORISUHRSHUDWLYH
FKHPRUDGLDWLRQLQSDWLHQWVZLWKORFDOL]HGJDVWULFDGHQRFDUFLQRPD572*TXDOLW\RIFRPELQHG
PRGDOLW\WKHUDS\DQGSDWKRORJLFUHVSRQVH-RXUQDORI&OLQLFDO2QFRORJ\

%HJJ

%HJJ&%0D]XPGDU02SHUDWLQJFKDUDFWHULVWLFVRIDUDQNFRUUHODWLRQWHVWIRUSXEOLFDWLRQELDV
%LRPHWULFV

%LIIL

%LIIL5)D]LR1/XFD)&KLDSSD$$QGUHRQL%=DPSLQR0*6XUJLFDORXWFRPHDIWHUGRFHWD[HOEDVHG
QHRDGMXYDQWFKHPRWKHUDS\LQORFDOO\DGYDQFHGJDVWULFFDQFHU:RUOG-RXUQDORI*DVWURHQWHURORJ\


%XUPHLVWHU

%XUPHLVWHU%+7KRPDV-0%XUPHLVWHU($:DOSROH(7+DUYH\-$7KRPVRQ'%,VFRQFXUUHQW
UDGLDWLRQWKHUDS\UHTXLUHGLQSDWLHQWVUHFHLYLQJSUHRSHUDWLYHFKHPRWKHUDS\IRUDGHQRFDUFLQRPDRI
WKHRHVRSKDJXV"$UDQGRPLVHGSKDVH,,WULDO(XURSHDQ-RXUQDORI&DQFHU

&KDX

&KDX,1RUPDQ$5&XQQLQJKDP':DWHUV-62DWHV-5RVV3-0XOWLYDULDWHSURJQRVWLFIDFWRU
DQDO\VLVLQORFDOO\DGYDQFHGDQGPHWDVWDWLFHVRSKDJRJDVWULFFDQFHUSRROHGDQDO\VLVIURPWKUHH
PXOWLFHQWHUUDQGRPL]HGFRQWUROOHGWULDOVXVLQJLQGLYLGXDOSDWLHQWGDWD-RXUQDORI&OLQLFDO2QFRORJ\

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&


&KDX

&KDX,1RUPDQ$5&XQQLQJKDP'2DWHV-+DZNLQV5,YHVRQ77KHLPSDFWRISULPDU\WXPRXU
RULJLQVLQSDWLHQWVZLWKDGYDQFHGRHVRSKDJHDORHVRSKDJRJDVWULFMXQFWLRQDQGJDVWULF
DGHQRFDUFLQRPDLQGLYLGXDOSDWLHQWGDWDIURPSDWLHQWVLQIRXUUDQGRPLVHGFRQWUROOHGWULDOV
$QQDOVRI2QFRORJ\

'H0HHVWHU

'H0HHVWHU65$GHQRFDUFLQRPDRIWKHHVRSKDJXVDQGFDUGLDDUHYLHZRIWKHGLVHDVHDQGLWV
WUHDWPHQW$QQDOVRI6XUJLFDO2QFRORJ\

'LNNHQ

'LNNHQ-/6DQGLFN-:0DXULWV6ZHOOHQJUHEHO+$/LQG3$3XWWHU+-DQVHQ(31HRDGMXYDQW
FKHPRWKHUDS\IROORZHGE\VXUJHU\DQGFKHPRWKHUDS\RUE\VXUJHU\DQGFKHPRUDGLRWKHUDS\IRU
SDWLHQWVZLWKUHVHFWDEOHJDVWULFFDQFHU&5,7,&6%0&&DQFHU

'MDUY

'MDUY70HWFDOIH&$YHU\.1/DJHUJUHQ3%OD]HE\-03URJQRVWLFYDOXHRIFKDQJHVLQKHDOWK
UHODWHGTXDOLW\RIOLIHVFRUHVGXULQJFXUDWLYHWUHDWPHQWIRUHVRSKDJRJDVWULFFDQFHU-RXUQDORI&OLQLFDO
2QFRORJ\

'MDUY

'MDUY7/DJHUJUHQ34XDOLW\RIOLIHDIWHUHVRSKDJHFWRP\IRUFDQFHU([SHUW5HYLHZRI
*DVWURHQWHURORJ\DQG+HSDWRORJ\

(JJHU

(JJHU0'DYH\6*6FKQHLGHU00LQGHU&%LDVLQPHWDDQDO\VLVGHWHFWHGE\DVLPSOHJUDSKLFDO
WHVW%0-

(JXFKL

(JXFKL7.RGHUD<1DNDQLVKL+<RNR\DPD+2KDVKL1,WR<7KHHIIHFWRIFKHPRWKHUDS\DJDLQVW
PLFURPHWDVWDVHVDQGLVRODWHGWXPRUFHOOVLQO\PSKQRGHVDQLQYLYRVWXG\,Q9LYR

)HUOD\

)HUOD\-6KLQ+5%UD\))RUPDQ'0DWKHUV&3DUNLQ'0(VWLPDWHVRIZRUOGZLGHEXUGHQRIFDQFHU
LQ*/2%2&$1,QWHUQDWLRQDO-RXUQDORI&DQFHU

)LVKHU

)LVKHU'-&RSDV$-7LHUQH\-)3DUPDU0.%$FULWLFDOUHYLHZRIPHWKRGVIRUWKHDVVHVVPHQWRI
SDWLHQWOHYHOLQWHUDFWLRQVLQLQGLYLGXDOSDUWLFLSDQWGDWDPHWDDQDO\VLVRIUDQGRPL]HGWULDOVDQG
JXLGDQFHIRUSUDFWLWLRQHUV-RXUQDORI&OLQLFDO(SLGHPLRORJ\

)RUPDQ

)RUPDQ'%XUOH\9-*DVWULFFDQFHUJOREDOSDWWHUQRIWKHGLVHDVHDQGDQRYHUYLHZRIHQYLURQPHQWDO
ULVNIDFWRUV%HVW3UDFWLFHDQG5HVHDUFK&OLQLFDO*DVWURHQWHURORJ\

*DOOR

*DOOR$&KD&8SGDWHVRQHVRSKDJHDODQGJDVWULFFDQFHUV:RUOG-RXUQDORI*DVWURHQWHURORJ\


+DJHQ

+DJHQ-$'H0HHVWHU653HWHUV-+&KDQGUDVRPD3'H0HHVWHU75&XUDWLYHUHVHFWLRQIRU
HVRSKDJHDODGHQRFDUFLQRPDDQDO\VLVRIHQEORFHVRSKDJHFWRPLHV$QQDOVRI6XUJHU\


+LJJLQV

+LJJLQV-37*UHHQ6HGLWRUV&RFKUDQH+DQGERRNIRU6\VWHPDWLF5HYLHZVRI,QWHUYHQWLRQV9HUVLRQ

>XSGDWHG0DUFK@7KH&RFKUDQH&ROODERUDWLRQ

.HOVHQ

.HOVHQ'3$GMXYDQWDQGQHRDGMXYDQWWKHUDS\IRUJDVWULFFDQFHU6HPLQDUVLQ2QFRORJ\

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&


0DFGRQDOG

0DFGRQDOG-66PDOOH\65%HQHGHWWL-+XQGDKO6$(VWHV1&6WHPPHUPDQQ*1
&KHPRUDGLRWKHUDS\DIWHUVXUJHU\FRPSDUHGZLWKVXUJHU\DORQHIRUDGHQRFDUFLQRPDRIWKHVWRPDFK
RUJDVWURHVRSKDJHDOMXQFWLRQ1HZ(QJODQG-RXUQDORI0HGLFLQH

0DOWKDQHU

0DOWKDQHU5$:RQJ5.5XPEOH5%=XUDZ/1HRDGMXYDQWRUDGMXYDQWWKHUDS\IRUUHVHFWDEOH
HVRSKDJHDOFDQFHUDV\VWHPDWLFUHYLHZDQGPHWDDQDO\VLV%0&0HGLFLQH

0DUVPDQ

0DUVPDQ:$7\WJDW*1.DWH)-/DQVFKRW--'LIIHUHQFHVDQGVLPLODULWLHVRIDGHQRFDUFLQRPDVRIWKH
HVRSKDJXVDQGHVRSKDJRJDVWULFMXQFWLRQ-RXUQDORI6XUJLFDO2QFRORJ\

0F&XOORFK

0F&XOORFK3:DUG-7HNNLV330RUWDOLW\DQGPRUELGLW\LQJDVWURRHVRSKDJHDOFDQFHUVXUJHU\LQLWLDO
UHVXOWVRI$6&27PXOWLFHQWUHSURVSHFWLYHFRKRUWVWXG\%0-&OLQLFDOUHVHDUFKHG

0XQHQH

0XQHQH*)UDQFLV:*DUODQG613HOOHWLHU*0DFN/$%DWKH2)7KHTXDOLW\RIOLIHWUDMHFWRU\RI
UHVHFWHGJDVWULFFDQFHU-RXUQDORI6XUJLFDO2QFRORJ\

2WW

2WW.6HQGOHU$%HFNHU.'LWWOHU+-+HOPEHUJHU+%XVFK51HRDGMXYDQWFKHPRWKHUDS\ZLWK
FLVSODWLQ)8DQGOHXFRYRULQ3/)LQORFDOO\DGYDQFHGJDVWULFFDQFHUDSURVSHFWLYHSKDVH,,VWXG\
*DVWULF&DQFHU

3DROHWWL

3DROHWWL;2ED.%XU]\NRZVNL70LFKLHOV62KDVKL<3LJQRQ-3%HQHILWRIDGMXYDQWFKHPRWKHUDS\
IRUUHVHFWDEOHJDVWULFFDQFHUDPHWDDQDO\VLV-$0$

3DUPDU

3DUPDU0.7RUUL96WHZDUW/([WUDFWLQJVXPPDU\VWDWLVWLFVWRSHUIRUPPHWDDQDO\VHVRIWKH
SXEOLVKHGOLWHUDWXUHIRUVXUYLYDOHQGSRLQWV6WDWLVWLFVLQ0HGLFLQH

3HWHUV

3HWHUV-/6XWWRQ$--RQHV'5$EUDPV.55XVKWRQ/&RPSDULVRQRIWZRPHWKRGVWRGHWHFW
SXEOLFDWLRQELDVLQPHWDDQDO\VLV-$0$

3LJQRQ

3LJQRQ-3+LOO&0HWDDQDO\VHVRIUDQGRPLVHGFOLQLFDOWULDOVLQRQFRORJ\/DQFHW

5

5

5HY0DQ

5HYLHZ0DQDJHU5HY0DQ

5LOH\

5LOH\5'6LPPRQGV0&/RRN03(YLGHQFHV\QWKHVLVFRPELQLQJLQGLYLGXDOSDWLHQWGDWDDQG
DJJUHJDWHGDWDDV\VWHPDWLFUHYLHZLGHQWLILHGFXUUHQWSUDFWLFHDQGSRVVLEOHPHWKRGV-RXUQDORI
&OLQLFDO(SLGHPLRORJ\

5LOH\

5LOH\5'/DPEHUW3&$ER=DLG*0HWDDQDO\VLVRILQGLYLGXDOSDUWLFLSDQWGDWDUDWLRQDOHFRQGXFW
DQGUHSRUWLQJ%0-F

6$6

6$6

6FKHPSHU

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
6FKHPSHU06PLWK7/$QRWHRQTXDQWLI\LQJIROORZXSLQVWXGLHVRIIDLOXUHWLPH&RQWUROOHG&OLQLFDO
7ULDOV

6KDK

6KDK0$.KDQLQ57DQJ/-DQMLJLDQ<<.OLPVWUD'6*HUGHV+0ROHFXODUFODVVLILFDWLRQRIJDVWULF
FDQFHUDQHZSDUDGLJP&OLQLFDO&DQFHU5HVHDUFK

6LHZHUW

6LHZHUW-5+ROVFKHU$+%HFNHU.*RVVQHU:&DUGLDFDQFHUDWWHPSWDWDWKHUDSHXWLFDOO\UHOHYDQW
FODVVLILFDWLRQ&KLUXUJ

6LHZHUW

6LHZHUW-5%RWWFKHU.6WHLQ+-5RGHU-'5HOHYDQWSURJQRVWLFIDFWRUVLQJDVWULFFDQFHUWHQ\HDU
UHVXOWVRIWKH*HUPDQ*DVWULF&DQFHU6WXG\$QQDOVRI6XUJHU\

6MRTXLVW

6MRTXLVW.0%XUPHLVWHU%+6PLWKHUV%0=DOFEHUJ-56LPHV5-%DUERXU$6XUYLYDODIWHU
QHRDGMXYDQWFKHPRWKHUDS\RUFKHPRUDGLRWKHUDS\IRUUHVHFWDEOHRHVRSKDJHDOFDUFLQRPDDQXSGDWHG
PHWDDQDO\VLV/DQFHW2QFRORJ\

6ODQJHU

6ODQJHU7(6FKZDU]EDFK0+RIKHLQ]5.LHQOH3-HQVHQ..LHVHU03HULRSHUDWLYHFKHPRWKHUDS\
YHUVXVSULPDU\VXUJHU\IRUORFRUHJLRQDOO\DGYDQFHGUHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFK
JDVWURHVRSKDJHDOMXQFWLRQDQGORZHUHVRSKDJXV&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV

6RELQ

6RELQ/+:LWWHNLQG&6RELQ/+:LWWHNLQG&,Q6RELQ/+:LWWHNLQG&HGLWRUV710&ODVVLILFDWLRQ
RI0DOLJQDQW7XPRXUV8,&&1HZ<RUN:LOH\/LVV

6WDKO

6WDKO0:DO]0.6WXVFKNH0/HKPDQQ10H\HU+-5LHUD.QRUUHQVFKLOG-3KDVH,,,FRPSDULVRQRI
SUHRSHUDWLYHFKHPRWKHUDS\FRPSDUHGZLWKFKHPRUDGLRWKHUDS\LQSDWLHQWVZLWKORFDOO\DGYDQFHG
DGHQRFDUFLQRPDRIWKHHVRSKDJRJDVWULFMXQFWLRQ-RXUQDORI&OLQLFDO2QFRORJ\

6WHZDUW

6WHZDUW/$&ODUNH0-3UDFWLFDOPHWKRGRORJ\RIPHWDDQDO\VHVRYHUYLHZVXVLQJXSGDWHGLQGLYLGXDO

SDWLHQWGDWD6WDWLVWLFVLQ0HGLFLQH

7KLULRQ

7KLULRQ3*0LFKLHOV60DvWUH$7LHUQH\-,QGLYLGXDOSDWLHQWGDWDEDVHGPHWDDQDO\VLVDVVHVVLQJ
SUHRSHUDWLYHFKHPRWKHUDS\LQUHVHFWDEOHRHVRSKDJHDOFDUFLQRPD-RXUQDORI&OLQLFDO2QFRORJ\


7KLULRQ

7KLULRQ30DLOODUG(3LJQRQ-,QGLYLGXDOSDWLHQWGDWDEDVHGPHWDDQDO\VLVDVVHVVLQJWKHHIIHFWRI
SUHRSHUDWLYHFKHPRUDGLRWKHUDS\LQUHVHFWDEOHRHVRSKDJHDOFDUFLQRPD6

7LHUQH\

7LHUQH\-)6WHZDUW/$*KHUVL'%XUGHWW66\GHV053UDFWLFDOPHWKRGVIRULQFRUSRUDWLQJVXPPDU\
WLPHWRHYHQWGDWDLQWRPHWDDQDO\VLV7ULDOV

9HUJHU

9HUJHU(6DODPHUR0&RQLOO&&DQ.DUQRIVN\SHUIRUPDQFHVWDWXVEHWUDQVIRUPHGWRWKH(DVWHUQ
&RRSHUDWLYH2QFRORJ\*URXS6FRULQJ6FDOHDQGYLFHYHUVD(XURSHDQ-RXUQDORI&DQFHU
$

9LDO

9LDO0*UDQGH/3HUD0(SLGHPLRORJ\RIDGHQRFDUFLQRPDRIWKHHVRSKDJXVJDVWULFFDUGLDDQG
XSSHUJDVWULFWKLUG5HFHQW5HVXOWVLQ&DQFHU5HVHDUFK

9RJW

9RJW.)HQORQ'5KRGHV60DOWKDQHU53UHRSHUDWLYHFKHPRWKHUDS\IRUUHVHFWDEOHWKRUDFLF

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
HVRSKDJHDOFDQFHU&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV

:LOOLDPVRQ

:LOOLDPVRQ356PLWK&7+XWWRQ-/0DUVRQ$*$JJUHJDWHGDWDPHWDDQDO\VLVZLWKWLPHWRHYHQW
RXWFRPHV6WDWLVWLFVLQ0HGLFLQH

:X

:X$:;X*::DQJ+<-L-)7DQJ-/:,7+'5$:11HRDGMXYDQWFKHPRWKHUDS\YHUVXVQRQHIRU
UHVHFWDEOHJDVWULFFDQFHU&RFKUDQH'DWDEDVHRI6\VWHPDWLF5HYLHZV

*5$3+ 6

*UDSKVDQG7DEOHV

7RYLHZDJUDSKRUWDEOHFOLFNRQWKHRXWFRPHWLWOHRIWKHVXPPDU\WDEOHEHORZ

2YHUDOOVXUYLYDO

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

+D]DUG5DWLR5DQGRP >

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDO  
&, @
+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\W\SH +D]DUG5DWLR5DQGRP 6XEWRWDOV
 
RIGDWD &, RQO\

+D]DUG5DWLR5DQGRP >

,QGLYLGXDOSDWLHQWGDWD  
&, @

+D]DUG5DWLR5DQGRP >

$JJUHJDWHGGDWD  
&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 6XEWRWDOV

 
WXPRUVLWH &, RQO\
+D]DUG5DWLR5DQGRP >
(VRSKDJXV  
&, @

+D]DUG5DWLR5DQGRP >

*(MXQFWLRQ  
&, @

+D]DUG5DWLR5DQGRP >

6WRPDFK  
&, @

,QWHUDFWLRQFRHIILFLHQW >
,QWHUDFWLRQWUHDWPHQWWXPRUVLWHRQO\,3'  
5DQGRP&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 6XEWRWDOV

 
FKHPRUDGLRWKHUDS\ &, RQO\

+D]DUG5DWLR5DQGRP >

&KHPRWKHUDS\RQO\  
&, @

+D]DUG5DWLR5DQGRP >

&KHPRUDGLRWKHUDS\  
&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 6XEWRWDOV

 
WLPLQJRIUHJLPHQ &, RQO\

+D]DUG5DWLR5DQGRP >

3UHRSHUDWLYHUHJLPHQ  
&, @

3UHRSHUDWLYHDQGSRVWRSHUDWLYHFRPELQHG +D]DUG5DWLR5DQGRP >

 
UHJLPHQ &, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 6XEWRWDOV

 
FKHPRWKHUDSHXWLFDJHQWV &, RQO\

1RQSODWLQXPDQGQRQDQWKUDF\FOLQH +D]DUG5DWLR5DQGRP >

 
UHJLPHQ &, @

+D]DUG5DWLR5DQGRP >

3ODWLQXPEDVHGQRQDQWKUDF\FOLQHUHJLPHQ  
&, @

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
$QWKUDF\FOLQHEDVHGQRQSODWLQXPUHJLPHQ   +D]DUG5DWLR5DQGRP >
&, @
+D]DUG5DWLR5DQGRP >
3ODWLQXPDQGDQWKUDF\FOLQHEDVHGUHJLPHQ  
&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 7RWDOVQRW

 
SHUIRUPDQFHVWDWXVRQO\,3' &, VHOHFWHG

+D]DUG5DWLR5DQGRP >

3HUIRUPDQFHVWDWXV  
&, @

+D]DUG5DWLR5DQGRP >

3HUIRUPDQFHVWDWXV  
&, @

,QWHUDFWLRQWUHDWPHQWSHUIRUPDQFHVWDWXV ,QWHUDFWLRQFRHIILFLHQW >

 
RQO\,3' 5DQGRP&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\DJH +D]DUG5DWLR5DQGRP 7RWDOVQRW

 
RQO\,3' &, VHOHFWHG

+D]DUG5DWLR5DQGRP >

\HDUV  
&, @

+D]DUG5DWLR5DQGRP >

WR\HDUV  
&, @


,QWHUDFWLRQFRHIILFLHQW
,QWHUDFWLRQWUHDWPHQWDJHRQO\,3'   >
5DQGRP&,
@

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\VH[ +D]DUG5DWLR5DQGRP 7RWDOVQRW

 
RQO\,3' &, VHOHFWHG

+D]DUG5DWLR5DQGRP >

0DOH  
&, @

+D]DUG5DWLR5DQGRP >

)HPDOH  
&, @


,QWHUDFWLRQFRHIILFLHQW
,QWHUDFWLRQWUHDWPHQWVH[RQO\,3'   >
5DQGRP&,
@

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 7RWDOVQRW

 
SUHWUHDWPHQW7FODVVRQO\,3' &, VHOHFWHG
+D]DUG5DWLR5DQGRP >
7VWDJH  
&, @

+D]DUG5DWLR5DQGRP >

7VWDJH  
&, @

,QWHUDFWLRQFRHIILFLHQW >
,QWHUDFWLRQWUHDWPHQW7FODVVRQO\,3'  
5DQGRP&, @

+D]DUGUDWLRSORWIRURYHUDOOVXUYLYDOE\ +D]DUG5DWLR5DQGRP 7RWDOVQRW

 
SUHWUHDWPHQW1FODVVRQO\,3' &, VHOHFWHG

+D]DUG5DWLR5DQGRP >

1VWDJH  
&, @

+D]DUG5DWLR5DQGRP >

1VWDJH  
&, @


,QWHUDFWLRQFRHIILFLHQW
,QWHUDFWLRQWUHDWPHQW1FODVVRQO\,3'   >
5DQGRP&,
@

'LVHDVHIUHHVXUYLYDOODQGPDUNWLPHPRQWKV

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

+D]DUGUDWLRSORWIRUGLVHDVHIUHHVXUYLYDO +D]DUG5DWLR >

 
ODQGPDUNWLPHPRQWKV 5DQGRP&, @

3UHVHQFHRIWXPRUIUHHUHVHFWLRQPDUJLQ

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
3UHVHQFHRIWXPRUIUHHUHVHFWLRQPDUJLQ

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

2GGVUDWLRSORWIRUWXPRUIUHH 2GGV5DWLR0+5DQGRP >

 
UHVHFWLRQPDUJLQ &, @

7XPRUVWDJHDWUHVHFWLRQ

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

2GGVUDWLRSORWIRUWXPRUVWDJH 2GGV5DWLR0+5DQGRP >

 
777 &, @

2GGVUDWLRSORWIRUQRGDOVWDWXV 2GGV5DWLR0+5DQGRP >

 
1 &, @

6DIHW\RISHULRSHUDWLYHFKHPRWKHUDS\UHJLPHQ

1RRI 1RRI 6WDWLVWLFDO

2XWFRPHWLWOH (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV PHWKRG

1XPEHURIJUDGHWR[LFLWLHVSHU 1RQXPHULF
  2WKHUGDWD
SDWLHQW GDWD

3RVWRSHUDWLYHPRUELGLW\

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

5LVNGLIIHUHQFHSORWIRU 5LVN'LIIHUHQFH0+ >

 
SRVWRSHUDWLYHPRUELGLW\ 5DQGRP&, @

3RVWRSHUDWLYHPRUWDOLW\

1RRI 1RRI
2XWFRPHWLWOH 6WDWLVWLFDOPHWKRG (IIHFWVL]H
VWXGLHV SDUWLFLSDQWV

5LVNGLIIHUHQFHSORWIRU 5LVN'LIIHUHQFH0+5DQGRP >

 
SRVWRSHUDWLYHPRUWDOLW\ &, @

&29(56+((7

3HULRSHUDWLYHFKHPRUDGLRWKHUDS\YHUVXVSULPDU\VXUJHU\IRUUHVHFWDEOHDGHQRFDUFLQRPDRIWKHVWRPDFK

JDVWURHVRSKDJHDOMXQFWLRQDQGORZHUHVRSKDJXV

5HYLHZHUV 5RQHOOHQILWVFK8OULFK6FKZDU]EDFK0DWWKLDV+RIKHLQ]5DOI.LHQOH3HWHU
.LHVHU0HLQKDUG6ODQJHU7UDF\(-HQVHQ.DWULQ

&RQWULEXWLRQRI5HYLHZHUV

,VVXHSURWRFROILUVWSXEOLVKHG LVVXH

,VVXHUHYLHZILUVWSXEOLVKHG LVVXH

'DWHRIODVWPLQRUDPHQGPHQW ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU

'DWHRIODVWVXEVWDQWLYH ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU
DPHQGPHQW

0RVWUHFHQWFKDQJHV

'DWHQHZVWXGLHVVRXJKWEXW ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU
QRQHIRXQG

'DWHQHZVWXGLHVIRXQGEXWQRW ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU
\HWLQFOXGHGH[FOXGHG

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2& 
 FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&
'DWHQHZVWXGLHVIRXQGDQG ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU
LQFOXGHGH[FOXGHG

'DWHUHYLHZHUV
FRQFOXVLRQV ,QIRUPDWLRQQRWVXSSOLHGE\UHYLHZHU
VHFWLRQDPHQGHG

&RQWDFWDGGUHVV 5RQHOOHQILWVFK
7KHRGRU.XW]HU8IHU
*RWHQVWUDVVH
,1)
0DQQKHLP
)UDQNIXUWDP0DLQ
0DQQKHLP
+HLGHOEHUJ
&RORJQH
6HH&RQWULEXWLRQVRI$XWKRUV

*HUPDQ\
*HUPDQ\
*HUPDQ\
*HUPDQ\
*HUPDQ\
*HUPDQ\
0DQQKHLP




7HOHSKRQH
)DFVLPLOH
(PDLOXOULFKURQHOOHQILWVFK#XPPGH

&RFKUDQH/LEUDU\QXPEHU &'

(GLWRULDOJURXS &RFKUDQH8SSHU*DVWURLQWHVWLQDODQG3DQFUHDWLF'LVHDVHV*URXS

(GLWRULDOJURXSFRGH +0833(5*,

6 285&(6 2)6 833257

([WHUQDOVRXUFHVRIVXSSRUW

)HGHUDO0LQLVWU\RI(GXFDWLRQDQG5HVHDUFK%0%)*HUPDQ\

,QWHUQDOVRXUFHVRIVXSSRUW

8QLYHUVLW\0HGLFDO&HQWUH0DQQKHLP8QLYHUVLW\RI+HLGHOEHUJ'HSDUWPHQWRI6XUJHU\*HUPDQ\
8QLYHUVLW\0HGLFDO&HQWUH0DQQKHLP8QLYHUVLW\RI+HLGHOEHUJUG0HGLFDO'HSDUWPHQW*HUPDQ\
8QLYHUVLW\+RVSLWDO+HLGHOEHUJ,QVWLWXWHRI0HGLFDO%LRPHWU\DQG,QIRUPDWLFV*HUPDQ\

.(<:25'6

+,6725<

&RS\ULJKW7KH&RFKUDQH/LEUDU\

FRFKUDQHEYVDOXGRUJFRFKUDQHVKRZSKS"GE UHYLHZV PIQ  LG &' ODQJ HV GEODQJ OLE &2&