2022 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)
$0DFKLQH/HDUQLQJEDVHG$SSOLFDWLRQWR3UDWLFH
)RUHLJQ/DQJXDJHV8VLQJ,PDJHVDQG3KRWRJUDSKV
2022 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE) | 978-1-6654-9117-4/22/$31.00 ©2022 IEEE | DOI: 10.1109/TALE54877.2022.00066
5RGULJR(GXDUGR*yPH]2UWL]
(VFXHODGH,QJHQLHULD\&LHQFLDV
7HFQRORJLFRGH0RQWHUUH\
=DSRSDQ0H[LFR
URGULJRJRPH]#JPDLOFRP
$EVWUDFW²0RVWRIWKHSRSXODWLRQXVHVDPRELOHGHYLFHHYHU\
GD\ KHQFH WKHVH GHYLFHV SRVH DQ LPSRUWDQW RSSRUWXQLW\ IRU
DSSOLFDWLRQVVXFKDVOHDUQLQJ$PRELOH$SSEDVHGRQ0DFKLQH
/HDUQLQJDOJRULWKPVDQG*RRJOHWRROVZDVGHYHORSHGDQGXVHG
WR DLG WKH VWXGHQWV LQ OHDUQLQJ D QHZ ODQJXDJH 7KH $SS LV
FDSDEOH RI SURYLGLQJ D WUDQVODWLRQ RI WKH REMHFWV IRXQG LQ D
SKRWRJUDSK RU D JDOOHU\ LPDJH DQG SURGXFLQJ PXOWLSOH RSWLRQ
TXL]]HV IURP WKH VWXGLHG REMHFWV 7KH HIIHFW RI WKH $SS LQ WKH
OHDUQLQJSURFHVVRIDIRUHLJQODQJXDJHZDVWHVWHGE\FRQGXFWLQJ
DQH[SHULPHQWDQGWKHUHVXOWVZHUHFRPSDUHGZLWKWKRVHRID
FRQWURO JURXS :KHWKHU WKH PRWLYDWLRQ DQG OHDUQLQJ
HQJDJHPHQWLQWKHVWXGHQWVLQFUHDVHGZDVDQDO\]HG7KHUHVXOWV
LQGLFDWHWKDWWKHH[SHULPHQWDOJURXSSHUIRUPHGEHWWHUWKDQWKH
FRQWUROJURXSDQGWKH$SSKDGJRRGXVHUDFFHSWDQFHDVPRVW
RIWKHSDUWLFLSDQWVPHQWLRQHGWKH$SSZDVHQJDJLQJDQGIXQWR
XVH
.H\ZRUGV²0/HDUQLQJ 0DFKLQH /HDUQLQJ (GXFDWLRQDO
,QQRYDWLRQ+LJKHU(GXFDWLRQ(GXFDWLRQDO$SSV
, ,1752'8&7,21
1RZDGD\V GHYLFHV OLNH PRELOH SKRQHV WDEOHWV DQG
VPDUWZDWFKHV DUH YLWDO WRHYHU\GD\ OLYLQJ DQG KDYH HQGOHVV
GLIIHUHQW XVHV DQG DSSOLFDWLRQV VXFK DV ZHEEURZVLQJ
SKRWRJUDSKLQJ DQG PHVVDJLQJ 6LQFH PRUH WKDQ KDOI WKH
SRSXODWLRQXVHVWKHLUPRELOHSKRQHVHYHU\GD\DPHWKRGRORJ\
FDOOHGPRELOHOHDUQLQJ RU0OHDUQLQJ ZDVGHYHORSHGDQGLV
ULVLQJLQSRSXODULW\ZRUOGZLGH>@0OHDUQLQJLVDFRQFHSW
ZKHUH³OHDUQLQJFDQRFFXUDQ\ZKHUHZKHUHDPRELOHGHYLFHLV
DYDLODEOH´ >@ 'XULQJ 0OHDUQLQJ WKH OHDUQHUV XVH WKHLU
PRELOHGHYLFHWRVWXG\DWWKHLURZQSDFLQJDQGDWDFRQYHQLHQW
WLPH EDVHG RQ WKHLU QHHGV >@ 'HSHQGLQJ RQ WKH HPSOR\HG
PHWKRGRORJ\ LQ VRPH FDVHV0OHDUQLQJ FDQEH XELTXLWRXV
WKDWLVFDQEHFRQGXFWHGHYHU\ZKHUHDQGDWDQ\WLPH>@$
ZHOOGHVLJQHG0OHDUQLQJFRQFHSWVKRXOGEHHQJDJLQJDQGLQ
VRPH FDVHV PD\ HYHQ SURPRWH OLIHORQJ OHDUQLQJ DQG
FRQWULEXWHWRWKHFRPSHWLWLYLW\DQGSHUVRQDOGHYHORSPHQWRI
WKH XVHU >@ WKHUHIRUH XELTXLW\ VKRXOG EH FRQVLGHUHG ZKHQ
GHVLJQLQJ0OHDUQLQJDFWLYLWLHV
0OHDUQLQJFDQEHDSSOLHGWRGLIIHUHQWGLVFLSOLQHVVXFKDV
FKHPLVWU\ PDWKHPDWLFV DQG ODQJXDJHV >@ )RU ODQJXDJH
OHDUQLQJDQXPEHURI$SSV DSSOLFDWLRQV H[LVWZLWKWKHPRVW
SRSXODU H[DPSOHV EHLQJ 'XROLQJR %DEEHO DQG *RRJOH
7UDQVODWH7KHDYDLODEOHDSSVFRQVLVWLQSHULRGLFTXL]]HVZLWK
YDU\LQJWRSLFVDQGOHYHOVRIGLIILFXOW\DIWHUDVHWWLPHRIVWXG\
'XROLQJR DSODWDIRUPWRFRQVXOWGLIIHUHQWIRUPVRIOHDUQLQJ
FRQWHQW %DEEHO0RRGOH RUDZLGJHWZKHUHRQHFDQZULWHD
ZRUG DQG VHH RU OLVWHQ WR WKH WUDQVODWLRQ *RRJOH WUDQVODWH 
$OTDKWDQL >@ PHQWLRQV WKDW WDQJLEOH REMHFWV DUH YLWDO WR
OHDUQLQJDVKXPDQEHLQJVUHO\RQYLVXDOGHSLFWLRQVWROHDUQ
FRQFHSWVKRZHYHUWRWKHDXWKRUVEHVWNQRZOHGJHDVRI
QR $SS H[LVWV WKDW WUDQVODWHV WKH REMHFWV IRXQG LQ JDOOHU\
LPDJHVRUSKRWRJUDSKVWRWH[WDQGVSHHFK
2470-6698/22/$31.00 ©2022 IEEE
DOI 10.1109/TALE54877.2022.00066
Authorized licensed use limited to: Oracle. Downloaded on April 17,2024 at 15:56:34 UTC from IEEE Xplore. Restrictions apply.
'DYLG$QWRQLR%XHQWHOOR0RQWR\D
(VFXHODGH,QJHQLHULD\&LHQFLDV
7HFQRORJLFRGH0RQWHUUH\
=DSRSDQ0H[LFR
GDYLGEXHQWHOOR#WHFP[
$Q LPSRUWDQW SUREOHP IDFHG E\ 0OHDUQLQJ LV XVHU
DFFHSWDQFHEHFDXVHHYHQLIXELTXLWRXVOHDUQLQJWHFKQRORJLHV
H[LVWLIWKHXVHULVQRWDWWUDFWHGRUIHHOVXQFRPSHOOHGWRXVHLW
WKH WHFKQRORJLHV EHFRPH XVHOHVV >@ 5\DQ DQG 'HFL KDYH
SURSRVHG WKDW PRWLYDWLRQ DQG FRQVHTXHQWO\ VHOIOHDUQLQJ 
UHTXLUHVDVHQVHRIDXWRQRP\ FRQWURORQRQH¶VEHKDYLRUDQG
JRDOV FRPSHWHQFH DIHHOLQJWKDWRQHKDVZKDWLVQHFHVVDU\
WRDFKLHYHDSDUWLFXODUJRDO DQGFRQQHFWLRQV LQWHUDFWLRQVDQG
DWWDFKPHQWZLWKSHRSOH >@(PSRZHULQJWKHXVHURQWKHKRZ
ZKHQDQGZKHUHRQHOHDUQVVKRXOGEHDPDMRUFRQVLGHUDWLRQ
WRGHVLJQDSHGDJRJLFDOWRRO
2QWKHRWKHUKDQG0DFKLQH/HDUQLQJ 0/ LVDIDPLO\RI
FRPSXWDWLRQDO PHWKRGV WKDW UHO\ RQ H[LVWLQJ EDQNV RI GDWD
NQRZOHGJH  WR PDNH SUHGLFWLRQV >@ 0/ DOJRULWKPV XVH
WUDLQLQJGDWDWRWUDLQDPRGHO WKDWLVILQHWXQHLWWRLQFUHDVH
SUHGLFWLRQDFFXUDF\ DQGPDNHLWFDSDEOHRISUHGLFWLRQV$IWHU
WKHPRGHOLVWUDLQHGDVHWRIYDOLGDWLRQGDWDZKHUHWKHLQSXW
DQGRXWSXWYDULDEOHVDUHNQRZQLVXVHGWRGHWHUPLQHZKHWKHU
WKHPRGHOZRUNVFRUUHFWO\RUQRWYDOLGDWLRQLVFRQGXFWHGE\
XVLQJ WKH PRGHO WR SUHGLFW WKH RXWSXWV DQG FRPSDULQJ WKH
SUHGLFWLRQVZLWKWKHUHDOYDOXHV>@:KHQWKH0/PRGHO
KDV EHHQ WUDLQHG DQG YDOLGDWHG LW FDQ EH XVHG WR GR
FDOFXODWLRQVZLWKGDWDRXWVLGHRIWKHWUDLQLQJEDQN
$PRQJVW WKH GLIIHUHQW 0/ DOJRULWKPV D IDPLO\ FDOOHG
'HHS /HDUQLQJ H[LVWV 'HHS /HDUQLQJ LV XVXDOO\ XVHG IRU
H[WHQVLYH DQG FRPSOH[ GDWD DQG IRU GHFLVLRQ PDNLQJ >@
0RUHRYHU'HHS/HDUQLQJFDQEHXVHGIRU2EMHFW'HWHFWLRQD
FRPSXWHU YLVLRQ WHFKQLTXH ZKHUH D YLVXDO GHSLFWLRQ RI DQ
REMHFW FDQ EH ORFDWHG FRXQWHG LGHQWLILHG DQG ODEHOOHG >
@
,QWKLVZRUNDPRELOHDSSOLFDWLRQFDSDEOHRILGHQWLI\LQJ
REMHFWVHLWKHUSKRWRJUDSKHGE\WKHXVHURUORDGHGIURPWKHLU
JDOOHU\ ZDV GHYHORSHG XVLQJ 0/ DOJRULWKPV VSHFLILFDOO\
'HHS/HDUQLQJ %HVLGHVLGHQWLI\LQJWKHREMHFWWKH$SSFDQ
WUDQVODWHWRDQGIURPGLIIHUHQWODQJXDJHVDQGSURQRXQFHWKH
ZRUG LQ WKH VHOHFWHG ODQJXDJH WR DLG WKH XVHU¶V
OLVWHQLQJVSHHFK DQG SUDFWLFH WKH YRFDEXODU\ RI D IRUHLJQ
ODQJXDJH 7KH JRDO RI WKH $SS LV WR PDNH WKH ODQJXDJH
OHDUQLQJSURFHVVLQWHUDFWLYHDQGOHVVWHGLRXVZKHQFRPSDUHG
ZLWK FRQYHQWLRQDO OHDUQLQJ PHWKRGV WKLV ZLOO WUDQVODWH WR
EHWWHUXVHUHQJDJHPHQWDQGIDFLOLWDWLRQRIODQJXDJHOHDUQLQJ
LQFDVXDOHQYLURQPHQWV
7R GHWHUPLQH WKH LPSDFW RI WKH $SS LQ WKH OHDUQLQJ
SURFHVVDQH[SHULPHQWDQGDQRSLQLRQVXUYH\ZHUHFRQGXFWHG
7KHH[SHULPHQWZDVXVHGWRPRQLWRUZKHWKHUDQLPSURYHPHQW
LV IRXQG ZKHQ VWXG\LQJ XVLQJ WKH $SS ZKHQ FRPSDUHG WR
VWXG\LQJXQGHUQRUPDOFLUFXPVWDQFHVRQWKHRWKHUKDQGWKH
RSLQLRQ VXUYH\ ZDV XVHG WR GHWHUPLQH ZKHWKHU WKH XVHU IHOW
FRPSHOOHGWRXVHWKH$SS7KHH[SHULPHQWFRQVLVWHGRIXVLQJ
WKH$SSWRVWXG\DVHWRILWHPVIROORZHGE\DWLPHGTXL]2Q
WKH RWKHU KDQG WKH VWXGHQW VXUYH\ ZDV DQ DQRQ\PRXV
TXHVWLRQQDLUH
362
 .QRZLQJWKHLPSDFWRIWKH$SSERWKLQWHUPVRIOHDUQLQJ )LJXUHVKRZVWKHXVHULQWHUIDFHIRUWKHYDULRXVPHQXVLQWKH
SURFHVVDQGXVHUDFFHSWDQFHLVRILPSRUWDQFHDVLWFDQKHOSLQ $SS
WKH GHVLJQ RI IXWXUH 0OHDUQLQJ $SSV DQG FDQ SURYLGH DQ
LQVLJKW RQ WKH SRVVLEOH VXFFHVV RU IDLOXUH RI IXWXUH $SSV
7KHUHIRUHDVHULHVRIUHVHDUFKTXHVWLRQVZHUHIRUPXODWHG
  &DQDPRELOH$SSEDVHGRQ0/DOJRULWKPVEHXVHGWR
SUDFWLFH YRFDEXODULHV WH[W DQG VSHHFK  LQ D IRUHLJQ
ODQJXDJH"
  :KHQFRPSDUHGZLWKWKHWUDGLWLRQDOZD\RIVWXG\LQJ
GRHVXVLQJDQ$SSWROHDUQIRUHLJQODQJXDJHV WH[WDQG
VSHHFK FDXVHDQLPSDFW"
  &DQDQ$SSWROHDUQIRUHLJQODQJXDJHVEHHQJDJLQJWR
WKHXVHU"
7KH VWUXFWXUH RI WKLV ZRUN LV DV IROORZV )LUVWO\ WKH
PHWKRGRORJ\IROORZHGGXULQJWKHFRQGXFWLRQRIWKHVWXG\LV
SUHVHQWHGLQ6HFWLRQ,,7KHPHWKRGRORJ\LVGLYLGHGLQDVHULHV
RI VXEVHFWLRQV WR   EULHIO\ H[SODLQ WKH PHWKRGRORJ\ DQG
UHVRXUFHV XVHG WR GHYHORS WKH $SS   GHVFULEH WKH $SS
LQWHUIDFH  JLYHDGHWDLORQWKHSDUWLFLSDQWV  H[SODLQWKH
H[SHULPHQWVXVHGWRWHVWWKH$SSDQG  H[SODLQWKHTXHVWLRQV
XVHGLQWKHRSLQLRQVXUYH\$IWHUWKHPHWKRGRORJ\WKHUHVXOWV 
VHFWLRQ 6HFWLRQ,,, LVFRQIHUUHGILUVWO\DVWDWLVWLFDODQDO\VLV
ZDVFRQGXFWHGRQWKHH[SHULPHQWDODQGFRQWUROJURXS WKDWLV )LJ 9LVXDOGHSLFWLRQRIWKHXVHULQWHUIDFH D 6KRZVWKHPHQXWRFKRRVH
WKHJURXSVWXG\LQJXQGHUQRUPDOFLUFXPVWDQFHV WRGHWHUPLQH EHWZHHQWDNLQJDSLFWXUHRUVHOHFWLQJIURPWKHJDOOHU\ E VKRZVWKHWUDQVODWH
ZKHWKHUWKHWZRJURXSVDUHVWDWLVWLFDOO\GLIIHUHQW$IWHUZDUGV IURP SLFWXUH LQWHUIDFH F  VKRZV WKH WUDQVODWH IURP JDOOHU\ LQWHUIDFH G 
VKRZV WKH SUHYLRXV WUDQVODWLRQVDQGDYDLODEOH UDQGRPO\JHQHUDWHG TXL]]HV
WKHUHVXOWVIURPWKHTXL]DQGWKHRSLQLRQVXUYH\DUHSUHVHQWHG DQG H VKRZVWKHTXL]LQWHUIDFH
DQG H[SODLQHG VHSDUDWHO\ $IWHU WKH UHVXOWV VHFWLRQ D
GLVFXVVLRQRQWKHILQGLQJVLVSUHVHQWHG)LQDOO\WKHODVWVHFWLRQ $IWHU WKH $SS LV XVHG WKH XVHU FDQ DFFHVV SUHYLRXV
RIWKHPDQXVFULSWSUHVHQWVDVXPPDU\RIWKHZRUNDQGVHULHV WUDQVODWLRQVIURPWKHPDLQPHQX7RPRQLWRUDQGSURPRWHWKH
RIFRQFOXVLRQVRQWKHILQGLQJV XVHU¶VOHDUQLQJSURFHVVDQGRXWFRPHVWKH$SSLVDOVRFDSDEOH
,, 0(7+2'2/2*< RIVWRULQJWKHWUDQVODWHGREMHFWVLQDGDWDEDVHDQGSURGXFLQJ
DUDQGRPL]HGZULWWHQRUDOPXOWLSOHRSWLRQTXL]]HVEDVHGRQ
$ $SSGHYHORSPHQW WKHVWXGLHGZRUGV$YLVXDOGHVFULSWLRQRIWKHDOJRULWKPXVHG
7KH$SSZDVGHYHORSHGIRUWKH$QGURLGSODWIRUPXVLQJD E\ WKH $SS WR JHQHUDWH WKH TXL]]HV WR SURPRWH WKH XVHU¶V
VHULHVRIRSHQVRXUFHGHYHORSPHQWNLWVDQGOLEUDULHV OHDUQLQJLVGHSLFWHGLQ)LJXUH
  7HQVRUIORZ/LWHDQGWKH66'0RELOH1HWPRGHOZHUH
XVHG IRU WKH REMHFW GHWHFWLRQ WKDW LV UHFRJQLWLRQ RI
SDWWHUQVDQGVKDSHV PRGXOH>@
  )OXWWHU D IUDPHZRUN GHYHORSHG DQG VXSSRUWHG E\
*RRJOHZDVHPSOR\HGIRUWKHGHYHORSPHQWRIWKHXVHU
LQWHUIDFH>@
  *RRJOH 7UDQVODWH DQG *RRJOH 7H[WWRVSHHFK ZHUH
XVHG DV WKH GDWD EDQNV IRU WKH WUDQVODWLRQ DQG
SURQXQFLDWLRQRIWKHREMHFWVLQWKHGLIIHUHQWODQJXDJHV
>@
  *RRJOH )LUHEDVH ZDV XVHG WR VWRUH WKH XVHUUHODWHG
GDWD VXFK DV FDSWXUHG LPDJHV WUDQVODWLRQV DQG WH[W
VFRUHV>@7KHGDWDEDVHZDVXVHGWRJHQHUDWHTXL]]HV
IRUWKHXVHUV
7KH$SSZDVWUDLQHGDQGYDOLGDWHGXVLQJGDWDEDQNVIRXQG
RQWKHLQWHUQHW,QWKHHQGZLWKWKHPRGXOHVSXWWRJHWKHUWKH
UHVXOWLQJ $SS ZDV WUDLQHG YDOLGDWHG DQG PDGH FDSDEOH RI
WUDQVODWLQJGLIIHUHQWODQJXDJHV*HUPDQ)LQQLVK,WDOLDQ
3ROLVK 9LHWQDPHVH &]HFK )UHQFK 'XWFK 3RUWXJXHVH
'DQLVK(QJOLVK1RUZHJLDQ7XUNLVKDQG6SDQLVK
% $SSGHVFULSWLRQ
7KH$SSZDVGHVLJQHGWREHVLPSOHDQGVWUDLJKWIRUZDUG
WRXVH2QILUVWVWDUWXSDIWHUORJJLQJLQWRD*RRJOHDFFRXQW 
XVHG WR VWRUH WKH XVHU GDWD  WKH XVHU LV DVNHG ZKHWKHU WR
WUDQVODWHE\WDNLQJDSLFWXUHRUXVLQJDQLPDJHIURPDJDOOHU\ )LJ $OJRULWKPXVHGE\WKH$SSWRSURPRWHWKHXVHU¶VOHDUQLQJ

363

Authorized licensed use limited to: Oracle. Downloaded on April 17,2024 at 15:56:34 UTC from IEEE Xplore. Restrictions apply.
& 'HVFULSWLRQRIWKHSDUWLFLSDQWV
7KHSDUWLFLSDQWVZHUHLQGLYLGXDOVDJHGEHWZHHQDQG
 \HDUV DQG ZHUH DOO QDWLYH 6SDQLVKVSHDNHUV PRUH
LQIRUPDWLRQRQWKHGHPRJUDSKLFVFDQEHIRXQGLQ7DEOH,
7$%/(, 3$57,&,3$17,1)250$7,21
$JHJURXS
*HQGHU
   7RWDO

0DOH   
)HPDOH    

7RWDO   

:LWKUHVSHFWWRWKHDJHJURXSRIWKHSDUWLFLSDQWVZHUH
EHWZHHQDQG\HDUVROGZHUHEHWZHHQDQG
\HDUVROGDQGRQO\RIWKHSDUWLFLSDQWVZKHUHROGHUWKDQ
7KHPDOHWRIHPDOHUDWLRZDV
6LQFH SODQQHG IXWXUH ZRUN LQFOXGHV WKH GHYHORSPHQW RI
DGGLWLRQDO $SSV IRU 0OHDUQLQJ LQ KLJKHU HGXFDWLRQ WKH
SDUWLFLSDQWV HGXFDWLRQ OHYHO ZDV DW OHDVW WKDW RI DQ
XQGHUJUDGXDWHVWXGHQW
' 'HVFULSWLRQRIWKHH[SHULPHQWV
7RPHDVXUHWKHLPSDFWRIXVLQJWKH$SSLQDGGLWLRQWRWKH
H[SHULPHQWDO JURXS D FRQWURO JURXS ZDV DOVR VXEMHFW WRWKH
H[SHULPHQW 7KH SDUWLFLSDQWV ZHUH DVVLJQHG WR HLWKHU WKH
H[SHULPHQWDORUFRQWUROJURXSDWUDQGRP
7KHH[SHULPHQWZDVFRQGXFWHGUHPRWHO\XVLQJDFRPSXWHU
DQG LQ WKH H[SHULPHQWDO JURXS D PRELOH SKRQH 7KH
SDUWLFLSDQWV DQG LQYLJLODWRUV FRPPXQLFDWHG XVLQJ WKH
YLGHRFRQIHUHQFHVRIWZDUH=RRP%RWKWKHH[SHULPHQWDODQG
FRQWUROJURXSVSDUWLFLSDWHGLQWKHH[SHULPHQWDWWKHVDPHWLPH
7KHH[SHULPHQWFRQVLVWHGRIWKUHHSKDVHV  VWXG\LQJSKDVH
  H[DPLQDWLRQ SKDVH DQG   RSLQLRQ VXUYH\ SKDVH 7KH
GLIIHUHQFHEHWZHHQWKHH[SHULPHQWDODQGFRQWUROJURXSVOLHG
LQ WKH VWXG\LQJ SKDVH ZKHUH WKH FRQWURO JURXS XVHG
FRQYHQWLRQDOPHWKRGVWRVWXG\WKDWLVVWXGLHGE\UHSHWLWLRQ
ZLWKRXW XVLQJ DQ $SS %RWK WKH H[SHULPHQWDO DQG FRQWURO
JURXSZHUHHTXDOLQVL]H SHUVRQV DQGDQLQYLJLODWRUZDV
LQFKDUJHRIPRQLWRULQJWKHSURJUHVVRIHDFKJURXS
  4XL]
6LQFH QR VLQJOH SDUWLFLSDQW ZDV IDPLOLDU ZLWK WKH 3ROLVK
ODQJXDJHWKDWODQJXDJHZDVXVHGLQWKHH[SHULPHQW
'XULQJWKHILUVWVWDJH VWXG\LQJSKDVH WKHSDUWLFLSDQWVLQ
WKH H[SHULPHQWDO JURXS ZHUH ILUVW H[SODLQHG WKH GLIIHUHQW
IXQFWLRQVRIWKH$SSJLYHQH[DPSOHVDQGILQDOO\ZHUHJLYHQ
DVHWWLPH PLQXWHV WRVWXG\'XULQJWKHVWXG\WLPHWKH
H[SHULPHQWDO JURXS XVHG WKH $SS WR SKRWRJUDSK GLIIHUHQW
REMHFWV DQG OHDUQUHYLHZ WKH 3ROLVK WUDQVODWLRQ RI WKH
SKRWRJUDSKHGREMHFW0RUHRYHUWKHH[SHULPHQWDOJURXSZHUH
SURYLGHG ZLWK VRPH SLFWXUHV LQ FDVH WKHLU PRELOH FDPHUD
IDLOHG ,Q FRQWUDVW ZLWK WKH H[SHULPHQWDO JURXS WKH FRQWURO
JURXSKDGWRVWXG\LQDWUDGLWLRQDOZD\DQGZHUHJLYHQDVHWRI
ZRUGV DQG WKHLU UHVSHFWLYH WUDQVODWLRQV $IWHU WKH VHW WLPH
SDVVHG WKH VHFRQG SKDVH FRPPHQFHG H[DPLQDWLRQ SKDVH 
DQGWKHSDUWLFLSDQWVZHUHJLYHQPLQXWHVWRDQVZHUDWHQ
TXHVWLRQTXL]ZLWKWKHZRUGVOHDUQHGXVLQJWKH$SS7KHTXL]
ZDVFRQGXFWHGXVLQJ*RRJOHIRUPVDQGHDFKSDUWLFLSDQWZDV
DEOHWRVHHKLVKHUVFRUHDIWHUWKH\ILQLVKHG
  2SLQLRQVXUYH\
364
Authorized licensed use limited to: Oracle. Downloaded on April 17,2024 at 15:56:34 UTC from IEEE Xplore. Restrictions apply.
8SRQ FRPSOHWLRQ RI WKH TXL] WKH SDUWLFLSDQWV LQ WKH
H[SHULPHQWDO JURXS ZHUH JLYHQ WKH RSSRUWXQLW\ WR HYDOXDWH
GLIIHUHQWDVSHFWVRIWKH$SSE\DQVZHULQJDQRSLQLRQVXUYH\
XVLQJ*RRJOHIRUPV RSLQLRQVXUYH\SKDVH 7KHTXHVWLRQQDLUH
ZDVGHVLJQHGWRGHWHUPLQHZKHWKHUWKHVWXGHQWVIHOWSRVLWLYH
WRZDUGVWKH$SSDVDOHDUQLQJWRRODQGWRPHDVXUHWKHVXFFHVV
LQHQJDJLQJWKHXVHUZLWKLWVLQWHUDFWLYLW\
7KH RSLQLRQ VXUYH\ FRQVLVWHG RI D /LNHUW VFDOHEDVHG
TXHVWLRQQDLUH 7KH /LNHUW VFDOH ZDV XVHG VLQFH LW LV D ZHOO
GRFXPHQWHG UDWLQJ VFDOH XVHG WR FRPSDUH VDPSOHV 7KH
DQVZHUVZHUHJLYHQQXPEHUVZKHUH FRPSOHWHO\GLVDJUHH 
DQG FRPSOHWHO\DJUHH ZHUHWKHOHDVWDQGPRVWIDYRXUDEOH
UHVSRQVHVUHVSHFWLYHO\
7KHVWXGHQWVZHUHDVNHGWKHIROORZLQJTXHVWLRQV
  ,VWKH$SSHDV\WRXVH"
  ,VWKH$SSIXQWRXVH"
  'LG \RX ILQG WKH $SS PRWLYDWLQJ WR OHDUQ QHZ
ODQJXDJHV"
  +RZ ZRXOG \RX UDWH WKH ³SKRWRJUDSK DQG WUDQVODWH´
IXQFWLRQ"
  +RZ ZRXOG \RX UDWH WKH ³WUDQVODWH IURP JDOOHU\´
IXQFWLRQ"
  +RZZRXOG\RXUDWHWKHWUDQVODWLRQV"
  :RXOG \RX UHFRPPHQG WKH $SS WR OHDUQ D QHZ
ODQJXDJH"
  2YHUDOOKRZZRXOG\RXUDWHWKH$SS"
7R UHGXFH WKH ELDV LQ WKH DQVZHUV WKH DQVZHUV ZHUH
DQRQ\PRXVDQGQRUHZDUGZDVJLYHQWRWKHSDUWLFLSDQWVEDVHG
RQWKHLUDQVZHUV
,,, 5(68/76
$ 6WDWLVWLFDODQDO\VLV
$6KDSLUR:LONWHVWZLWKDVLJQLILFDQFHOHYHORI Į 
  ZDV FRQGXFWHG WR GHWHUPLQH LI QRUPDOLW\ FRXOG EH
DVVXPHGIRUWKHTXL]UHVXOWV>@7KHFDOFXODWHGWHVWVWDWLVWLF
 ZDVODUJHUWKDQWKHFULWLFDOYDOXH  LQGLFDWLQJ
QRUPDOLW\FRXOGQRWEHDVVXPHGWKHUHIRUHDQRQSDUDPHWULF
WHVWZDVQHFHVVDU\WRGHWHUPLQHZKHWKHUWKHFRQWURODQGWKH
H[SHULPHQWDO JURXSV ZHUH GLIIHUHQW >@ 7KHUHIRUH D
.UXVNDO:DOOLVWHVWZDVFRQGXFWHGWRGHWHUPLQHZKHWKHUWKH
GLIIHUHQWJURXSVZHUHVWDWLVWLFDOO\HTXLYDOHQWRUQRW>@7KH
FDOFXODWHGWHVWVWDWLVWLF +  ZDVODUJHUWKDQWKHFULWLFDO
YDOXH +F  KHQFHLWZDVFRQFOXGHGWKDWWKHGLIIHUHQW
JURXSVZHUHVWDWLVWLFDOO\GLIIHUHQW>@
7KH UHVXOWV IURP WKH VWDWLVWLFDO DQDO\VLV PHDQ WKDW
DOWKRXJK WKH VFRUHV DUH VRPHZKDW VLPLODU WKH GLIIHUHQFHV
ZHUH QRW D UDQGRP RFFXUUHQFH 7KLV SDUWLDOO\ DQVZHUV
UHVHDUFK TXHVWLRQ  ³&DQ D PRELOH $SS EDVHG RQ 0/
DOJRULWKPVEHXVHGWRSUDFWLFHYRFDEXODULHV WH[WDQGVSHHFK 
LQ D IRUHLJQ ODQJXDJH"´  VLQFH WKH JURXS XVLQJ WKH $SS WR
VWXG\LVVWDWLVWLFDOO\GLIIHUHQW IURPWKHJURXSVWXG\LQJ ZLWK
WUDGLWLRQDOPHWKRGV
% 4XL]UHVXOWV
7KHTXL]UHVXOWVIRUERWKJURXSVFDQEHIRXQGLQ)LJXUH
)LJXUHDVHSDUDWHVWKHVFRUHGHWDLOVE\JURXS H[SHULPHQWDO
RUFRQWURO ZKHUHDV)LJXUHEVHSDUDWHVWKHVFRUHGHWDLOVE\
JHQGHUDQGDJHJURXS:KHQREVHUYLQJ)LJXUHDLWFDQEH
VHHQ WKDW WKH SHUIRUPDQFH RI ERWK JURXSV ZDV VRPHZKDW
VLPLODU KRZHYHU WKH H[SHULPHQWDO JURXS KDG D ODUJHU
VWDQGDUGGHYLDWLRQWKDQWKHFRQWUROJURXS ! 
7KLV GLIIHUHQFH LQ VWDQGDUG GHYLDWLRQ LQGLFDWHV WKDW VRPH
RXWOLHUV WKDWLVSHUVRQVSHUIRUPLQJYHU\GLIIHUHQWO\IURPWKH
PDLQ WUHQG LQ WKLV FDVH YHU\ SRRUO\  ZHUH SUHVHQW 7KHVH
UHVXOWVWRJHWKHUZLWKWKHVWDWLVWLFDODQDO\VLVFRXOGDUJXDEO\
LQGLFDWH WKDW LQGLYLGXDOV XVLQJ WKH $SS PLJKW SHUIRUP D ELW
EHWWHU WKDQ LQGLYLGXDOV WKDW VWXGLHG XVLQJ FRQYHQWLRQDO
PHWKRGV,Q)LJXUHELWFDQEHVHHQWKDWWKHHOGHVWJURXS  
KDGWKHSRRUHVWSHUIRUPDQFHWKLVFRXOGEHDVVRFLDWHGWRWKH
GHJUHHRIIDPLOLDULW\ RUODFNRI RIWKHXVHUZLWKWHFKQRORJ\
DQGPRELOHGHYLFHV$OWKRXJKWKHK\SRWKHVLVODFNVDGGLWLRQDO
HYLGHQFH VRPH VWXGLHV FODLP WKDW LQGLYLGXDOV ERUQ RQ WKH
LQWHUQHWHUD DIWHU DUHPRUHOLNHO\WREHSURILFLHQWZLWK
PRELOHSKRQHVDQGWHFKQRORJ\>@
%HWZHHQ JHQGHUV WKHSHUIRUPDQFH ZDV PRUHRU OHVVWKH
VDPH WKH ZRPHQ KDG D PHDQ VFRUH YDOXH RI  ZKLOH WKH
PHQKDGDPHDQVFRUHRIDIIHFWHGE\WKHSRRUSHUIRUPDQFH
RIWKHHOGHVWJURXS
 ZHUHHQJDJHGE\WKH$SSPD\XVHLWIRUODQJXDJHOHDUQLQJ
)LJ 5HVXOWVIURPWKHTXL] D &RPSDULVRQRIWKHPHDQVREWDLQHGE\WKH
H[SHULPHQWDO JURXS FRQWURO JURXS DQG ERWK JURXSV FRPELQHG E  6FRUH
EUHDNGRZQE\JHQGHUDQGDJHJURXS
7KHUHVXOWVIURPWKHTXL]FRPSOHPHQWVWKHUHVXOWVIURPWKH
VWDWLVWLFDODQDO\VLVDQGSURYLGHDQDQVZHUWRUHVHDUFKTXHVWLRQ
 ³&DQ D PRELOH $SS EDVHG RQ 0/ DOJRULWKPV EH XVHG WR
SUDFWLFH YRFDEXODULHV LQ D IRUHLJQ ODQJXDJH"´ DQG UHVHDUFK
TXHVWLRQ  ³:KHQ FRPSDUHG ZLWK WKH WUDGLWLRQDO ZD\ RI
VWXG\LQJGRHVXVLQJDQ$SSWROHDUQIRUHLJQODQJXDJHVFDXVH
DQ LPSDFW"´ $OWKRXJK WKH GLIIHUHQFH LQ WKH VFRUHV DSSHDUV
VPDOOWKLVPLJKWEHUHODWHGWRWKHGXUDWLRQRIWKHH[SHULPHQW
KRZHYHUDVH[SODLQHGLQ6HFWLRQ,,,$ 6WDWLVWLFDODQDO\VLV 
WKHJURXSVDUHVWDWLVWLFDOO\GLIIHUHQWKHQFHDQ$SSWKDWXVHV
LPDJHVWRWUDQVODWHWH[WDQGVSHHFKFDQEHVXFFHVVIXOO\XVHGWR
365
Authorized licensed use limited to: Oracle. Downloaded on April 17,2024 at 15:56:34 UTC from IEEE Xplore. Restrictions apply.
VWXG\DIRUHLJQODQJXDJHDQGFDXVHDQLPSDFWRQWKHOHDUQLQJ
SURFHVV
& 2SLQLRQVXUYH\
7KHUHVXOWVFROOHFWHGIURPWKHRSLQLRQVXUYH\FDQEHIRXQG
LQ)LJXUH2YHUDOOLWFDQEHVHHQWKDWWKH$SSUHFHLYHGJRRG
DFFHSWDQFHIURPWKHXVHUVDVWKHUHDUH]HURDQVZHUVZLWKDQ
RU D  LQ WKH /LNHUW VFDOH RIWHQ DVVRFLDWHG WR ³FRPSOHWHO\
GLVDJUHH´DQG³VRPHZKDWGLVDJUHH´UHVSHFWLYHO\ 0RUHRYHU
WKH DQVZHUV LQGLFDWH WKDW SHUVRQV PLJKW KDYH KDG VRPH
SUREOHPV XVLQJ WKH $SS DW ILUVW TXHVWLRQ   GXH WR
XQIDPLOLDULW\ZLWKLWEXWVWLOOIRXQGWKH$SSVRPHZKDWIXQWR
XVH TXHVWLRQ $GGLWLRQDOO\XVHUVUHVSRQGHGWKDWWKH$SS
PDGHWKHPIHHOPRWLYDWHGWROHDUQDQHZODQJXDJH TXHVWLRQ
 
$GGHGWRJHWKHUWKHDQVZHUVWRTXHVWLRQVDQGLQGLFDWH
WKDWWKH$SSIHOWFRPSHOOLQJWRWKHVWXGHQWVDQGWKHDQVZHUWR
TXHVWLRQ  LQGLFDWHV WKDW WKH XVHU LQWHUIDFH DQG LQLWLDO
DFFHVVLELOLW\FRXOGEHLPSURYHG
7KHUHVXOWVIURPTXHVWLRQVLQGLFDWHWKDWIRUWKHPRVW
SDUW DIWHU WKH XVHU EHFDPH DFTXDLQWHG ZLWK WKH $SS WKH
SDUWLFLSDQWVGLGQ¶WKDYHDQ\WHFKQLFDOSUREOHP)LQDOO\UHVXOWV
IURP TXHVWLRQV  DQG  LQGLFDWH WKDW VWXGHQWV RYHUDOO OLNHG
XVLQJ WKH $SS DQG PLJKW UHFRPPHQG LW WR WKHLU SHHUV
7RJHWKHUWKHUHVXOWVIURPWKHRSLQLRQVXUYH\DQVZHUUHVHDUFK
TXHVWLRQ  ³&DQ DQ $SS WR OHDUQ IRUHLJQ ODQJXDJHV EH
HQJDJLQJWRWKHXVHU"´
)LJ %UHDNGRZQRIWKHSHUFHQWDJHRIDQVZHUVWRWKHRSLQLRQVXUYH\7KH
FRORUV LQGLFDWH WKH DQVZHU WR HDFKTXHVWLRQ ZKLOHWKH [D[LVLQGLFDWHV WKH
TXHVWLRQ
)URPWKHSUHYLRXVDQDO\VLVWKHUHVXOWVLQGLFDWHWKHXVHUV
DQGFRXOGUHFRPPHQGLWWRWKHLUSHHUV
,9 ',6&866,21
$OWKRXJK WKH GLIIHUHQFH LQ SHUIRUPDQFH EHWZHHQ WKH
H[SHULPHQWDODQGWKHFRQWUROJURXSLQWKHTXL]UHVXOWVLVQRW
WRREURDGWKLVPLJKWEHUHODWHGWRWKHZD\WKHH[SHULPHQWZDV
FRQGXFWHGSDUWLFXODUO\LQWHUPVRIOHQJWK,QDORQJHUVWXG\
DUJXDEO\ WKH GLIIHUHQFHV LQ SHUIRUPDQFH EHWZHHQ WKH
H[SHULPHQWDO DQG WKH FRQWURO JURXS PLJKW EH PRUH
SURQRXQFHG DV VWXGHQWV XVLQJ WKH $SS FRQWLQXRXVO\ FRXOG
VHHDODUJHULPSURYHPHQWWKDQWKRVHQRWXVLQJLW GXHWRDQ
LQFUHDVHGHQJDJHPHQWIURPFRQWLQXRXVXVDJH 
$GGLWLRQDOO\LWVKRXOGEHVWXGLHGZKHWKHUWKHKLJKUDWLQJV
REWDLQHGE\WKHDSSZHUHEDVHGRQWKHQRYHOW\RILWWRPDNH
VXUH WKH VWXGHQWV¶ PRWLYDWLRQ DQG $SS HQJDJHPHQW GR QRW
GHFUHDVHRQFHWKHDSSQRYHOW\IDGHVDZD\WKLVLVLPSRUWDQW
VLQFH IDGLQJ QRYHOW\ LV D UHFXUUHQW SUREOHP LQ HGXFDWLRQ
LQQRYDWLRQPHWKRGRORJLHV>@
)XWXUH ZRUN ZLOO LQFOXGH LPSURYLQJ WKH XVHU LQWHUIDFH
XVLQJWKH$SSGXULQJDPRUHH[WHQGHGSHULRGDQGZLWKPRUH
SDUWLFLSDQWV LQ HYHU\ DJH JURXS (YHQ LI ZH WKLQN WKH SRRU
SHUIRUPDQFH H[KLELWHG E\ WKH HOGHVW JURXS LV DVVRFLDWHG WR
GLJLWDOOLWHUDF\IXUWKHUHYLGHQFHLVQHFHVVDU\WRVXSSRUWWKLV
VWDWHPHQW DGGLWLRQDO UHVHDUFK FRXOG EH FRQGXFWHG WR
GHWHUPLQH ZKHWKHU WKH HIIHFWLYHQHVV RI 0OHDUQLQJ LV
LQIOXHQFHGE\WKHDJHRIWKHXVHUEDVHGRQWKHLUOLWHUDF\DQG
ZLOOLQJQHVVWRXVHQHZVWXG\PHWKRGRORJLHV
,QDGGLWLRQWRVWXG\LQJWKHPHQWLRQHGGHWDLOVDIXWXUHIXOO
IOHGJHG ZRUN ZLOO LQFOXGH DGGLWLRQDO LQIRUPDWLRQ RQ WKH
GHYHORSPHQWRIWKH$SSDPRUHLQWULFDWHH[SHULPHQWDOGHVLJQ
DQGDQDO\VLVDQGIXUWKHUDVVHVVPHQWRQWKHXVHUHQJDJHPHQW
DQGPRWLYDWLRQ
9 6800$5<&21&/86,216$1')8785(:25.
$Q$SSFDSDEOHRIWUDQVODWLQJWKHREMHFWVLQDQLPDJHRU
SKRWRJUDSK ZDV GHYHORSHG IRU WKH $QGURLG SODWIRUP XVLQJ
PDFKLQH OHDUQLQJ DOJRULWKPV WKH VDPH $SS LV FDSDEOH RI
FUHDWLQJ TXL]]HV EDVHG RQ WKH XVDJH WR VWXG\ DQG OHDUQ
GLIIHUHQWODQJXDJHV
$JURXSRILQGLYLGXDOVXVHGWKH$SSWRWU\WROHDUQDQG
VWXG\VRPHZRUGVLQWKH3ROLVKODQJXDJHWKHUHVXOWVIURPWKH
H[SHULPHQWDOJURXSZHUHFRPSDUHGZLWKDFRQWUROJURXSWKDW
OHDUQHG DQG VWXGLHG ZRUGV LQ WKH VDPH ODQJXDJH XVLQJ
FRQYHQWLRQDO PHWKRGV $IWHU WKH TXL] WKH SDUWLFLSDQWV
DQVZHUHGDQRSLQLRQVXUYH\WRHYDOXDWHWKHXVHUDFFHSWDQFH
)URPWKHH[SHULPHQWWKHIROORZLQJZDVFRQFOXGHG
• 7KHH[SHULPHQWDOJURXSSHUIRUPHGEHWWHUWKDQWKH
FRQWUROJURXSDOEHLWVOLJKWO\
• 7KH PDOHV DQG IHPDOHV SHUIRUPHG VLPLODUO\ WKH
PHDQ GLIIHUHQFH ZDV   +RZHYHU WKHUH ZHUH
ODUJHUGLIIHUHQFHVLQSHUIRUPDQFHEHWZHHQWKHDJH
JURXSVWKH\RXQJHVWJURXS
• 7KH HOGHVW JURXS XVLQJ WKH $SS KDG WKH SRRUHVW
SHUIRUPDQFH LQ WKH 4XL] $OWKRXJK IXUWKHU
HYLGHQFH LV QHFHVVDU\ WKH ORZ VFRUH FRXOG EH
DWWULEXWHGWRSUREOHPVZLWKWHFKQRORJ\DQGGLJLWDO
LOOLWHUDF\
• 7KH SDUWLFLSDQWV OLNHG XVLQJ WKH $SS DQG
FRQVLGHULQJLWPRWLYDWLQJWROHDUQQHZODQJXDJHV
• )XWXUH VWXG\ LV QHFHVVDU\ WR DVFHUWDLQ WKH
DFFHSWDQFH RI WKH $SS ZDV QRW GXH WR QRYHOW\
ZKLFKPLJKWIDGHDZD\ZLWKFRQVWDQWXVH
)XWXUHZRUNZLOOFRQVLVWRIWHVWLQJWKH$SSGXULQJDPRUH
H[WHQGHGSHULRGDQGDGGLQJDGGLWLRQDOIXQFWLRQDOLWLHVWRWKH
$SSOLNHPDWKHPDWLFVDQGFKHPLFDOFRPSRXQGLQWHUSUHWDWLRQ
DQG WUDQVODWLRQ 0RUHRYHU VLQFH UHVXOWV LQGLFDWH JRRG
DFFHSWDQFH RI WKH $SS RXU UHVHDUFK JURXS SODQV RQ

366
Authorized licensed use limited to: Oracle. Downloaded on April 17,2024 at 15:56:34 UTC from IEEE Xplore. Restrictions apply.
GHYHORSLQJ DGGLWLRQDO 0OHDUQLQJ UHVRXUFHV IRU GLIIHUHQW
GLVFLSOLQHV DQG VWXG\LQJ GLIIHUHQW SDUDPHWHUV VXFK DV WKH
LPSDFWRIWKHXVHU¶VDJHIRU0OHDUQLQJ
$&.12:/('*0(17
7KHDXWKRUVZRXOGOLNHWRDFNQRZOHGJHWKHILQDQFLDODQG
WKHWHFKQLFDOVXSSRUWRI:ULWLQJ/DE,QVWLWXWHIRUWKH)XWXUH
RI (GXFDWLRQ 7HFQRORJLFR GH 0RQWHUUH\ 0H[LFR LQ WKH
SURGXFWLRQRIWKLVZRUN
5()(5(1&(6

>@ &URPSWRQ +   $ KLVWRULFDO RYHUYLHZ RI PRELOH OHDUQLQJ
7RZDUG OHDUQHUFHQWHUHG HGXFDWLRQ ,Q = / %HUJH  / <
0XLOHQEXUJ (GV +DQGERRNRIPRELOHOHDUQLQJ SS± )ORUHQFH
.<5RXWOHGJH
>@ 50RJRV&%RGHD0'DVFDOX26DIRQNLQD(/D]DURX(7ULIDQ
,9 1HPRLDQX ³7HFKQRORJ\ HQKDQFHG OHDUQLQJ IRU ,QGXVWU\ 
HQJLQHHULQJHGXFDWLRQ´5HY5RXP6FL7HFKQYROQRSS

>@ $OMDZDUQHK 6   ³5HYLHZLQJ DQG H[SORULQJ LQQRYDWLYH
XELTXLWRXVOHDUQLQJWRROVLQKLJKHUHGXFDWLRQ´-RXUQDORI&RPSXWLQJ
LQ+LJKHU(GXFDWLRQYROSS
>@ &RPPLVVLRQ RI WKH (XURSHDQ &RPPXQLWLHV $GXOW OHDUQLQJ ,W LV
QHYHUWRRODWHWROHDUQ&20  ILQDO%UXVVHOV
>@ 7DOHE=$KPDGL$0XVDYL0  ³7KHHIIHFWRI0OHDUQLQJ
RQPDWKHPDWLFVOHDUQLQJ´3URFHGLD±6RFLDODQG%HKDYLRUDO6FLHQFHV
SS 
>@ $OTDKWDQL 0   7KH LPSRUWDQFH RI YRFDEXODU\ LQ ODQJXDJH
OHDUQLQJ DQG KRZ WR EH WDXJKW,QWHUQDWLRQDO MRXUQDO RI WHDFKLQJ DQG
HGXFDWLRQ  
>@ $EX$O$LVK $   ³7RZDUG PRELOH OHDUQLQJ GHSOR\PHQW LQ
KLJKHUHGXFDWLRQ´%UXQHO8QLYHUVLW\
>@ 5 5\DQ DQG ( 'HFL   ³6HOIGHWHUPLQDWLRQ WKHRU\ DQG WKH
IDFLOLWDWLRQ RI LQWULQVLF PRWLYDWLRQ VRFLDO GHYHORSPHQW DQG ZHOO
EHLQJ´$PHULFDQ3V\FKRORJLVWYROQRSS±
>@ %URZQOHH-  'HHS/HDUQLQJIRU&RPSXWHU9LVLRQ
>@ 'DL -  2FWREHU  5HDOWLPH DQG DFFXUDWH REMHFW GHWHFWLRQ RQ
HGJHGHYLFHZLWK7HQVRU)ORZ/LWH,Q-RXUQDORI3K\VLFV&RQIHUHQFH
6HULHV 9RO1RS ,233XEOLVKLQJ
>@ $OVLQJ 2  0RELOH REMHFWGHWHFWLRQXVLQJWHQVRUIORZ OLWH DQG
WUDQVIHUOHDUQLQJ
>@ =RX=6KL=*XR< <H-  2EMHFWGHWHFWLRQLQ\HDUV
$VXUYH\DU;LYSUHSULQWDU;LY
>@ :LQGPLOO(  )OXWWHULQDFWLRQ6LPRQDQG6FKXVWHU
>@ 6 6 6KDSLUR 0 % :   $Q DQDO\VLV RI YDULDQFH WHVW IRU
QRUPDOLW\ FRPSOHWHVDPSOHV  %LRPHWULND ± SS±
>@ 6LHJHO6DQG&DVWHOOiQ--  1RQSDUDPHWULF6WDWLVWLFVIRU7KH
%HKDYLRUDO6FLHQFHV
>@ 0 3UHQVN\   ³'LJLWDO 1DWLYHV 'LJLWDO ,PPLJUDQWV´ 2Q WKH
+RUL]RQ8QLYHUVLW\3UHVV
>@ 6WDQGDUGV IRU 7HFKQRORJLFDO /LWHUDF\ &RQWHQW IRU WKH 6WXG\ RI
7HFKQRORJ\ HG  5HVWRQ 9LUJLQLD ,QWHUQDWLRQDO 7HFKQRORJ\
(GXFDWLRQ$VVRFLDWLRQSS
>@ %XHQWHOOR0RQWR\D'$/RPHOt3ODVFHQFLD0*0HGLQD+HUUHUD
/0  ³7KHUROHRIUHDOLW\HQKDQFLQJWHFKQRORJLHVLQWHDFKLQJ
DQGOHDUQLQJRIPDWKHPDWLFV´&RPSXWHUV (OHFWULFDO(QJLQHHULQJ