VW<RXWK$FDGHPLF$QQXDO&RQIHUHQFHRI&KLQHVH$VVRFLDWLRQRI$XWRPDWLRQ

:XKDQ&KLQD1RYHPEHU

2YHUYLHZRI'HHS/HDUQLQJ

;XHGDQ'X <LQJKDR&DL 6KXR:DQJDQG/HLMLH=KDQJ

7KH6WDWH.H\/DERUDWRU\RI0DQDJHPHQWDQG&RQWUROIRU&RPSOH[6\VWHPV ,QVWLWXWHRI$XWRPDWLRQ&$6
%HLMLQJ&KLQD
(PDLOV GX[XHGDQ#LDDFFQ\LQJKDRFDL#LDDFFQVKXRZDQJ#LDDFFQ]KDQJOHLMLH#LDDFFQ

Abstract²,Q UHFHQW \HDUV GHHS OHDUQLQJ KDV DFKLHYHG JUHDW
VXFFHVV LQ PDQ\ ILHOGV VXFK DV FRPSXWHU YLVLRQ DQG QDWXUDO
ODQJXDJH SURFHVVLQJ &RPSDUHG WR WUDGLWLRQDO PDFKLQH OHDUQLQJ
PHWKRGVGHHSOHDUQLQJKDVDVWURQJOHDUQLQJDELOLW\DQGFDQPDNH
EHWWHU XVH RI GDWDVHWV IRU IHDWXUH H[WUDFWLRQ %HFDXVH RI LWV
SUDFWLFDELOLW\GHHSOHDUQLQJEHFRPHVPRUHDQGPRUHSRSXODUIRU
PDQ\UHVHDUFKHUVWRGRUHVHDUFKZRUNV,QWKLVSDSHUZHPDLQO\
LQWURGXFH VRPH DGYDQFHG QHXUDO QHWZRUNV RI GHHS OHDUQLQJ DQG
WKHLU DSSOLFDWLRQV %HVLGHV ZH DOVR GLVFXVV WKH OLPLWDWLRQV DQG
SURVSHFWVRIGHHSOHDUQLQJ
Keywords—deep learning; machine learning; neural network
, ,1752'8&7,21
'HHSOHDUQLQJZDVGHYHORSHGIURPDUWLILFLDOQHXUDOQHWZRUN
DQGQRZLWLVDSUHYDOHQWILHOGRIPDFKLQHOHDUQLQJ7KHUHVHDUFK
RIDUWLILFLDOQHXUDOQHWZRUNEHJDQIURPV0F&XOORFK et al
SHUIRUPDQFH RI WUDGLWLRQDO PDFKLQH OHDUQLQJ PHWKRGV XVXDOO\
UHO\RQXVHUV¶H[SHULHQFHVZKLOH GHHSOHDUQLQJDSSURDFKHVUHO\
RQ WKH GDWD 7KHUHIRUH ZH FDQ ILQG RXW WKDW GHHS OHDUQLQJ
DSSURDFKHV KDYH UHGXFHG WKH GHPDQGV IRU XVHUV :LWK WKH
SURJUHVV RI FRPSXWHU WHFKQRORJ\ FRPSXWHUV¶ SHUIRUPDQFH LV
UDSLGO\LPSURYHG0HDQZKLOHLQIRUPDWLRQRQWKH,QWHUQHWLVDOVR
VSHZLQJ RXW 7KHVH IDFWRUV SURYLGH D VWURQJ LPSHWXV IRU GHHS
OHDUQLQJ WR GHYHORS DQG PDNH GHHS OHDUQLQJ EHFRPH WKH
SUHYDOHQWPHWKRGLQPDFKLQHOHDUQLQJ
,Q WKLV SDSHU ZH PDNH D V\VWHPDWLF LQWURGXFWLRQ IRU GHHS
OHDUQLQJ IURP PDQ\ DVSHFWV E\ H[SDWLDWLQJ LWV UHVHDUFK
SURJUHVVHV VWDWHRIWKHDUW PRGHOV IUDPHZRUNV DQG
DSSOLFDWLRQV UHVSHFWLYHO\ )LUVW ZH LQWURGXFH WKH UHVHDUFK
SURJUHVVHVLQ6HFWLRQ,,7KHQZHLQWURGXFHVHYHUDOW\SLFDOGHHS
OHDUQLQJ PRGHOV LQ 6HFWLRQ ,,, DQG VHYHUDO GHHS OHDUQLQJ
IUDPHZRUNV LQ 6HFWLRQ ,9 1H[W ZH OLVW VRPH DSSOLFDWLRQV RI
>@SURSRVHGWKH0F&XOORFK3LWWV 03 PRGHOE\DQDO\]LQJDQG
VXPPDUL]LQJ WKH FKDUDFWHULVWLFV RI QHXURQV +HEE et al >@
SURSRVHG D FHOO DVVHPEO\ WKHRU\ WR H[SODLQ WKH DGDSWDWLRQ RI
FHUHEUDOQHXURQGXULQJWKHOHDUQLQJSURFHVV7KLVWKHRU\KDGDQ
LPSRUWDQW LQIOXHQFH RQ WKH GHYHORSPHQW RI QHXUDO QHWZRUNV
7KHQ 5RVHQEODWW et al >@ LQYHQWHG WKH SHUFHSWURQ DOJRULWKP
7KLV DOJRULWKP LV D NLQG RI ELQDU\ FODVVLILHU ZKLFK EHORQJV WR
VXSHUYLVHG OHDUQLQJ :LGURZ SURSRVHG WKH DGDSWLYH OLQHDU
HOHPHQWDQGLWLVDVLQJOHOD\HUDUWLILFLDOQHXUDOQHWZRUNEDVHG
RQWKH03PRGHO8QIRUWXQDWHO\0LQVN\DQG3DSHUWSRLQWHGWKDW
WKH SHUFHSWURQ DOJRULWKP KDG JUHDW OLPLWDWLRQV LQ WKHRU\ DQG
PDGHDQHJDWLYHHYDOXDWLRQRQWKHSURVSHFWVRIQHXUDOQHWZRUNV
ZKLFK OHG WKH GHYHORSPHQW RI QHXUDO QHWZRUNV WR KLW D QDGLU
+RZHYHU+RSILHOGet al>@SURSRVHGWKH+RSILHOGQHWZRUNLQ
WKH HDUO\ V 7KLV PDGH DUWLILFLDO QHXUDO QHWZRUN UHYLYHG
7KHQ+LQWRQet al. >@SURSRVHGWKH%ROW]PDQQPDFKLQHE\XVLQJ
VLPXODWHG DQQHDOLQJ DOJRULWKP ,Q WKH V YDULRXV VKDOORZ
PDFKLQHOHDUQLQJPHWKRGVZHUHSURSRVHGRQHDIWHUDQRWKHUVXFK
DV VXSSRUW YHFWRU PDFKLQH >@ %RRVWLQJ >@ 'XH WR WKH
DGYDQWDJHVRIWKHVHPHWKRGVERWKLQWKHRU\DQGLQDSSOLFDWLRQ
DUWLILFLDOQHXUDOQHWZRUNKLWDQDGLUDJDLQ$IWHU+LQWRQHWDOSXW
IRUZDUGWKHFRQFHSWRIGHHSOHDUQLQJLQWKHMRXUQDO6FLHQFHLQ
DUWLILFLDOQHXUDOQHWZRUNRQFHDJDLQUHFHLYHGPXFKLQWHUHVW
IURPWKHUHVHDUFKFRPPXQLW\
'HHSOHDUQLQJPRGHOVXVXDOO\DGRSWKLHUDUFKLFDOVWUXFWXUHV
WR FRQQHFW WKHLU OD\HUV 7KH RXWSXW RI D ORZHU OD\HU FDQ EH
UHJDUGHG DV WKH LQSXW RI D KLJKHU OD\HU YLD VLPSOH OLQHDU RU
QRQOLQHDU FDOFXODWLRQV 7KHVH PRGHOV FDQ WUDQVIRUP ORZOHYHO
GHHS OHDUQLQJ LQ 6HFWLRQ 9 )LQDOO\ ZH FRQFOXGH WKLV SDSHU LQ
6HFWLRQ9,
,, 5(6($5&+352*5(66(6
7KHFRQFHSWRIGHHSOHDUQLQJZDVSXWIRUZDUGLQDWILUVW
$IWHUWKDWGHHSOHDUQLQJLVVWLOOFRQWLQXDOO\GHYHORSLQJDWDEURDG
$WSUHVHQWWKHUHDUHPDQ\RXWVWDQGLQJILJXUHVVXFKDV*HRIIUH\
+LQWRQ<RVKXD%HQJLR<DQQ/H&XQDQG$QGUHZ1J7KH\DUH
OHDGLQJWKHUHVHDUFKGLUHFWLRQRIGHHSOHDUQLQJ6RPHFRPSDQLHV
OLNH *RRJOH DQG )DFHERRN KDYH PDGH ORWV RI UHVHDUFK
DFKLHYHPHQWVLQGHHSOHDUQLQJDQGDSSOLHGWKHPWRYDULRXVILHOGV
,QWKLV\HDU*RRJOH¶V$OSKD*RSURJUDPGHIHDWHG/HH6HGROLQ
*RFRPSHWLWLRQZKLFKVKRZHGWKDWGHHSOHDUQLQJKDGDVWURQJ
OHDUQLQJ DELOLW\ :KDW¶V PRUH *RRJOH¶V 'HHS'UHDP LV DQ
H[FHOOHQW VRIWZDUH ZKLFK FDQ QRW RQO\ FODVVLI\ LPDJHV EXW
JHQHUDWH VWUDQJH DQG DUWLILFLDO SDLQWLQJV EDVHG RQ LWV RZQ
NQRZOHGJH )DFHERRN DQQRXQFHG D QHZ DUWLILFLDO LQWHOOLJHQFH
V\VWHPQDPHG'HHS7H[W'HHS7H[WLVDGHHSOHDUQLQJEDVHG
WH[WXQGHUVWDQGLQJHQJLQHZKLFKFDQFODVVLI\PDVVLYHDPRXQWV
RIGDWDSURYLGHFRUUHVSRQGLQJVHUYLFHVDIWHULGHQWLI\LQJXVHUV¶
FKDWWLQJPHVVDJHVDQGFOHDQXSVSDPPHVVDJHV
'HHS OHDUQLQJ VWDUWHG UHODWLYHO\ ODWH EXW GHYHORSHG YHU\
UDSLGO\ DW KRPH 7KHUH KDYH DFKLHYHG UHPDUNDEOH SURJUHVV LQ
FROOHJHVXQLYHUVLWLHVUHVHDUFKLQVWLWXWHVDQGFRPSDQLHV%DLGX
KDV HVWDEOLVKHG D GHHS OHDUQLQJ LQVWLWXWH WR H[SORUH KRZ WR
FRPSOHWH PDQ\ D WDVN ZLWK GHHS OHDUQLQJ %DLGX¶V XQPDQQHG
JURXQG YHKLFOH KDV DFFRPSOLVKHG URDG WHVW XQGHU FRPSOLFDWHG
URDG FRQGLWLRQV ,)/<7(. VWDUWHG WKH UHVHDUFK RI VSHHFK
IHDWXUHVRIWKHGDWDLQWR KLJKOHYHODEVWUDFWIHDWXUHV2ZQLQJ WR
WKLV FKDUDFWHULVWLF GHHS OHDUQLQJ PRGHOV FDQ EH VWURQJHU WKDQ
VKDOORZPDFKLQHOHDUQLQJPRGHOVLQIHDWXUHUHSUHVHQWDWLRQ7KH
7KLVZRUNLVVXSSRUWHGLQSDUWE\WKH1DWLRQDO1DWXUDO6FLHQFH )RXQGDWLRQ
RI&KLQDXQGHU*UDQWV
UHFRJQLWLRQ EDVHG RQ 'HHS 1HXUDO 1HWZRUN '11 LQ 
7KH\ ODXQFKHG WKH ILUVW RQOLQH &KLQHVH VSHHFK UHFRJQLWLRQ
V\VWHP DQG DQ DGYDQFHG WHFKQRORJ\ WR UHFRJQL]H GLIIHUHQW


‹,(((
ODQJXDJHV$QGQRZWKH\KDYHSXEOLVKHGDKLJKSHUIRUPDQFH
\ /[[ÿ
FRPSXWLQJ+3&SODWIRUPLQFRRSHUDWLRQZLWK,QWHO
,,, '((3/($51,1*02'(/6
)URP WKH EHJLQQLQJ WR WKH SUHVHQW WKHUH DUH D ORW RI GHHS
OHDUQLQJPRGHOV 7KHW\SLFDOPRGHOVLQFOXGH$XWRHQFRGHU$(
'HHS %HOLHI 1HWZRUN '%1 &RQYROXWLRQDO 1HXUDO 1HWZRUN
&11DQG5HFXUUHQW1HXUDO1HWZRUN511,QWKLVVHFWLRQ
ZHPDLQO\LQWURGXFHVRPHVWDWHRIWKHDUWPRGHOV [ [ÿ

A. Autoencoder )LJ 7KHEDVLFSULQFLSOHRI$XWRHQFRGHU

$XWRHQFRGHU LV PDLQO\ XVHG WR SURFHVV FRPSOH[ KLJK
GLPHQVLRQDOGDWD,WVDLPLVWROHDUQKRZWRUHSUHVHQWDVHWRIGDWD +LGGHQOD\HUh
YLDGLPHQVLRQDOLW\UHGXFWLRQ:KHQZHSURFHVVWKHLQSXWx E\
XVLQJDVHULHVRIZHLJKWLQJDQGPDSSLQJPHWKRGVZHFDQJHWWKH
ORZGLPHQVLRQDO RXWSXWy7KHQZHDGRSWWKHLQYHUVHZHLJKWLQJ
DQG PDSSLQJ PHWKRGV WR PDNH y WUDQVIRUP WR WKH RXWSXW x’
ZKRVHGLPHQVLRQLVDVWKHVDPHDVWKHLQSXWx1RZDOOZHKDYH 9LVXDOOD\HUv
WRGRLVWRPDNHWKHHUURUIXQFWLRQLx, x’EHWKHVPDOOHVWE\
WUDLQLQJLWHUDWLYHO\WKHQHWZRUNZHLJKWV7KHEDVLFSULQFLSOHRI
$(LVVKRZQLQ)LJ
$( DOVR KDV PDQ\ LPSURYHG VWUXFWXUHV OLNH 'HQRLVLQJ
$XWRHQFRGHU >@ DQG 6SDUVH $XWRHQFRGHU >@ )RU 'HQRLVLQJ
$XWRHQFRGHULWXVHVWKHRULJLQDOGDWDZLWKUDQGRPQRLVHWRWUDLQ
QHWZRUNZHLJKWVZKLFKPDNHVH[WUDFWHGIHDWXUHVEHFRPHPRUH
UREXVW)RU6SDUVH$XWRHQFRGHUEHVLGHVLQFUHDVLQJWKHQXPEHU
RI KLGGHQ OD\HUV DQG QHXURQV 6SDUVH $XWRHQFRGHU OLPLWV WKH
DFWLYDWLRQVWDWHRIKLGGHQQRGHVZKLFKRQO\DVPDOOQXPEHURI
KLGGHQQRGHVDUHLQWKHDFWLYDWHGVWDWHDQGPRVWRIKLGGHQQRGHV
DUH LQWKHXQDFWLYDWHGVWDWH
;LRQJet al>@SURSRVHGDPRGLILHGDXWRHQFRGHUQHWZRUN
WR UHFRJQL]H DQG VHSDUDWH DQRPDORXV RQHV IURP D VHW RI
)LJ 7KHEDVLFVWUXFWXUHRIUHVWULFWHG%ROW]PDQQPDFKLQH
)LJ
$IWHULQFUHDVLQJWKHQXPEHURIWKHKLGGHQOD\HUVRI5%0
ZHFDQJHWGHHS%ROW]PDQQPDFKLQH7KHQZHDGRSWDWRSGRZQ
GLUHFWHGFRQQHFWLRQQHDUWKHYLVXDOOD\HUVRWKDWZHFDQJHW'%1
PRGHO :KHQ WUDLQLQJ WKH QHWZRUN WKH JUHHG\ XQVXSHUYLVHG
OD\HUZLVHSUHWUDLQLQJPHWKRGFDQEHXVHGWRJHWWKHQHWZRUN
ZHLJKWV,WRQO\WUDLQVRQHOD\HUDWDWLPHZLWKWKHRXWSXWRIWKH
ORZHU OD\HU EHLQJ XVHG DV WKH LQSXW RI WKH KLJKHU OD\HU 7KHQ
EDFNSURSDJDWLRQ DOJRULWKP LV XVHG WR ILQHWXQH WKH ZKROH
QHWZRUN
/LX et al >@ SURSRVHG D QRYHO %RRVWHG 'HHS %HOLHI
JHRFKHPLFDO VDPSOHV &RQWLQXRXV 5HVWULFWHG %ROW]PDQQ 1HWZRUN%'%1ZKLFKFRQVLVWVRIVHYHUDO'%1V(DFK'%1
0DFKLQH&5%0LVXVHGDVWKHSDUWRIWKHDXWRHQFRGHUQHWZRUN LVXVHGWROHDUQKLHUDUFKLFDOIHDWXUHUHSUHVHQWDWLRQVDQGDOO'%1V
LQ>@7KHDXWKRUVDGRSWWKUHHVWHSVWRWUDLQWKHPRGHOZKLFK ZKLFK DUH UHJDUGHG DV ZHDN OHDUQHUV DUH FRQQHFWHG WRJHWKHU
DUH SUHWUDLQLQJ &5%0V XQUROOLQJ &5%1V WR FRQVWUXFW WKH WKURXJK D ERRVWHG FODVVLILHU %'%1 DGRSWV D ERWWRPXS
QHWZRUN DQG ILQHWXQLQJ SDUDPHWHUV YLD EDFNSURSDJDWLRQ XQVXSHUYLVHGIHDWXUHOHDUQLQJ%88)/SURFHVVDQGDERRVWHG
)LQDOO\ WKLV DSSURDFK DFKLHYHV JRRG UHVXOWV LQ UHFRJQL]LQJ
PXOWLYDULDWHJHRFKHPLFDODQRPDOLHV
/RXL]RV et al >@ SURSRVHG D YDULDWLRQDO IDLU DXWRHQFRGHU
PRGHO ZKLFK FRXOG PDNH ODWHQW UHSUHVHQWDWLRQV PD[LPDOO\
LQIRUPDWLYH DERXW REVHUYHG UDQGRP YDULDEOHV EXW PLQLPDOO\
LQIRUPDWLYHDERXWVHQVLWLYHRUQXLVDQFHYDULDEOHV,QRWKHUZRUGV
WKHPRGHOFRXOGVHSDUDWHXQGHVLUHGIDFWRUVIURPWKHYDULDWLRQV
ZKLOH UHWDLQLQJ DV PXFK LQIRUPDWLRQ DV SRVVLEOH IURP ZKDW
UHPDLQV,QRUGHUWRUHPRYHVHQVLWLYHRUQXLVDQFHYDULDEOHVIURP
ODWHQW UHSUHVHQWDWLRQV >@ DGGHG D SHQDOW\ WHUP EDVHG RQ
0D[LPXP 0HDQ 'LVFUHSDQF\ PHDVXUH WR WKH PRGHO $W ODVW
WKH\DSSOLHGWKLVPRGHOWRVRPHWDVNVDQGJRWJUHDWUHVXOWV
B. Deep Belief Network
'HHS%HOLHI1HWZRUNLVDNLQGRIQHXUDOQHWZRUNZKLFKLV
WRSGRZQVXSHUYLVHGIHDWXUHVWUHQJWKHQ%7'6)6SURFHVV,W
LV XVHG WR UHFRJQL]H IDFLDO H[SUHVVLRQV 7KH QHWZRUN GLYLGHV
IDFLDOLPDJHVLQWRPDQ\SDUWLDOO\RYHUODSSHGSDWFKHV$QGWKHQ
LW XVHV %88)/ SURFHVV WR OHDUQ IHDWXUH UHSUHVHQWDWLRQ IURP
HDFKSDWFKZLWKRQH'%1DQG%7'6)6SURFHVVWRILQHWXQHWKH
IHDWXUHVE\SURFHVVLQJFODVVLILFDWLRQHUURUVSURGXFHGE\ERRVWHG
FODVVLILHUDQGZHDNOHDUQHUV)LQDOO\WKHPRGHOJHWVEHWWHUUHVXOWV
WKDQRWKHUUHODWHGZRUN7KHVWUXFWXUHRIWKLVPRGHOLVVKRZQLQ
)LJ
.LP et al >@ SURSRVHG D ILQJHUSULQW OLYHQHVV GHWHFWLRQ
PHWKRGZKLFKFRXOGGLVWLQJXLVKZKHWKHUDVFDQQHGILQJHUSULQWLV
OLYHRUIDNHSULRUWRWKHUHFRJQLWLRQ7KHPRGHOLQ>@XVHVD
GHHSEHOLHIQHWZRUN7KHVWUXFWXUHRI'%1LVDVWKHVDPHDVD
QRUPDO '%1 H[FHSW IRU WKH ODVW OD\HU ZKLFK KDV WZR RXWSXW
QRGHVWRPDNHOLYHQHVVGHFLVLRQ%HIRUHLQSXWWLQJGDWDWR'%1
VWDFNHG E\ VHYHUDO UHVWULFWHG %ROW]PDQQ PDFKLQHV 5%0V
5%0LVDNLQGRIJHQHUDWLYHVWRFKDVWLFQHXUDOQHWZRUNPRGHOV
ZKLFKFRPHVIURPWKH%ROW]PDQQPDFKLQH$OWKRXJK5%0KDV
LQKHULWHG WKH WZROD\HU QHXURQ VWUXFWXUH RI WKH %ROW]PDQQ
PDFKLQH WKHUH LV QR FRQQHFWLRQ EHWZHHQ QHXURQV LQ WKH VDPH
OD\HUZLWKRQO\WKHZKROHFRQQHFWLRQEHWZHHQWKHYLVXDOOD\HU
DQGWKHKLGGHQOD\HU7KHEDVLFVWUXFWXUHRI5%0LVVKRZQLQ

ILQJHUSULQWLPDJHVVKRXOGEHSURFHVVHG7KHDXWKRUVXVHWKHWZR
GLPHQVLRQDO+DUULVFRUQHUGHWHFWRUWRLQIHUWKHDYHUDJHORFDWLRQ
ZKLFKFRQWDLQHGWKHUHJLRQRILQWHUHVW7KHPRGHOLVSUHWUDLQHG
E\XQVXSHUYLVHGOHDUQLQJZLWKDQGILQHWXQHGZLWKDWUDLQLQJVHW
RIODEHOHGLQSXWV/DVWO\WKHH[SHULPHQWVVKRZWKDWWKHSURSRVHG
PHWKRGFDQSURYLGHHIILFLHQWDQGHIIHFWLYHILQJHUSULQWOLYHQHVV
GHWHFWLRQWRSUHYHQWVSRRILQJE\IDNHILQJHUSULQWV
 %RRVWLQJ
)RUHVWVZKLFKLVDQRYHOVWUXFWXUHWKDWXQLILHVFODVVLILFDWLRQWUHHV
ZLWK&11,QWKHLUSDSHUWKHQHWZRUNVWUXFWXUHLVYHU\FOHDUWKDW
6HOHFWHG3DWFKHV
WKH\ UHSODFH WKH VRIWPD[ OD\HU ZLWK D VWRFKDVWLF DQG
GLIIHUHQWLDEOHGHFLVLRQWUHHPRGHO7KHGHFLVLRQWUHHLVDNLQGRI
WUHHVWUXFWXUHG FODVVLILHU ZKLFK FRQVLVWV RI GHFLVLRQ QRGHV DQG
SUHGLFWLRQQRGHV7KH GHFLVLRQQRGHVGHFLGHWKHURXWHVWKDWKRZ
VDPSOHVSDVV DORQJWKHWUHH7KHSUHGLFWLRQQRGHVDUHWRFDOFXODWH

)HHGIRUZDUG

)HHGIRUZDUG
%DFNIRUZDUG
)HHGIRUZDUG

WKHLU SUHGLFWLRQV )LQDOO\ DOO SUHGLFWLRQV ZLOO EH DYHUDJHG

VHSDUDWHO\DQGWKHVDPSOHVFDQEHMXGJHGWKDWZKLFKFODVVWKH\
EHORQJWR2QEDFNSURSDJDWLRQWKH\DGRSWPLQLPXPHPSLULFDO
ULVNSULQFLSOHWRILQHWXQHWKHQHWZRUN7KHVWUXFWXUHRIWKHWUHH
PRGHOLVVKRZQLQ)LJ

WKSDWFK 0
WKSDWFK 1S
WKSDWFK /HYLQHet al>@SURSRVHGDQDSSURDFKZKLFKFRRUGLQDWHV
WKH KDQG DQG H\H RI D URERW WR JUDVS WKLQJV IURP PRQRFXODU
)LJ 7KHVWUXFWXUH RIWKH%RRVWHG'HHS%HOLHI1HWZRUNZKLFKFRQVLVWVRI LPDJHV7KHDSSURDFKXQLILHVUHLQIRUFHPHQWOHDUQLQJZLWKGHHS
PXOWLSOHGHHSEHOLHIQHWZRUNV2QO\WKHRQHVLQWKH GRWWHGER[ ZLOOEHILQH
WXQHGMRLQWO\$GDSWHGIURP>@
C. Convolutional Neural Network
,Q V WKH FRQFHSW RI WKH UHFHSWLYH ILHOG ZDV SURSRVHG
7KHQHRFRJQLWURQ >@ EDVHGRQWKHUHFHSWLYHILHOGSURSRVHGLQ
V ZDV FRQVLGHUHG DV WKH SUHGHFHVVRU RI &11 7KH
UHPDUNDEOHFKDUDFWHULVWLFRI&11LVWKDWWKHQHWZRUNXVHVWKH
ORFDO UHFHSWLYH ILHOG DQG ZHLJKW VKDULQJ %\ XVLQJ WKHVH WZR
VWUDWHJLHV WKH QXPEHU RI WUDLQLQJ SDUDPHWHUV LV UHGXFHG
VLJQLILFDQWO\ ZKLFK FDQ PDNH WKH QHWZRUN EHFRPHV OHVV
FRPSOLFDWHG $ W\SLFDO &11 VWUXFWXUH FRQVLVWV RI VRPH
FRQYROXWLRQDOOD\HUVSRROLQJOD\HUVDQGIXOO\FRQQHFWHGOD\HUV
7KHFRQYROXWLRQDOOD\HULVXVHGIRUIHDWXUHH[WUDFWLRQ(DFKLQSXW
RIWKHQHXURQLQWKLVOD\HULVFRQQHFWHGWRDORFDOUHFHSWLYHILHOG
RI WKH SUHYLRXV RQH 7KH SRROLQJ OD\HU LV XVHG IRU IHDWXUH
PDSSLQJ ,W FDQ UHGXFH WKH GLPHQVLRQ RI GDWD DQG EH DEOH WR
PDLQWDLQWKHLQYDULDQFHRIWKHQHWZRUNVWUXFWXUH
,QUHFHQW\HDUV&11KDVJRWORWVRIDWWHQWLRQVIURPPDQ\
UHVHDUFKHUV,WLVDQH[FHOOHQWPRGHOWKDWFDQDFFRPSOLVKWDVNV
HIILFLHQWO\ 7KHUH DUH PDQ\ W\SHV RI &11 VWUXFWXUHV VXFK DV
/H1HW >@ $OH[1HW >@ =)1HW >@ 9**1HW >@ DQG
*RRJOH1HW>@/H&XQHWDOSURSRVHGDFRQYROXWLRQDOQHXUDO
OHDUQLQJ ,Q WKHLU SDSHU DXWKRUV XVH FRQYROXWLRQDO QHXUDO
QHWZRUNV WR PDNH D SUHGLFWLRQ WKDW ZKHWKHU WKH PRWLRQ RI WKH
JULSSHUFRXOGUHVXOWLQDVXFFHVVIXOJUDVS7KHFXUUHQWLPDJHVIW
DQGWKHRULJLQDOLPDJHI DUHUHJDUGHGDVLQSXWVRIWKHQHWZRUN
,W DOVRSURYLGHVWKHFRPPDQGYHFWRUv DVLQSXWWRWKHQHWZRUN
W
DIWHUWKHWZRLPDJHVDUHSURFHVVHGE\WKHILUVWILYHOD\HUV7KHQ
WKH\ DUH LQSXWWHG WR WKH IROORZLQJ VHW RI OD\HU VR WKDW WKH
SUREDELOLW\RIDVXFFHVVIXOJUDVS
D. Recurrent Neural Network
5HFXUUHQW 1HXUDO 1HWZRUN LV D NLQG RI DUWLILFLDO QHXUDO
QHWZRUN $SDUW IURP KDYLQJ WKH VWUXFWXUH RI WKH IHHGIRUZDUG
QHXUDO QHWZRUN WKHUH H[LVWV GLUHFWHG F\FOHV LQ 511 7KLV
VWUXFWXUHDOORZVWKHLQIRUPDWLRQWREHFLUFXODWHGLQWKHQHWZRUN
VR WKH RXWSXW RI HDFK WLPH LV QRW RQO\ UHODWHG WR WKH LQSXW DW
SUHVHQWEXWUHODWHGWRWKHLQSXWDW SUHYLRXVWLPHVWDPSV
$OWKRXJKWKHWUDGLWLRQDO511LVDEOHWRGHDOZLWKWLPHVHULHV
GDWDWKHUHH[LVWVDVHULRXVSUREOHPDERXWJUDGLHQWYDQLVKLQJLQ
WKH SURFHVV RI EDFN SURSDJDWLRQ 7KHUHIRUH 511 FDQ RQO\ EH
XVHGIRUVKRUWWHUPPHPRU\LQPRVWFDVHV,QRUGHUWRVROYHWKLV
SUREOHPPDQ\UHVHDUFKHUVEHJDQWRSXWIRUZDUGVHYHUDONLQGV
RI LPSURYHG VWUXFWXUHV VXFK DV /RQJ 6KRUW7HUP 0HPRU\
QHWZRUNQDPHO\/H1HWDQGDSSOLHGWRKDQGZULWLQJUHFRJQLWLRQ
$OH[1HWLVPDLQO\XVHGWRREMHFWGHWHFWLRQV$IWHUWKDW=)1HW
9**1HWDQG*RRJOH1HWZHUHSXWIRUZDUGEDVHGRQ$OH[1HW
$WSUHVHQW&11LVVWLOODQDFWLYHWRSLF ZLWKPDQ\GLUHFWLRQVWR
H[SORUH 6RPH UHVHDUFKHUV ZDQW WR LQFUHDVH WKH FRPSOH[LW\ RI
&11 VWUXFWXUHV 2WKHUV ZDQW WR FRPELQH &11 ZLWK RWKHU
WUDGLWLRQDOPDFKLQHOHDUQLQJV
/LXet al>@SURSRVHGDQ66'PRGHOZKLFKFRXOGGHWHFW
REMHFWVHIILFLHQWO\ZLWKKLJKDFFXUDF\7KHPRGHOFRQVLVWVRID
WUXQFDWHG EDVH QHWZRUN VWUXFWXUH DQG DX[LOLDU\ VWUXFWXUH 7KH
WUXQFDWHGEDVHQHWZRUNLQ>@DGRSWV9**DQGWKHDX[LOLDU\
VWUXFWXUHDGRSWVVRPHIHDWXUHOD\HUVWRWKHHQGRI9**7KH
QHWZRUN FDQ SURGXFH D VHW RI IL[HGVL]H ERXQGLQJ ER[HV IURP
PDQ\IHDWXUHPDSV,WFDQDOVRJLYHFDWHJRU\VFRUHVLIWKHUHLVDQ
REMHFWLQWKHERXQGLQJER[HVDQGFRUUHVSRQGLQJRIIVHWV:KHQ
WUDLQLQJ66'WKHORVVIXQFWLRQZKLFKLVWKHZHLJKWHGVXPRIWKH
ORFDOL]DWLRQ ORVV DQG FRQILGHQFH ORVV ZLOO EH SURGXFHG RQ
IRUZDUG SURSDJDWLRQ /DVWO\ WKH ORVV IXQFWLRQ FDQ EH XVHG WR
ILQHWXQHWKHPRGHORQEDFNSURSDJDWLRQ7KHVWUXFWXUHRIWKLV
PRGHOLVVKRZQLQ)LJ
.RQWVFKLHGHU et al >@ SURSRVHG 'HHS 1HXUDO 'HFLVLRQ

/670 'LIIHUHQW IURP WKH WUDGLWLRQDO 511 /670 KDV D
PHPRU\FHOODQGDQLQSXWRXWSXWJDWHVWUXFWXUH7KHPHPRU\FHOO
LV XVHG WR UHFRUG LQIRUPDWLRQ DQG WKH LQSXWRXWSXW JDWH
GHWHUPLQHVZKHWKHUWKHLQIRUPDWLRQLVFDSDEOHRIIORZLQJLQWRRU
RXWRIWKHPHPRU\FHOO'XHWRWKHVHFKDUDFWHULVWLFV/670KDV
DEHWWHUSHUIRUPDQFHWKDQ511LQORQJWHUPPHPRU\WDVNV
%\HRQ et al >@ SURSRVHG D FRPSOHWHO\ OHDUQLQJEDVHG
DSSURDFKIRUVFHQHODEHOLQJXVLQJDNLQGRI'/670UHFXUUHQW
QHXUDOQHWZRUNV7KHQHWZRUNLVGLYLGHGLQWRWKUHHPDLQOD\HUV
LQSXW OD\HU KLGGHQ OD\HU DQG RXWSXW OD\HU 7KH LQSXW LPDJH LV
VSOLWLQWRVHYHUDOQRQRYHUODSSLQJZLQGRZVWRWKHLQSXWQHWZRUN
7KHKLGGHQOD\HUFRQVLVWVRID'/670OD\HUDQGIHHGIRUZDUG
OD\HU 7KH ' /670 OD\HU LV XVHG WR PHPRUL]H FRQWH[W
LQIRUPDWLRQ LQ DOO GLUHFWLRQV DQG WKH IHHGEDFN OD\HU FRPELQHV
LQIRUPDWLRQ WRJHWKHU 7KH RXWSXW OD\HU QRUPDOL]HV WKH RXWSXWV
IURPWKHODVWKLGGHQOD\HUZLWKDVRIWPD[IXQFWLRQDQGJHQHUDWHV
SUREDELOLWLHV DERXW ZKLFK FODVVHV WKH WDUJHWV EHORQJ WR
([SHULPHQWDO UHVXOWV VKRZ WKH HIIHFWLYHQHVV RI WKH SURSRVHG
PRGHO7KHQHWZRUNLVVKRZQLQ)LJ
/LX et al >@ LQWURGXFHG D QHZ DSSURDFK WR MRLQWO\ OHDUQ
IHDWXUHUHSUHVHQWDWLRQVDFURVVPXOWLSOHUHODWHGWDVNV7KHQRYHOW\
 ([WUD)HDWXUH/D\HUV
9**
WKURXJK3RROOD\HU

1RQ0D[LPXP6XSSUHVVLRQ
&ODVVLILHU&RQY[[[FODVVHV

'HWHFWLRQVSHU&ODVV
&ODVVLILHU&RQY[[[FODVVHV

  
66'

&RQYB &RQY &RQY 

LPDJH )F )F
&RQYB 
&RQYB
&RQYB 
3RRO
  
 
  
       
&RQY[[ &RR
&RQY[[ &RQQ
&RQY[[ &RQY[[
& &RQY[[ $YJ3RROLQJ*OREDO
$YY
&RQY[[V
& &RQY[[V
& &RQY[[V

)LJ 7KHPRGHOLQ>@DGRSWV9**DVWKH EDVHQHWZRUN([WUDIHDWXUHOD\HUVDUHDGGHG WRWKHEDVHQHWZRUNVRWKDW>@ FDQXVHIHDWXUHOD\HUVWRSURGXFH

GHWHFWLRQSUHGLFWLRQV RIHYHU\IHDWXUHPDS$GDSWHGIURP>@

)& I I I I I I I I I I I I I I

G G

G G G G

G G G G G G G G

ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ ʌ

)LJ 7KHWUHHPRGHORI'HHS1HXUDO'HFLVLRQ)RUHVWVFRQVLVWVRIVHYHUDOGHFLVLRQWUHHV7KHGHFLVLRQQRGHVGHFLGHKRZVDPSOHVSDVVWKURXJKWKHWUHHV7KH
SUHGLFWLRQQRGHV SURGXFHWKHGHFLVLRQSUREDELOLWLHVDIWHUVDPSOHVUHDFKWKHFRUUHVSRQGLQJILQDO QRGHV$GDSWHGIURP>@

wi Q [Q[Q [Q[Q
 
Q 
/670 /670  /670 /670


/670 /670
Ȉ
/670 /670
Ȉ ı 2XWSXW

6RIWPD[ 3UF _ Z i 
7 0
[Q[Q [Q[Q
 6
)HHGIRUZDUGOD\HU
,QSXW,N '/670OD\HU
+LGGHQOD\HU

)LJ 7KH'ORQJVKRUWWHUPPHPRU\ QHWZRUN DUFKLWHFWXUH $QLQSXWLPDJH,N LVGLYLGHGLQWRVRPH ZLQGRZV (DFKZLQGRZ LV IHGLQWRIRXUVHSDUDWH/670

PHPRU\EORFNV 7KHRXWSXWRIHDFK/670EORFNLVSDVVHGWRWKHIHHGIRUZDUGOD\HU$WWKHODVWOD\HUWKHRXWSXWVRIWKHILQDO/670EORFNVDUHVXPPHGXSDQG VHQW
WRWKHVRIWPD[OD\HU)LQDOO\WKHQHWZRUNVRXWSXWWKHFODVVSUREDELOLWLHVIRUHDFKLQSXWZLQGRZ $GDSWHGIURP>@
RIWKLVDSSURDFKLVWKDWWKH\LQWHJUDWH/670LQWRWKHPXOWLWDVN IRU&11PRGHOVEDVHGRQVHYHUDOFRPSXWLQJOLEUDULHVOLNH0./
OHDUQLQJ IUDPHZRUN ,Q WKHLU SDSHU WKH\ SURSRVHG WKUHH 2SHQ%/$6DQGFX%/$6&DIIHSURYLGHVDVHWRIWRROVWREHXVHG
DUFKLWHFWXUHVRIVKDULQJLQIRUPDWLRQWRPRGHOWH[W7KHILUVWRQH IRUWUDLQLQJSUHGLFWLQJILQHWXQLQJDQGVRIRUFH,WDOVRKDVPDQ\
VKDUHVRQO\D/670OD\HUIRUDOOWDVNV7KHVHFRQGRQHDVVLJQV UHIHUHQFH PRGHOV DQG URXWLQHV IRU OHDUQHUV WR XVH 7KH
D /670 OD\HU IRU HDFK WDVN DQG HYHU\ /670 OD\HU FRXOG XVH FRQILJXUDWLRQILOHVRI&DIIHDUHVLPSOHWRVHWXS$QGWKH0DWODE
LQIRUPDWLRQ IURP RWKHUV 7KH ODVW RQH QRW RQO\ KDV WKH DQG 3\WKRQ LQWHUIDFHV LW SURYLGHG DUH FRQYHQLHQW WR XVH
FKDUDFWHULVWLF RI WKH VHFRQG¶V EXW DOVR EXLOGV D ELGLUHFWLRQDO &RPSDUHGWRRWKHUIUDPHZRUNV&DIIHLVHDVLHUWRXQGHUVWDQGVR
/670OD\HUIRUDOOWDVNV$WWKHHQGRIWKHLUSDSHUZHFDQILQG WKDWPDQ\EHJLQQHUVSUHIHUWRFKRRVHLW
WKDWWKHLUPRGHOVFDQLPSURYHWKH SHUIRUPDQFHVRIWKHWDVNVWKH\
PHQWLRQHG7KHWKUHHDUFKLWHFWXUHVDUHVKRZQLQ)LJ 7HQVRU)ORZ >@ LV D ODUJHVFDOH PDFKLQH OHDUQLQJ
IUDPHZRUN ZKLFK SURYLGHV DQ LQWHUIDFH IRU PDFKLQH OHDUQLQJ
,9 '((3/($51,1*)5$0(:25.6 DOJRULWKPVWRH[HFXWH,WKDVEHHQXVHGLQPDQ\ILHOGVLQFOXGLQJ
VSHHFK UHFRJQLWLRQ FRPSXWHU YLVLRQ URERWLFV LQIRUPDWLRQ
%HVLGHVOHDUQLQJWKHVHPRGHOVZHVKRXOGDOVRNQRZDERXW UHWULHYDO DQG QDWXUDO ODQJXDJH SURFHVVLQJ 7HQVRUIORZ LV
VHYHUDO GHHS OHDUQLQJ IUDPHZRUNV DQG KRZ WR XVH WKHP LQ GHYHORSHG IURP 'LVW%HOLHI ,W WDNHV FRPSXWDWLRQV GHVFULEHG
GLIIHUHQWDSSOLFDWLRQV7KHPRVWFRPPRQO\XVHGGHHSOHDUQLQJ XVLQJ D GDWDIORZOLNH PRGHO DQG PDSV WKHP RQWR GLIIHUHQW
IUDPHZRUNVLQFOXGH&DIIH7HQVRU)ORZ7RUFKDQG7KHDQR KDUGZDUH SODWIRUPV VXFK DV VXFK DV $QGURLG DQG L26 $QG LW
&DIIH>@ LVDNLQGRIGHHSOHDUQLQJIUDPHZRUNWKDWVXLWDEOH VXSSRUWVVLQJOHGHYLFHPXOWLGHYLFHDQGGLVWULEXWHGH[HFXWLRQ


 xP xP xP xTP
H[WUDFWLRQ PHWKRG QHHGV XVHUV WR GHVLJQ ZKDW IHDWXUHV WKH\
y m
VKRXOGH[WUDFW$QGWKHVHSURFHVVHVDUHRIWHQKLJKFRVWDQGWLPH
VRIWPD[
xV xV xV xTV
FRQVXPLQJ'HHSOHDUQLQJKDVWKHDELOLW\RIXQVXSHUYLVHGIHDWXUH
h s  h s  h s  hT s  OHDUQLQJDQGLWFDQH[WUDFWWKHIHDWXUHVRILPDJHVZLWKRXWDQ\
KXPDQ LQWHUYHQWLRQ 7KXV LW LV JUDGXDOO\ DWWUDFWHG PRUH DQG
xQ xQ xQ xTQ PRUHDWWHQWLRQE\UHVHDUFKHUV$IWHU.UL]KHYVN\et al>@JRWD
xV xV xV xTV
VRIWPD[ yn EUHDNWKURXJK E\XVLQJ&11LQ,PDJH1HW /695&GHHS
D0RGHO, OHDUQLQJEHFRPHVPRUHDQGPRUHSRSXODULQFRPSXWHUYLVLRQDQG
KDYH PDGH DQ H[FHOOHQW EUHDNWKURXJK XS WR QRZ 6R IDU WKH
x x x xT
PHWKRGZKLFKFRQMXQFWVWKUHHUHVLGXDO,QFHSWLRQQHWZRUNV ZLWK
RQH,QFHSWLRQY >@PDNHVWKHLPDJHUHFRJQLWLRQWDVNDFKLHYH
hP hP hP hT s  VRIWPD[ y m WRSHUURU /HDUQHG0LOOHUet al>@SURSRVHGDGHHS
OHDUQLQJ PHWKRG ZKLFKPDGHWKH DFFXUDF\RI IDFHUHFRJQLWLRQ
ULVH WR DERXW  $W SUHVHQW WKH UHVHDUFKHUV LQ WKH &KLQHVH
hQ hQ hQ hTQ VRIWPD[ yn 8QLYHUVLW\ RI +RQJ .RQJ KDYH LQFUHDVHG WKH IDFH UHFRJQLWLRQ
DFFXUDF\DERYH>@
x x x xT 'HHSOHDUQLQJKDVEHHQLQFRQWLQXRXVGHYHORSPHQWLQQDWXUDO
E0RGHO,, ODQJXDJH SURFHVVLQJ DQG JRW PDQ\ DFKLHYHPHQWV LQ PDQ\
DSSOLFDWLRQVLQFOXGLQJVSHHFKUHFRJQLWLRQ VSHHFKV\QWKHVLVDQG
x x x xT 4XHVWLRQ$QVZHULQJ 7KH WUDGLWLRQDO VSHHFK UHFRJQLWLRQ
V\VWHPV ZHUH PRVWO\ EDVHG RQ *DXVVLDQ 0L[WXUH 0RGHO DQG
hP hP hP hT s  VRIWPD[ y m +LGGHQ 0DUNRY 0RGHO LQ WKH SDVW IRU D ORQJ WLPH +RZHYHU
WKHVHPHWKRGV FRXOGQRWGHDOZLWKGHHSFKDUDFWHULVWLFVZHOODQG
hQ hQ hQ hTQ DUHVHQVLWLYHWRGLVWXUEDQFHVIURPWKHRXWVLGHHQYLURQPHQW$IWHU
DGRSWLQJGHHSOHDUQLQJLQVSHHFKUHFRJQLWLRQWKHSHUIRUPDQFHV
hQ hQ hQ hTQ VRIWPD[ yn RI WKH V\VWHPV KDYH LPSURYHG GUDPDWLFDOO\ 1RZ WKH VSHHFK
UHFRJQLWLRQV\VWHP'HHS6SHHFKZKLFKLVGHVLJQHGE\%DLGX
x x x xT KDV UHGXFHG WKH HUURU UDWH WR  LQ &KLQHVH VSHHFK WHVW $W
SUHVHQW *RRJOH 'HHS0LQG SXEOLVKHG D QHZ VSHHFK V\QWKHVLV
F0RGHO,,,
V\VWHPZKLFKZDVQDPHG:DYH1HW >@:DYH1HWLVDNLQGRI
)LJ 7KUHHDUFKLWHFWXUHVRIWKHQHWZRUNIRUWH[WFODVVLILFDWLRQ ZLWKPXOWL GHHS QHXUDO QHWZRUN DQG FDQ JHQHUDWH UDZ DXGLR ZDYHIRUPV
WDVNOHDUQLQJ $GDSWHGIURP>@ &RPSDUHG WR RWKHU WH[WWRVSHHFK V\VWHPV :DYH1HW FDQ
7RUFK >@ FDQ VXSSRUW PRVW RI WKH PDFKLQH OHDUQLQJ JHQHUDWHPRUHUHDOLVWLFVRXQGVDVZHOODVPXVLF)URP'HHS0LQG
DOJRULWKPV,WLQFOXGHVPRVWSRSXODU DOJRULWKPVDQGPRGHOV VXFK LW VKRZHG WKDW :DYH1HW UHGXFHG WKH JDS EHWZHHQ KXPDQ DQG
DV PXOWLOD\HU SHUFHSWURQV VXSSRUW YHFWRU PDFKLQHV *DXVVLDQ V\QWKHVL]HG YRLFHV E\ RYHU  LQ (QJOLVK DQG &KQLHVH
PL[WXUH PRGHOV KLGGHQ 0DUNRY PRGHOV VSDWLDO DQG WHPSRUDO
FRQYROXWLRQDOQHXUDOQHWZRUNV $GD%RRVW %D\HVFODVVLILHUV DQG
VR RQ %HVLGHV VXSSRUWLQJ &38 DQG *38 7RUFK DOVR FDQ EH
HPEHGGHGLQWRL26$QGURLGDQG)3*$
7KHDQR >@ LVDIUDPHZRUNEDVHGRQ3\WKRQ,W FDQVXSSRUW
VRPHXQVXSHUYLVHGDQGVHPLVXSHUYLVHGOHDUQLQJDSSURDFKHVDV
ZHOO DV VXSHUYLVHG OHDUQLQJ DSSURDFKHV VXFK DV ORJLVWLF
UHJUHVVLRQ PXOWLOD\HUSHUFHSWURQGHHS&11$(5%0DQG
'%17KDQNVWRWKHVHIXQFWLRQV7KHDQRLVXVXDOO\EHXVHGIRU
WHDFKLQJ DW DERDUG +RZHYHU 7KHDQR KDV D ZHDNQHVV WKDW LWV
VSHHGLVWRR VORZ
9 $33/,&$7,2162) '((3/($51,1*
$IWHUZHGLVFXVVWKHVHPRGHOVDQGIUDPHZRUNVZHFDQILQG
WKDW GHHS OHDUQLQJ DSSURDFKHV FRXOG KHOS XV WR DFKLHYH
SHUIRUPDQFHV LQ YDULRXV DSSOLFDWLRQV ,Q WKLV VHFWLRQ ZH
LQWURGXFHVRPHDSSOLFDWLRQVRIGHHSOHDUQLQJLQFRPSXWHUYLVLRQ
DQGQDWXUDOODQJXDJHSURFHVVLQJ
'HHS OHDUQLQJ KDV KDG D ZLOG GHYHORSPHQW LQ FRPSXWHU
YLVLRQ VXFK DV REMHFW GHWHFWLRQ REMHFW WUDFNLQJ DQG LPDJH
VHJPHQWDWLRQ 2EMHFW GHWHFWLRQ DLPV WR UHFRJQL]H D FODVV RI
REMHFWV IURP D ODUJH QXPEHU RI LPDJHV 7KH WUDGLWLRQDO REMHFW
GHWHFWLRQ PHWKRGV PDLQO\ LQFOXGH FDQGLGDWH UHJLRQ VHOHFWLRQ
IHDWXUH H[WUDFWLRQ DQG FODVVLILFDWLRQ 7KLV PDQXDO IHDWXUH

4XHVWLRQ$QVZHULQJ 4$ LVDKRWUHVHDUFKGLUHFWLRQRIQDWXUDO
ODQJXDJH SURFHVVLQJ ZKLFK FDQ JLYH D FRUUHFW DQG FRQFLVH
DQVZHU ZLWK WKH QDWXUDO ODQJXDJH IRUP IRU QDWXUDO ODQJXDJH
SUREOHPV 7KHYLFWRU\RI :DWVRQ>@ RQMHRSDUG\KDVVKRZQ
WKDW4$EDVHGRQGHHSOHDUQLQJKDVLWVRZQXQLTXHVXSHULRULW\
9, &21&/86,21
'HHSOHDUQLQJDSSURDFKHVDUHSUDFWLFDOIRUXVWRVROYHPDQ\
SUREOHPV,QWKLVSDSHUZHLQWURGXFHGHHSOHDUQLQJPRGHOVDQG
IUDPHZRUNVLQGHWDLO'HHSOHDUQLQJGLIIHUHQWNLQGVRIPRGHOV
DQG IUDPHZRUNV DQG LW KDV KDG PDQ\ DSSOLFDWLRQV LQ PDQ\
DVSHFWV)URPWKHVHZHFDQVHHWKDWGHHSOHDUQLQJKDVDJUHDW
GHYHORSPHQWSRWHQWLDO
,QIXWXUHLWLVIRUHVHHDEOHWKDWGHHSOHDUQLQJFRXOGHVWDEOLVK
SHUIHFW WKHRULHV WR H[SODLQ LWV SHUIRUPDQFHV 0HDQZKLOH LWV
DELOLWLHVRIXQVXSHUYLVHGOHDUQLQJZLOOEHHQKDQFHGVLQFHWKHUH
DUHPLOOLRQVRI GDWDLQWKHZRUOGEXWLWLVQRWDSSOLFDEOHWRDGG
ODEHOV WR DOO RI WKHP ,W LV DOVR SUHGLFWHG WKDW QHXUDO QHWZRUN
VWUXFWXUHV ZLOO EHFRPH PRUH FRPSOH[ VR WKDW WKH\ FDQ H[WUDFW
PRUH VHPDQWLFDOO\ PHDQLQJIXO IHDWXUHV :KDW¶V PRUH GHHS
OHDUQLQJZLOOFRPELQHZLWKUHLQIRUFHPHQWOHDUQLQJEHWWHUDQGZH
FDQXVHWKLVDGYDQWDJHVWRDFFRPSOLVKPRUHWDVNV
 5()(5(1&(6
>@ :60F&XOORFKDQG:3LWWV³$ORJLFDOFDOFXOXVRIWKHLGHDVLPPDQHQW
LQQHUYRXVDFWLYLW\´The bulletin of mathematical biophysicsYROSS

>@ '2+HEE³7KHRUJDQL]DWLRQRIEHKDYLRU´J. Appl. Behav. Anal.YRO
SS±
>@ ) 5RVHQEODWW ³7KH SHUFHSWURQ D SUREDELOLVWLF PRGHO IRU LQIRUPDWLRQ
VWRUDJHDQGRUJDQL]DWLRQLQWKHEUDLQ´Psychol. Rev.YROQR SS

>@ - - +RSILHOG ³1HXUDO QHWZRUNV DQG SK\VLFDO V\VWHPV ZLWK HPHUJHQW
FROOHFWLYHFRPSXWDWLRQDODELOLWLHV´P. Natl. Acad. Sci. USAYROSS

>@ '+$FNOH\*(+LQWRQDQG7-6HMQRZVNL³$OHDUQLQJDOJRULWKPIRU
EROW]PDQQPDFKLQHV´Cognitive Sci.YROSS
>@ &&RUWHVDQG99DSQLN³6XSSRUW9HFWRU1HWZRUNV´Mach. Learn.YRO
SS
>@ <)UHXQGDQG5(6FKDSLUH³$GHFLVLRQWKHRUHWLFJHQHUDOL]DWLRQRIRQ
OLQHOHDUQLQJDQGDQDSSOLFDWLRQWRERRVWLQJ´J. comput. Syst. Sci.YRO
QRSS
>@ 39LQFHQW+/DURFKHOOH<%HQJLRDQG3$0DQ]DJRO³([WUDFWLQJ
DQG FRPSRVLQJ UREXVW IHDWXUHV ZLWK GHQRLVLQJ DXWRHQFRGHUV´
Proceedings of the 25th international conference on Machine learning
New York pp. 1096-1103 
>@ $ 1J ³6SDUVH DXWRHQFRGHU´ CS294A Lecture Notes Stanford Univ.
CaliforniaSS
>@ < ;LRQJ DQG 5 =XR ³5HFRJQLWLRQ RI JHRFKHPLFDO DQRPDOLHV XVLQJ D
GHHS DXWRHQFRGHU QHWZRUN´ Comput. Geosci.-UK YRO  SS 

>@ 3/LX6+DQ=0HQJDQG<7RQJ³)DFLDO([SUHVVLRQ5HFRJQLWLRQYLD
D%RRVWHG'HHS%HOLHI1HWZRUN´Proceedings of the IEEE Conference on
Computer Vision and Pattern Recognition Columbus SS 

>@ 6 .LP % 3DUN %6 6RQJ DQG 6 <DQJ ³'HHS EHOLHI QHWZRUN EDVHG
VWDWLVWLFDO IHDWXUH OHDUQLQJ IRU ILQJHUSULQW OLYHQHVV GHWHFWLRQ´ Pattern
Recogn. Lett YRO SS
>@ .)XNXVKLPD60L\DNHDQG7,WR³1HRFRJQLWURQ$QHXUDOQHWZRUN
PRGHOIRUDPHFKDQLVPRIYLVXDOSDWWHUQUHFRJQLWLRQ´IEEE Trans. Syst.
Man Cybern.YROSS
>@ </HFXQ/%RWWRX<%HQJLRDQG3+DIIQHU³*UDGLHQWEDVHGOHDUQLQJ
DSSOLHG WR GRFXPHQW UHFRJQLWLRQ´Proc. IEEE YRO  SS 

>@ $ .UL]KHYVN\ 6XWVNHYHU , 6XWVNHYHU DQG *( +LQWRQ ³,PDJHQHW
FODVVLILFDWLRQ ZLWK GHHS FRQYROXWLRQDO QHXUDO QHWZRUNV´ Proc. Neural
Information and Processing SystemsSS
>@ 0'=HLOHUDQG5)HUJXV³9LVXDOL]LQJDQGXQGHUVWDQGLQJFRQYROXWLRQDO
QHWZRUNV´European Conference on Computer Vision ZurichSS


>@ .6LPRQ\DQDQG$=LVVHUPDQ³9HU\GHHSFRQYROXWLRQDOQHWZRUNVIRU
ODUJHVFDOHLPDJHUHFRJQLWLRQ´ arXiv preprint arXiv
>@ & 6]HJHG\ : /LX < -LD DQG 3 6HUPDQHW ³*RLQJ GHHSHU ZLWK
FRQYROXWLRQV´Proceedings of the IEEE Conference on Computer Vision
and Pattern Recognition BostonSS
>@ :/LX'$QJXHORY'(UKDQ&6]HJHG\DQG65HHG³66'6LQJOH
6KRW0XOWL%R['HWHFWRU´arXiv preprint arXiv: 1512.02325
>@ 3.RQWVFKLHGHU0)LWHUDX$&ULPLQLVLDQG65%XOR³'HHS1HXUDO
'HFLVLRQ)RUHVWV´IEEE International Conference on Computer Vision
SantiagoSS
>@ 6/HYLQH33DVWRU$.UL]KHYVN\DQG'4XLOOHQ³/HDUQLQJ+DQG(\H
&RRUGLQDWLRQIRU5RERWLF*UDVSLQJZLWK'HHS/HDUQLQJDQG/DUJH6FDOH
'DWD&ROOHFWLRQ´arXiv preprint arXiv: 1603.02199
>@ :%\HRQ70%UHXHO)5DXHDQG0/LZLFNL³6FHQHODEHOLQJZLWK
/670UHFXUUHQWQHXUDOQHWZRUNV´Proceedings of the IEEE Conference
on Computer Vision and Pattern Recognition Boston SS 

>@ 3 /LX ; 4LX DQG ; +XDQJ ³5HFXUUHQW 1HXUDO 1HWZRUN IRU 7H[W
&ODVVLILFDWLRQ ZLWK 0XOWL7DVN /HDUQLQJ´ arXiv preprint arXiv:
1605.05101
>@ < -LD( 6KHOKDPHU- 'RQDKXH6 .DUD\HY- /RQJ5 *LUVKLFNet al
³&DIIH &RQYROXWLRQDO DUFKLWHFWXUH IRU IDVW IHDWXUH HPEHGGLQJ´
Proceedings of the 22nd ACM international conference on Multimedia
OrlandoSS 
>@ 0 $EDGL $$JDUZDO3 %DUKDP ( %UHYGR = )&KHQ&&LWURet al
³7HQVRUIORZ/DUJHVFDOHPDFKLQHOHDUQLQJRQKHWHURJHQHRXVGLVWULEXWHG
V\VWHPV´arXiv preprint arXiv: 1603.04467
>@ 5 &ROOREHUW 6 %HQJLR DQG - 0DULpWKR] ³7RUFK D PRGXODU PDFKLQH
OHDUQLQJVRIWZDUHOLEUDU\´ Idiap No. EPFL-REPORT-82802 
>@ 5$O5IRX* $ODLQ $$OPDKDLUL & $QJHUPXHOOHU'%DKGDQDX1
%DOODV et al ³7KHDQR $ 3\WKRQ IUDPHZRUN IRU IDVW FRPSXWDWLRQ RI
PDWKHPDWLFDOH[SUHVVLRQV´arXiv preprint arXiv: 1605.02688
>@ & 6]HJHG\ 6 ,RIIH 9 9DQKRXFNH DQG $ $OHPL ³,QFHSWLRQY
LQFHSWLRQUHVQHW DQG WKH LPSDFW RI UHVLGXDO FRQQHFWLRQV RQ OHDUQLQJ´
arXiv preprint arXiv: 1602.07261 
>@ * % +XDQJ + /HH DQG ( /HDUQHG0LOOHU ³/HDUQLQJ KLHUDUFKLFDO
UHSUHVHQWDWLRQV IRU IDFH YHULILFDWLRQ ZLWK FRQYROXWLRQDO GHHS EHOLHI
QHWZRUNV´Proceedings of the IEEE Conference on Computer Vision and
Pattern Recognition, 5KRGH,VODQG, pp. 2 
>@ <6XQ;:DQJDQG;7DQJ³'HHSO\OHDUQHGIDFHUHSUHVHQWDWLRQVDUH
VSDUVH VHOHFWLYH DQG UREXVW´ Proceedings of the IEEE Conference on
Computer Vision and Pattern Recognition BostonSS
>@ $9' 2RUG6 'LHOHPDQ + =HQ . 6LPRQ\DQ 2 9LQ\DOV $*UDYHV
et al³:DYH1HW $*HQHUDWLYH0RGHOIRU5DZ$XGLR´arXiv preprint
arXiv: 1609.03499
>@ ' )HUUXFFL $ /HYDV 6 %DJFKL ' *RQGHNDQG(7 0XHOOHU ³:DWVRQ
%H\RQG-HRSDUG\´Artif. Intell. YROSS