UI
*&&&"$.

*OUFSOBUJPOBM
4ZNQPTJVN
PO
$MVTUFS
$MPVE
BOE
(SJE
$PNQVUJOH
$$(3*%

(IIHFWLYHDQG(IILFLHQW%LJ'DWD0DQDJHPHQWLQ
'LVWULEXWHG(QYLURQPHQWV0RGHOV,VVXHVDQG
5HVHDUFK3HUVSHFWLYHV
$OIUHGR&X]]RFUHD
',$'HSDUWPHQW
8QLYHUVLW\RI7ULHVWH
7ULHVWH,WDO\
DOIUHGRFX]]RFUHD#GLDXQLWVLW


 
 
$EVWUDFW²7KLV SDSHU IRFXVHV WKH DWWHQWLRQ RQ WKH
HPHUJLQJ SUREOHP RI HIIHFWLYHO\ DQG HIILFLHQWO\
PDQDJLQJELJGDWDLQGLVWULEXWHGHQYLURQPHQWVE\DOVR
SURSRVLQJ UHVHDUFK SHUVSHFWLYHV DORQJ WKLV OLQH RI
UHVHDUFK0RVWUHOHYDQWVWDWHRIWKHDUWDSSURDFKHVDUH
DOVRUHSRUWHGDQGGLVFXVVHG)LQDOO\WKHSDSHUSURSRVHV
FOHDUO\WKHPRVWUHSUHVHQWDWLYHVHWWLQJZKHUHWKHHIIHFWLYHQHVV
DQGHIILFLHQF\JRDOVRYHUELJGDWDFDQEHDFKLHYHGVXFFHVVIXOO\
,QWKLVUHVSHFW>@DUHVRPHQRWLFHDEOHH[SHULHQFHV
,QRUGHUWRFRSHZLWKVXFKLVVXHVVHYHUDODSSURDFKHVKDYH
EHHQ SURSRVHG UHFHQWO\ )RU LQVWDQFH D FODVV RI DSSURDFKHV
DPRQJ WKH PRVW SRSXODU RQHV SUHGLFDWHV WR DGRSW ZHOO
WKH ORJLFDO DUFKLWHFWXUH RI D GLVWULEXWHG V\VWHP WKDW
FRQVLGHUV WKH LQWHUHVWLQJ FDVH RI VHQVRU GDWD D
VLJQLILFDQWLQVWDQFHRIELJGDWD
.H\ZRUGV² %LJ 'DWD 'LVWULEXWHG (QYLURQPHQWV 'DWD
&RPSUHVVLRQ'DWD*ULGV
, ,1752'8&7,21
FRQVROLGDWHG GDWD FRPSUHVVLRQ PHWKRGV HJ >@ IRU
UHGXFLQJWKHHIIRUWRIDFFHVVLQJSURFHVVLQJDQGPDQDJLQJELJ
GDWD
7KLVOLQHRIUHVHDUFKKDVEHHQWUDGLWLRQDOO\DGRSWHGE\WKH
GDWDEDVH PDQDJHPHQW UHVHDUFK FRPPXQLW\ DQG QRZ LW LV RI
JUHDW LQWHUHVW IRU WKH KHUHGLWDU\ UHVHDUFK FRPPXQLW\ WKDW
IRFXVHVWKHDWWHQWLRQRQELJGDWDPDQDJHPHQW
%\ IROORZLQJ WKLV UHVHDUFK WUHQG LQ WKLV SDSHU ZH DOVR
%LJGDWDHJ>@DUHQRZRIFULWLFDOLQWHUHVWIRU SURSRVH WKH ORJLFDO DUFKLWHFWXUH RI D GLVWULEXWHG V\VWHP WKDW
ERWKDFDGHPLFDQGLQGXVWULDOUHVHDUFKFRPPXQLWLHV7KHZHOO FRQVLGHUV WKH LQWHUHVWLQJ FDVH RI VHQVRU GDWD D VLJQLILFDQW
NQRZQ FKDUDFWHULVWLFV RI ELJ GDWD DUH UHSUHVHQWLQJ D ELJ LQVWDQFHRIELJGDWD7KLVV\VWHPDGRSWVWKHIXQGDPHQWDO*ULG
FKDOOHQJHWKDWLVEHLQJIDFHGRIIE\PHDQVRIVHYHUDOUHVHDUFK LQIUDVWUXFWXUHHJ>@ZKLFKLVVWLOORIKLJKLQWHUHVWIRUWKH
SHUVSHFWYLHVDQGDQJOHV ELJGDWDUHVHDUFKFRPPXQLW\HJ>@DQGLQWURGXFHVWKH
$PRQJ VHYHUDO SUREOHPV WKH LVVXH RI HIIHFWLYO\ DQG GDWD FRPSUHVVLRQ DSSURDFK WKDW KDV EHHQ SURSRVHG E\ XV LQ
HIILFLHQWO\VXSSRUWLQJELJGDWDPDQDJHPHQWSOD\VDFULWLFDOUROH >@%DVLFDOO\DVGHVFULEHGLQ>@ZHSURSRVHGD*ULGEDVHG
HJ>@,QGHHGFODVVLFDODSSURDFKHVFDQQRWGHDOZLWKWKH IUDPHZRUN IRU PDQDJLQJ VHQVRU QHWZRUN UHDGLQJV DQG
WUHPHGRXVDPRXQWVRIGDWD SURGXFHGE\DFWXDOGDWDLQWHQVLYH VXSSRUWLQJ IDVW DSSUR[LPDWH DJJUHJDWH TXHU\ DQVZHULQJ LV
SODWIRUPVVXFKDVVRFLDOQHWZRUNVHJ>@VPDUWFLWLHVHJ SUHVHQWHG,QRXUIUDPHZRUNUHDGLQJVSURGXFHGE\VHQVRUVFDQ
>@H[SHULPHQWDOSODWIRUPVHJ>@DQGVRIRUWK EHVWRUHGLQWRRQHRUPRUH*ULGQRGHV(DFKQRGHLVLQWHUHVWHG
,QRXURSLQLRQRQHRIWKHPRVWSUREOHPDWLFFKDUDFWHULVWLFRI LQUHDGLQJVFRPLQJIURPDVHWRIVHQVRUVIRULQVWDQFHVHQVRUV
ELJGDWDLVUHSUHVHQWHGE\WKHLU KHWHURJHQHLW\DVW\SLFDOUHDO EHORQJLQJWRWKHVDPHJHRJUDSKLFDOUHJLRQLWVWRUHVQHZGDWD
OLIHELJGDWDUHSRVLWRULHVLQFOXGHGDWDVRXUFHVRIVHYHUDOW\SHV LQWRDWUDGLWLRQDOWHPSRUDO'%06DQGDWWKHVDPHWLPHXSGDWHV
VXFK DV JHRVSDWLDO GDWD ' GDWD DXGLR DQG YLGHR GDWD DFRPSUHVVHGUHSUHVHQWDWLRQRIGDWDZKLFKFDQEHXVHGIRUIDVW
XQVWUXFWXUHGGDWDJUDSKGDWDDQGVRIRUWK7KLVLVLQGHHGD TXHU\ DQVZHULQJ ZKHQ D GUDPDWLF DFFXUDF\ LV QRW UHTXLUHG
FULWLFDOFKDOOHQJHIRUQH[WJHQHUDWLRQELJGDWDDSSOLFDWLRQVDQG 0RUHRYHUHDFKQRGHFDQVWRUHDFRPSUHVVHGVQDSVKRWRIGDWD
V\VWHPVIRULQVWDQFHWKRVHEDVHGRQVPDUWFLWLHV UHSUHVHQWHGLQWRRWKHUQRGHVZKLFKLVXSGDWHGSHULRGLFDOO\7KH
'HDGOLQJ ZLWK ELJ GDWD PHDQV GHDOLQJ ZLWK SRZHUIXO FRPSUHVVLRQWHFKQLTXHLVGHVFULEHGLQGHWDLOLQ>@
DUFKLWHFWXUHV WKDW DLP DW FUHDWLQJ WKH VRFDOOHG ³ELJ GDWD 7KHUHVWRIWKHSDSHULVRUJDQL]HGDVIROORZV,Q6HFWLRQ,,
HFRV\VWHP´HJ>@DUHIHUHQFHDUFKLWHFWXUHWKDWVXSSRUWVDOO ZH SURYLGH DQ RYHUYLHZ RI PRVW UHOHYDQW VWDWHRIWKHDUW
WKH SKDVHV WKDW DUH QHFHVVDU\ WR HIIHFWLYHO\ DQG HIILFLHQWO\ DSSURDFKHV WKDW FRQVLGHU ELJ GDWD PDQDJHPHQW LQ GLVWULEXWHG
VXSSRUW ELJ GDWD UHSUHVHQWDWLRQ VWRUDJH PDQDJHPHQW DQG HQYLURQPHQWV ,Q 6HFWLRQ ,,, ZH SURSRVH RXU UHVHDUFK
PLQLQJ :LWKLQ WKHVH SURSRVDOV GLVWULEXWHG HQYLURQPHQWV DUH SHUVSHFWLYHV DORQJ WKLV OLQH RI UHVHDUFK ,Q 6HFWLRQ ,9 ZH


¥
*&&& 
%0*
$$(3*%
GHVFULEH WKH ORJLFDO DUFKLWHFWXUH RI WKH GLVWULEXWHG V\VWHP IRU
PDQDJLQJ VHQVRU GDWD )LQDOO\ LQ 6HFWLRQ 9 ZH GHULYH
FRQFOXVLRQVDQGIXWXUHZRUNRIRXUUHVHDUFK
,, %,*'$7$0$1$*(0(17,1',675,%87('(19,5210(176
29(59,(:2)67$7(2)7+($57$3352$&+(6
$PRQJVHYHUDODSSURDFKHVWKDWDUHDYDLODEOHLQWKHDFWLYH
OLWHUDWXUH WKDW FRQVLGHUV WKH SUREOHP RI HIIHFWLYHO\ DQG
HIILFLHQWO\ VXSSRUWLQJ ELJ GDWD PDQDJHPHQW LQ GLVWULEXWHG
HQYLURQPHQWV VRPH QRWLFHDEOH RQHV DUH RXWOLQHG LQ WKH
IROORZLQJ
>@ IRFXVHV WKH DWWHQWLRQ RQ WKH LVVXH RI HIIHFWLYHO\ DQG
HIILFLHQWO\VXSSRUWLQJIX]]\FOXVWHULQJRYHU$SDFKH6SDUN>@
DQGLQWURGXFHVDGLVWULEXWHGGHQVLW\EDVHGFOXVWHULQJDOJRULWKP
EDVHGRQWKHKHVLWDQWIX]]\ZHLJKWHGFRUUHODWLRQFRHIILFLHQWDV
LWV VLPLODULW\ PHDVXUH 7KH SURSRVHG FOXVWHULQJ VWHSV DGDSW
FRPSOHWHO\ZLWKWKHGLVWULEXWHG6SDUNFRPSXWDWLRQIUDPHZRUN
$OVRE\DGRSWLQJWKHVRFDOOHGGHQVLW\UHDFKDELOLW\FRQFHSWWKH
GDWD GHSHQGHQF\ LV NHSW ORZ DV PRUH DV SRVVLEOH ZLWKLQ WKH
6SDUNVHWWLQJ%\SURSRVLQJWKHVRFDOOHG5''ORFDOL]HGVXE
FOXVWHULQJ PHWKRG GLVN ,2 EXUGHQ LQWURGXFHG E\ WKH
0DS5HGXFH EDVHG FOXVWHULQJ DSSURDFKHV KDV EHHQ VROYHG
HIIHFWLYHO\ 7KH FRPSDULVRQ RI WKH FOXVWHULQJ UHVXOWV ZLWK
VLPLODUZRUNVVKRZVWKHVXSHULRULW\RIWKHSURSRVHGDOJRULWKP
LQSUHFLVLRQDQGFOXVWHUYDOLGLW\LQGH[HV7KHVFDODELOLW\RIWKH
SURSRVHG PHWKRG LV DOPRVW VLPLODU WR WKH VWDQGDUG 6SDUN
PDFKLQHOHDUQLQJOLEUDU\
>@FRQVLGHUV&ORXGV\VWHPVDQGSURSRVHVDIUDPHZRUNIRU
VXSSRUWLQJ LQWHOOLJHQW VHUYLFH UHFRPPHQGDWLRQ IRU ELJ GDWD
DSSOLFDWLRQV7KHQRYHOW\RIWKHSURSRVHGDSSURDFKUHOLHVLQWKH
IDFWWKDWWKHIUDPHZRUNWDNHVLQWRDFFRXQWERWKXVHUEHKDYLRUV
GHYHORSHGWRDGGUHVVELJFOLPDWHGDWDYDULHW\E\LQWHJUDWLQJWKH
SURFHVVLQJ FRPSRQHQWV RI WKH FOLPDWH GDWD OLIHF\FOH
&OLPDWH6SDUN XWLOL]HV 6SDUN 64/ DQG $SDFKH =HSSHOLQ WR
GHYHORS D ZHE SRUWDO WR IDFLOLWDWH WKH LQWHUDFWLRQ DPRQJ
FOLPDWRORJLVWVFOLPDWHGDWDDQDO\WLFRSHUDWLRQVDQGFRPSXWLQJ
UHVRXUFHV ([SHULPHQWDO UHVXOWV VKRZ WKDW &OLPDWH6SDUN
H[SRVHVKLJKHIILFLHQF\DQGGDWDORFDOLW\
,,, %,*'$7$0$1$*(0(17,1',675,%87('(19,5210(176
5(6($5&+3(563(&7,9(6
,Q WKH FRQWH[W RI ELJ GDWD PDQDJHPHQW LQ GLVWULEXWHG
HQYLURQPHQWV WKHUH DUH DQ LQFUHDVLQJ QXPEHU RI UHVHDUFK
FKDOOHQJHV WR EH FRQVLGHUHG ,Q WKH IROORZLQJ ZH GLVFXVV WKH
PRVW UHOHYDQW RQHV IURP D GDWD PDQDJHPHQW YLHZSRLQW
VSHFLDOO\

%LJ 'DWD ,QGH[LQJ ,Q GLVWULEXWHG HQYLURQPHQWV D FULWLFDO
SUREOHPLVUHSUHVHQWHGE\WKHIXQGDPHQWDOQHHG IRULQGH[LQJ
ELJ GDWD DV WR DLG WKH DFFHVV SURFHVV DQG TXHU\ SKDVHV
UHVSHFWLYHO\ ,QGHHG GLVWULEXWHG LQGH[LQJ GDWD VWUXFWXUHV DUH
QHFHVVDU\ WR WKLV HQG 7KLV FKDOOHQJH LV PDGH ZRUVH E\ WKH
VWULQJKHWHURJHQHLW\RIELJGDWDVRXUFHV

%LJ 'DWD &RPSUHVVLRQ :KLOH LQ WKH FRQWH[W RI WUDGLWLRQDO
GDWDEDVH UHVHDUFK VHYHUDO FRPSUHVVLRQ PHWKRGV KDYH EHHQ
SURSRVHGFRPSUHVVLQJELJGDWDLVDGLIIHUHQWPDWWHU,QGHHGIRU
ELJGDWDV\VWHPVFRPSUHVVLRQLVDQHQDEOLQJWHFKQRORJ\MXVW
GXH WR WKH HQRUPRXV VL]H RI ELJ GDWD UHSRVLWRULHV WKDW DV D
PDWWHURIIDFWUHDOO\OLPLWVWKHUDQJHRIDSSOLFDELOLW\RIUHDOOLIH
ELJGDWD DSSOLFDWLRQVDQG V\VWHPV 2QHRSSRUWXQLW\WRIROORZ
VHHPV UHSUHVHQWHG E\ VHPDQWLFVEDVHG DSSURDFKHV ZKLFK
DQG4XDOLW\RI6HUYLFH4R6UHTXLUHPHQWVDVZHOODVVSDWLR
WHPSRUDOIHDWXUHV7KHSURSRVHGDSSURDFKILUVWLQWURGXFHVWLPH
DQGORFDWLRQLQIRUPDWLRQLQWRWKH UHFRPPHQGDWLRQ PRGHOV E\
GLVWLQJXLVKLQJWLPHVHQVLWLYH4R6PHWULFVDQGUHJLRQVHQVLWLYH
4R6PHWULFVIURPVWDEOH4R6PHWULFV7RGHDOZLWKWKHVSDUVH
UDWLQJ GDWD WLPH VORWV DQG UHJLRQV DUH FOXVWHUHG UHVSHFWLYHO\
7KHQDKLJKRUGHUWHQVRUIDFWRUL]DWLRQWHFKQLTXHLVDSSOLHGWR
PLQHWKHODWHQWIDFWRUVDPRQJXVHUVVHUYLFHVWLPHLQIRUPDWLRQ
DQGORFDWLRQLQIRUPDWLRQ0RUHRYHUWRLPSURYHWKHVFDODELOLW\
RIRXUUHFRPPHQGDWLRQPRGHOVLQELJGDWDHQYLURQPHQWVDIDVW
ZRXOG PDNH XVH RI WKH VHPDQWLFV RI ELJ GDWD WR JXLGH WKH
FRPSUHVVLRQSURFHVVLWVHOI

4XHU\LQJ &RPSUHVVHG %LJ 'DWD 6WULFWO\ UHODWHG WR WKH
SUHYLRXVWRSLFWKHLVVXHRITXHU\LQJFRPSUHVVHGELJGDWDSOD\V
D UHOHYDQW UROH ,QGHHG TXHU\LQJ FRPSUHVVHG UHSUHVHQWDWLRQV
UHTXLUHVVSHFLILF³GDWDJXLGH´GLFWLRQDU\WRPDSWKHFRPSUHVVHG
GRPDLQ RQWR WKH XQFRPSUHVVHG GRPDLQ DQG UHWULYH WKH VR
FDOOHG DSSUR[LPDWH DQVZHUV 7KLV VSHFLILF JRDO DVNV IRU
LQQRYDWLYHVROXWLRQVDQGDOJRULWKPV
GLVWULEXWHG DV\QFKURQRXV 6WRFKDVWLF *UDGLHQW 'HVFHQW 6*'
PHFKDQLVP LV HPSOR\HG WR JHW D JRRG EDODQFH EHWZHHQ WKH
FRQYHUJHQFH VSHHG DQG SUHGLFWLRQ DFFXUDF\([SHULPHQWDO
UHVXOWVVKRZWKDWRXUSURSRVDODFKLHYHVDJRRGEDODQFHEHWZHHQ
WKHUHFRPPHQGDWLRQDFFXUDF\DQGVFDODELOLW\
>@PRYHVWKHDWWHQWLRQRQELJFOLPDWHGDWDDQDO\WLFVDQG
SURSRVHV DQ LQPHPRU\ GLVWULEXWHG FRPSXWLQJ IUDPHZRUN
FDOOHG &OLPDWH6SDUN WR IDFLOLWDWH FRPSOH[ ELJ GDWD DQDO\WLFV
DQGWLPHFRQVXPLQJFRPSXWDWLRQDOWDVNVGHULYLQJIURPWKHWKH
QHHG IRU DQDO\]LQJ FOLPDWH GDWD &KXQNLQJ GDWD VWUXFWXUH
LPSURYHVSDUDOOHO,2HIILFLHQF\ZKLOHDVSDWLRWHPSRUDOLQGH[
LVEXLOW IRUWKH FKXQNVWRDYRLGXQQHFHVVDU\GDWD UHDGLQJDQG
SUHSURFHVVLQJ$QLQWHJUDWHGPXOWLGLPHQVLRQDODUUD\EDVHG
GDWD PRGHO FDOOHG &OLPDWH5'' DQG (7/ RSHUDWLRQV DUH


%LJ'DWD([FKDQJH,QWKHFRQWH[WRIGDWDLQWHQVLYHGLVWULEXWHG
HQYLURQPHQWV ELJ GDWD PXVW EH YHU\ RIWHQ
H[FKDQJHGWUDQVIHUUHG%LJGDWDH[FKDQJHLVLQWKLVUHVSHFWD
FULWLFDO UHVHDUFK FKDOOHQJH ZKHUH WKH PDLQ LVVXHV DUH GDWD
LQWHJUDWLRQ GDWD SULYDF\ GDWD DQDO\WLFV DQG VR IRUWK :LWKLQ
WKLVVRGHOLQHDWHGFRQWH[WPDQ\LQWHUHVWLQJDSSOLFDWLRQVFDQEH
DOVR LGHQWLILHG VXFK DV ELJ GDWD SURYLVLRQLQJ LQ EXVLQHVVWR
EXVLQHVVRUEXVLQHVVWRFRQVXPHUVHWWLQJV
,9 *5,'%$6('6(1625'$7$0$1$*(0(17$1'48(5<,1*
$',675,%87('6<67(0
,Q WKLV 6HFWLRQ ZH SURSRVH WKH ORJLFDO DUFKLWHFWXUH RI D
GLVWULEXWHGV\VWHPWKDWFRQVLGHUVWKHLQWHUHVWLQJFDVHRIVHQVRU
GDWD>@DVLJQLILFDQWLQVWDQFHRIELJGDWDGHSOR\HGRQWRSRI WKDWVWRUHVUHDGLQJVFRPLQJIURPDFHUWDLQVHWRIVHQVRUGRPDLQV
WKH IXQGDPHQWDO *ULG LQIUDVWUXFWXUH ZKLFK LV KHUH XVHG DV WR IRULQVWDQFH66'VWRUHVWKHUHDGLQJVRI6HQVRU'RPDLQ6'
PDQDJHELJGDWDDWWKHVFDOHRIWKHSURFHVVHGGDWD7KLVIROORZV 66'VWRUHVWKHUHDGLQJVRIWKH6HQVRU'RPDLQV6'DQG6'
WKH QDWXUDO LQWHJUDWLRQ RI *ULG IUDPHZRUNV DV DSSOLFDWLYH DQG VR RQ )XUWKHUPRUH LW FRQWDLQV FRPSUHVVHG LQIRUPDWLRQ
LQIUDVWUXFWXUHVRIELJGDWDSODWIRUPVHJ>@ QDPHO\6QDSVKRWRQGDWDJHQHUDWHGE\VHQVRUVEHORQJLQJWR
,QWKLV6HFWLRQZHGHVFULEHRXU*ULGEDVHGIUDPHZRUNIRU GLIIHUHQWVHQVRUGRPDLQVYL66'/RFDWRU66'/LVDVHUYLFH
VWRULQJ VHQVRU QHWZRUN UHDGLQJV DQG VXSSRUWLQJ IDVW WKDW DFFHVVHV WKH FDWDORJ RI 66'V ZKHUH WKH DVVRFLDWLRQV
DSSUR[LPDWHDJJUHJDWHTXHU\DQVZHULQJ7KHDUFKLWHFWXUHRI EHWZHHQ66'VDQG6'VDUHVWRUHGYLL4XHU\'LVSDWFKHU4'
RXU IUDPHZRUN LV VNHWFKHG LQ )LJ  ZKHUH WKH IROORZLQJ LVDVHUYLFHWKDWSURFHVVHVUDQJHTXHULHVE\ORFDWLQJWKH 66'V
HQWLWLHVDUHUHSUHVHQWHGL6HQVRULVWKHEDVLFGDWDVRXUFHIRU FRQWDLQLQJ WKH GDWD LQYROYHG LQ WKH TXHULHV DQG VHOHFWLQJ WKH
RXUV\VWHPLL6HQVRU'RPDLQ6'LVDFROOHFWLRQRIVHQVRUV 66'VWREHDFFHVVHGLQRUGHUWRHYDOXDWHWKHTXHULHVHIIHFWLYHO\
ZKLFK DUH VHPDQWLFDOO\ UHODWHG WR RQH DQRWKHU IRU LQVWDQFH LHZLWKDUHDVRQDEOHDFFXUDF\DQGHIILFLHQWO\YLLL6QDSVKRW
WHPSHUDWXUH VHQVRUV RI WKH VDPH UHJLRQ LLL 6WUHDP 6RXUFH &DWDORJ6&LVDVHUYLFHWKDWDFFHVVHVWKHFDWDORJRIVQDSVKRWV
66LVWKHKRVWFROOHFWLQJWKHVHQVRUUHDGLQJVFRPLQJIURPD ± WKLV FDWDORJ VWRUHV IRU HDFK 66' LQIRUPDWLRQ DERXW WKH
FHUWDLQVHQVRUGRPDLQLY'DWD'LVSDWFKHU''LVDVHUYLFH VQDSVKRWVZKLFKDUHDYDLODEOHLQLWL[6QDSVKRW$JHQW6$LV
WKDWUHFHLYHVVHQVRUUHDGLQJVIURP6WUHDP6RXUFHVDQGIRUZDUG DQ DJHQW H[HFXWLQJ WKH VQDSVKRW SROLF\ E\ XSGDWLQJ
WKHPWRWKH6HQVRU6WUHDP'DWDEDVHVZKLFKDUH³LQWHUHVWHG´LQ SHULRGLFDOO\FRPSUHVVHGGDWDVWRUHGLQWKH66'V
WKHVHUHDGLQJVY6HQVRU6WUHDP'DWDEDVH66'LVDGDWDEDVH

)LJ $$UFKLWHFWXUHRIWKHSURSRVHG*ULGEDVHGIUDPHZRUN>@

7KH SURSRVHG DUFKLWHFWXUH LQWURGXFHV WZR IXQGDPHQWDO
DEVWUDFWHQWLWLHVWKDWFKDUDFWHUL]HWKHORJLFDODUFKLWHFWXUH
x *ULG$JHQW
x *ULG6HUYLFH
VLQWHUIDFHWRZDUGVVHQVRUV,W
*ULG$JHQWVDUHDFWLYHHQWLWLHVZLWKDQDSSOLFDWLRQORJLFWKDW
UHTXLUH WKH H[HFXWLRQ RI VHUYLFHV *ULG VHUYLFHV DUH UHDFWLYH
HQWLWLHV WKDW SHUIRUP VHUYLFHV DQG RSHUDWLRQV XSRQ UHTXHVW
)XUWKHUPRUHZLWKUHVSHFWWRWKHSURSRVHGORJLFDODUFKLWHFWXUH
GLIIHUHQWW\SHVRI*ULG$JHQWVDQG*ULG6HUYLFHVDUHGHILQHG

*ULG$JHQWVLQWURGXFHGLQWKHSURSRVHGDUFKLWHFWXUHDUHWKH
IROORZLQJRQHV
x 5HPRWH6HQVLQJ*ULG$JHQWLVWKHDJHQWUHVSRQVLEOH
IRUPDQDJLQJWKHV\VWHP
GHDOV ZLWK GDWD FRPPXQLFDWLRQ DQG WUDQVSRUW IURP D
VHQVRUWRWKHUHVSRQVLEOH6WUHDP6RXUFH$QLPSRUWDQW
UHTXLUHPHQW LV WKH QHHG IRU PDNLQJ WKH VDPH DJHQW
LQGHSHQGHQWIURPWKHSDUWLFXODUVHQVRULWLQWHUIDFHVDQG
DERYHDOOLWVWHFKQRORJLFDOSHFXOLDULWLHVQRWHWKDWWKHUH
HDFK RQH GHGLFDWHG WR SHUIRUPLQJ D SDUWLFXODU WDVN 7KLV DUHPDQ\DQGGLIIHUHQWW\SHVRIVHQVRUVRQWKHPDUNHW
PRGHOLQJ LQ WHUPV RI DJHQWV DQG VHUYLFHV LV SDUWLFXODUO\ )URP WKH VRIWZDUHHQJLQHHULQJ SRLQW RI YLHZ WKLV
HIIHFWLYHLQFRPSXWDWLRQDO*ULGVDVZHOODV&ORXGVDVLWIXOO\ UHTXLUHPHQWFDQEHVDWLVILHGE\SURYLGLQJIRUWKHXVHRI
VDWLVILHVWKHQHHGVRIKLJKSHUIRUPDQFHFRPSXWLQJDQGDERYH DSUR[\FODVVWKDWLVLQWHUSRVHGEHWZHHQWKHGHYLFHDQG
DOOVFDODELOLW\WKDWDUHW\SLFDORIODUJHV\VWHPVDQGWKDWRSHUDWH WKHDJHQWDQGWKDWSURYLGHVDVRIWZDUHLQWHUIDFHWRWKH
RQODUJHDPRXQWVRIGDWDGDWDLQWHQVLYHV\VWHPVVXFKDVELJ DJHQW VWDUWLQJ IURP WKH WHFKQRORJLFDO GHWDLOV RI WKH
GDWDV\VWHPV GHYLFHPDUVKDOOLQJ


 x 7UDQVDFWLRQDO'DWD+DQGOHU*ULG$JHQWLVWKHDJHQW
UHVSRQVLEOHIRUUHFHLYLQJGDWDVWUHDPVSURGXFHGE\WKH
5HPRWH6HQVLQJ*ULG$JHQWDQGLQVHUWLQJWKHUHDGLQJV
LQWR D VXLWDEOH GDWDEDVH GHILQHG RQ D WRS RI D JLYHQ
'%06 PDGH DFFHVVLEOH WKURXJK WKH 2*6$'$,
KRF VHUYLFH FDSDEOH RI PDQDJLQJ VHFRQGDU\ PHPRU\
DQGFRQVHTXHQWO\WKHLQGH[LQJGDWDVWUXFWXUHDVZHOO
)RU H[DPSOH GXULQJ WKH TXHU\LQJ SKDVH WKLV VHUYLFH
FRXOGORDGWKH³SRUWLRQ´RIWKHVWUXFWXUHLQYROYHGE\WKH
TXHULHV IURP WKH VHFRQGDU\ PHPRU\ WR WKH PDLQ
SURWRFRO >@ LQ RUGHU WR DOORZ WKH PRGHOLQJ DQG PHPRU\LQRUGHUWRIXUWKHULQFUHDVHWKHHIILFLHQF\RI
UHSUHVHQWDWLRQ RI UHDGLQJV DFFRUGLQJ WR UHODWLRQDO TXHU\H[HFXWLRQUHVSRQVHWLPH
SDWWHUQV DQG RIIHU VXSSRUW IRU WKH H[HFXWLRQ RI VHW x 6QDSVKRS 4XHU\ ([HFXWRU *ULG 6HUYLFH LV WKH
YDOXHGTXHULHV8SGDWLQJDQGTXHU\LQJSURFHGXUHVDUH VHUYLFH UHVSRQVLEOH IRU WKH H[HFXWLRQ RI GDWD
SHUIRUPHG E\ VSHFLDO VHUYLFHV LQYRNHG E\ WKH DJHQW H[FKDQJLQJSURWRFRORSHUDWLRQV,WPXVWLDFWLYDWHWKH
1RWHWKDWLWLVDSSURSULDWHWRLQWURGXFHWKLVDJHQWHQWLW\ H[HFXWLRQ RI 6QDSVKRW 4XHULHV DW WKH H[HFXWRUV DQG
VLQFH LQ JHQHUDO WKH '%06 ³UHFLSLHQW´ PD\ QRW EH GRZQORDGWKHGDWDDWWKHVXEVFULEHUVLLFDUU\RXWWKH
SK\VLFDOO\ORFDWHGLQWKHVDPH*ULGQRGHRQZKLFKWKH SDUVLQJ RI WKH ;0/ PHWDGDWD UHSUHVHQWLQJ WKH
DJHQWLVDFWLYH 6QDSVKRW 3ROLFLHV LLL V\QFKURQL]H DQG FRQWURO WKH
x $JJUHJDWH 'DWD +DQGOHU *ULG $JHQW LV WKH DJHQW IORZRIGDWDWKDWDUHWUDQVIHUUHGDPRQJ6WUHDP6HUYHUV
UHVSRQVLEOHIRUUHFHLYLQJGDWDVWUHDPVSURGXFHGE\WKH
5HPRWH6HQVLQJ*ULG$JHQWDQGLQVHUWLQJWKHUHDGLQJV
LQWRDVSHFLDOVHFRQGDU\PHPRU\GDWDVWUXFWXUHFDSDEOH
RI VXSSRUWLQJ WKH H[HFXWLRQ RI DJJUHJDWH TXHULHV E\
SURYLGLQJ DSSUR[LPDWH DQVZHUV EDVHG RQ D PXOWL
UHVROXWLRQUHSUHVHQWDWLRQPRGHO
x 6QDSVKRW3URWRFRO+DQGOHU*LUG$JHQWLVWKHDJHQW
UHVSRQVLEOHIRUPDQDJLQJWKHGDWDH[FKDQJLQJSURWRFRO
H[LVWLQJ DPRQJ WZR RU PRUH 6WUHDP 6HUYHUV ZKLFK
UHSUHVHQWVWKHIXQGDPHQWDOHOHPHQWRIWKHV\VWHP7KLV
SURWRFROLVEDVHGRQWKHH[HFXWLRQRIVKDSVKRWTXHULHV
WKDW VXSSRUW WKH FUHDWLRQ RI V\QWKHWLF YLHZV DW WKH
LY FDUU\ RXW WKH SDUVLQJ RI $JJUHJDWLRQ 6FKHPHV LQ
RUGHU WR JHQHUDWH V\QWKHWLF YHUVLRQV RI WKH DJJUHJDWH
GDWDZLWKWKHVXEVFULEHUVHWF
x $JJUHJDWH 'DWD 'LUHFWRU\ *ULG 6HUYLFH LV WKH
IXQGDPHQWDOVHUYLFHRIDOOWKHDUFKLWHFWXUHDQGDOVRLWV
HIIHFWLYHUHDOL]DWLRQ,QDVLPLODUZD\WRZKDWKDSSHQV
ZLWK 'LVWULEXWHG )LOH 6\VWHPV RI 'LVWULEXWHG 6\VWHPV
IRUZKDWUHJDUGVILOHVDQGGLUHFWRULHVWKLVVHUYLFHPXVW
EHDEOHRIRIIHULQJDQDEVWUDFWLRQOHYHOZLWKUHVSHFWWR
WKHORFDWLRQRIWKHDJJUHJDWHGDWDORFDWHGLQWKH*ULG
,QRWKHU ZRUGVDQDSSOLFDWLRQWKDWDFFHVVHVDQ\ *ULG
QRGH PXVW EH DEOH WR NQRZ ZKDW DUH WKH GDWD
VXEVFULEHU6QDSVKRW4XHU\6XEVFULEHUVWDUWLQJIURP DJJUHJDWLRQV DYDLODEOH LQ WKH *ULG 'LVFRYHU\ *ULG
DJJUHJDWH UHDGLQJV VWRUHG DW WKH H[HFXWRU 6QDSVKRW 6HUYLFH ZKHUH WKH\ DUH ORFDWHG /RFDWLRQ *ULG
4XHU\([HFXWRU 6HUYLFHZKDWWKHLU$JJUHJDWLRQ6FKHPHVDUHDQGWKHLU
*ULGVHUYLFHVLQWURGXFHGLQWKHSURSRVHGDUFKLWHFWXUHDUHWKH OHYHO RI GHWDLO 0HWDGDWD *ULG 6HUYLFH 7KLV
IROORZLQJRQHV NQRZOHGJH FDQ EH H[SORLWHG WR VXSSRUW WKH G\QDPLF
x 7UDQVDFWLRQDO 'DWD 8SGDWLQJ *ULG 6HUYLFH LV WKH GHILQLWLRQ RI RSWLPDO TXHU\ SODQV IRU TXHU\LQJ
VHUYLFHUHVSRQVLEOHIRUSHUIRUPLQJWKHXVXDORSHUDWLRQV DJJUHJDWH GDWD GLVWULEXWHG RQ WKH *ULG *ULGEDVHG
RQUHODWLRQDOGDWDLQVHUWXSGDWHGHOHWHTXHU\RQWKH
UHODWLRQDO UHSUHVHQWDWLRQV RI UHDGLQJV ,W GLUHFWO\
LQYRNHVWKHFRUUHVSRQGLQJVHUYLFHVH[SRUWHGIURPWKH
VXSSRUW'%06E\XVLQJWKH2*6$'$,SURWRFRO
x $JJUHJDWH'DWD8SGDWLQJ*LUG6HUYLFHLVWKHVHUYLFH
GHOHJDWHG WR LQVHUW QHZ UHDGLQJV LQ WKH VHFRQGDU\
PHPRU\GDWDVWUXFWXUHZKLFKUHSUHVHQWVWKHDJJUHJDWH
LQIRUPDWLRQE\DOVRXSGDWLQJWKHLQGH[WKDWUHVLGHVLQ
PDLQPHPRU\
x 'DWD&RPSUHVVLRQ*ULG6HUYLFHLVWKHVHUYLFHWKDWLV
LQYRNHG RQ WKH DJJUHJDWH UHSUHVHQWDWLRQ RI UHDGLQJV
'LVWULEXWHG$JJUHJDWH4XHU\(QJLQH
$VDIXUWKHUFRQWULEXWLRQWRWKHFRQFHSWVDERYHLQ>@ZH
SURYLGHH[WHQVLYHH[SHULPHQWVDQGWHFKQLFDODQDO\VLVRQVXFK
H[SHULPHQWVWKDWVKRZERWKWKHHIIHFWLYHQHVVDQGWKHHIILFLHQF\
RI WKH ZKROH V\VWHP HJ LQ WKH FRQWH[W RI K\GURJHRORJLFDO
SURWHFWLRQLQ6RXWK,WDO\
9 &21&/86,216$1')8785(:25.
,QWKLVSDSHUZHKDYHIRFXVHGWKHDWWHQWLRQRQWKHHPHUJLQJ
SUREOHP RI HIIHFWLYHO\ DQG HIILFLHQWO\ PDQDJLQJ ELJ GDWD LQ
GLVWULEXWHG HQYLURQPHQWV E\ DOVR SURSRVLQJ UHVHDUFK
VHFRQGDU\ PHPRU\ ZKHQ WKH DYDLODEOH SK\VLFDO
PHPRU\ UXQV RXW LW DOORZV GDWD WR EH FRPSUHVVHG LQ
RUGHU WR IUHH XS PHPRU\ VSDFH WR EH XVHG IRU
UHSUHVHQWLQJQHZUHDGLQJV
x 0HPHUR\ +DQGOHU *ULG 6HUYLFH LV WKH VHUYLFH
UHVSRQVLEOH IRU DOORFDWLQJ DQG PDQDJLQJ VHFRQGDU\
PHPRU\ LW VKRXOG EH QRWHG WKDW LQ VHQVRU QHWZRUNV
SHUVSHFWLYHVDORQJWKLVOLQHRIUHVHDUFK0RVWUHOHYDQWVWDWHRI
WKHDUW DSSURDFKHV KDYH DOVR EHHQ UHSRUWHG DQG GLVFXVVHG
)LQDOO\ WKH SDSHU KDV SURSRVHG WKH ORJLFDO DUFKLWHFWXUH RI D
GLVWULEXWHGV\VWHPWKDWFRQVLGHUVWKHLQWHUHVWLQJFDVHRIVHQVRU
GDWDDVLJQLILFDQWLQVWDQFHRIELJGDWD
)XWXUH ZRUN LV PDLQO\ RULHQWHG WRZDUGV WKH H[WHQVLRQV RI
IXQFWLRQDOLWLHVRIRXUIUDPHZRUNDVWRHPEHGVXSSRUWIRUQRYHO
DSSOLFDWLRQ WKH VL]H RI ELJ GDWD WR EH PDQDJHG LV FKDOOHQJHV GLFWDFWHG E\ HPHUJLQJ ELJ GDWD WUHQGV HJ
HQRUPRXVDQGWKHUHIRUHLWLVHVVHQWLDOWRSURYLGHDQDG >@


 5()(5(1&(6 >@ &X]]RFUHD $  6DFFj '  ([SORLWLQJ &RPSUHVVLRQ DQG
$SSUR[LPDWLRQ3DUDGLJPVIRU(IIHFWLYHDQG(IILFLHQW2QOLQH$QDO\WLFDO
>@ =LNRSRXORV3 (DWRQ&8QGHUVWDQGLQJ%LJ'DWD$QDO\WLFV
3URFHVVLQJ RYHU 6HQVRU 1HWZRUN 5HDGLQJVLQ 'DWD *ULG(QYLURQPHQWV
IRU(QWHUSULVH&ODVV+DGRRSDQG6WUHDPLQJ'DWD0F*UDZ+LOO2VERUQH
&RQFXUUHQF\DQG&RPSXWDWLRQ3UDFWLFHDQG([SHULHQFH
0HGLD

>@ 0DQ\LND-&KXL0%URZQ%%XJKLQ-'REEV55R[EXUJK&
>@ &X]]RFUHD $ )XUIDUR ) 0DVFLDUL ( 6DFFj '  6LUDQJHOR &
 %\HUV $+  %LJ 'DWD 7KH 1H[W )URQWLHU IRU ,QQRYDWLRQ
$SSUR[LPDWH4XHU\$QVZHULQJRQ6HQVRU1HWZRUN'DWD6WUHDPV
&RPSHWLWLRQDQG3URGXFWLYLW\0F.LQVH\*OREDO,QVWLWXWH75
,Q³*HR6HQVRU1HWZRUNV´&5&3UHVV
>@ &X]]RFUHD$6DFFj' 8OOPDQ-'E%LJ'DWD$5HVHDUFK
>@ +RVVHLQL% .LDQL.$ELJGDWDGULYHQGLVWULEXWHGGHQVLW\
$JHQGD,Q3URFRI$&0,'($6,QW&RQI
EDVHG KHVLWDQW IX]]\ FOXVWHULQJ XVLQJ $SDFKH VSDUN ZLWK DSSOLFDWLRQ WR
>@ &X]]RFUHD$6RQJ,< 'DYLV.&$QDO\WLFVRYHU/DUJH
JHQH H[SUHVVLRQ PLFURDUUD\ (QJLQHHULQJ $SSOLFDWLRQV RI $UWLILFLDO
6FDOH0XOWLGLPHQVLRQDO'DWD7KH%LJ'DWD5HYROXWLRQ,Q3URFRI$&0
,QWHOOLJHQFH
'2/$3,QW:RUN
>@ =DKDULD 0 ;LQ 56 :HQGHOO 3 'DV 7 $UPEUXVW 0 'DYH $
>@ 3HQJ 6 <X 6  0XHOOHU 3  6RFLDO QHWZRUNLQJ ELJ GDWD
0HQJ ; 5RVHQ - 9HQNDWDUDPDQ 6 )UDQNOLQ 0- *KRGVL $
2SSRUWXQLWLHV VROXWLRQV DQG FKDOOHQJHV )XWXUH *HQHUDWLRQ &RPSXWHU
*RQ]DOH]-6KHQNHU6 6WRLFD, $SDFKH6SDUNDXQLILHG
6\VWHPV
HQJLQHIRUELJGDWDSURFHVVLQJ&RPPXQLFDWLRQVRIWKH$&0
>@ 0DVVREULR 5 1HVPDFKQRZ 6 7FKHUQ\NK $ $YHWLV\DQ $ 

5DGFKHQNR*,7RZDUGVD&ORXG&RPSXWLQJ3DUDGLJPIRU%LJ
>@ 0HQJ6:DQJ+/L4/XR<'RX: :DQ66SDWLDO
'DWD $QDO\VLV LQ 6PDUW &LWLHV 3URJUDPPLQJ DQG &RPSXWHU 6RIWZDUH
7HPSRUDO$ZDUH,QWHOOLJHQW6HUYLFH5HFRPPHQGDWLRQ0HWKRG%DVHGRQ

'LVWULEXWHG7HQVRUIDFWRUL]DWLRQIRU%LJ'DWD$SSOLFDWLRQV,((($FFHVV
>@ )HQJ.6XQ;+<DQJ; =KRX66FL'36XSSRUW+3&

DQG%LJ'DWD$SSOLFDWLRQVYLD,QWHJUDWHG6FLHQWLILF'DWD3URFHVVLQJ,Q
>@ +X)<DQJ&6FKQDVH-/'XII\'4;X0%RZHQ0./HH
3URFRI,(((&/867(5
7  6RQJ :  &OLPDWH6SDUN $Q LQPHPRU\ GLVWULEXWHG
>@ &KHQ&*ROVKDQ%+DOHY\$<7DQ:& 'RDQ$+
FRPSXWLQJ IUDPHZRUN IRU ELJ FOLPDWH GDWD DQDO\WLFV &RPSXWHUV 
%LJ*RULOOD $Q 2SHQ6RXUFH (FRV\VWHP IRU 'DWD 3UHSDUDWLRQ DQG
*HRVFLHQFHV
,QWHJUDWLRQ,((('DWD(QJLQHHULQJ%XOOHWLQ
>@ *OREDO *ULG )RUXP  2SHQ *ULG 6HUYLFHV $UFKLWHFWXUH  'DWD
>@ .HQQHG\5./.KRVKJRIWDDU709LOODQXVWUH) +XPSKUH\7
$FFHVVDQG,QWHJUDWLRQŠ––’ǣȀȀ™™™Ǥ‘‰•ƒǦ†ƒ‹Ǥ‘”‰Ǥ—
 $ SDUDOOHO DQG GLVWULEXWHG VWRFKDVWLF JUDGLHQW GHVFHQW
>@ 2SHQ 6RXUFH *HRVSDWLDO )RXQGDWLRQ  0DS6HUYHU
LPSOHPHQWDWLRQXVLQJFRPPRGLW\FOXVWHUV-RXUQDORI%LJ'DWD
Š––’ǣȀȀƒ’•‡”˜‡”Ǥ‘”‰Ȁ
>@ &KRQ .:  .LP 06  %,*0LQHU D IDVW DQG VFDODEOH
>@ %UDXQ 3 &DPHURQ -- &X]]RFUHD $ -LDQJ )  /HXQJ &.6
GLVWULEXWHGIUHTXHQWSDWWHUQPLQHUIRUELJGDWD&OXVWHU&RPSXWLQJ
(IIHFWLYHO\DQG(IILFLHQWO\0LQLQJ)UHTXHQW3DWWHUQVIURP'HQVH

*UDSK6WUHDPVRQ'LVN3URFHGLDRI&RPSXWHU6FLHQFH
>@ 6D\RRG .  ,QWURGXFWLRQ WR 'DWD &RPSUHVVLRQ WK HGLWLRQ
>@ /L .& -LDQJ + <DQJ /7  &X]]RFUHD $  %LJ 'DWD 
0RUJDQ.DXIPDQQ
$OJRULWKPV$QDO\WLFVDQG$SSOLFDWLRQV&KDSPDQDQG+DOO&5&
>@ )RVWHU,.HVVHOPDQ& 7XHFNH67KH$QDWRP\RIWKH*ULG
>@ :X=<LQ:&DR-;X* &X]]RFUHD$&RPPXQLW\
(QDEOLQJ6FDODEOH9LUWXDO2UJDQL]DWLRQV -RXUQDORI+LJK3HUIRUPDQFH
'HWHFWLRQLQ0XOWLUHODWLRQDO6RFLDO1HWZRUNV ,Q 3URFRI,(((:,6(
&RPSXWLQJ$SSOLFDWLRQV
,QW&RQI
>@ =KXJH+ 6XQ;6HPDQWLFVNQRZOHGJHDQGJULGVDWWKHDJH
>@ <DQJ &7 /LX -& +VX &+  &KRX :/  2Q
RI ELJ GDWD DQG $, &RQFXUUHQF\ DQG &RPSXWDWLRQ 3UDFWLFH DQG
,PSURYHPHQWRI&ORXG9LUWXDO0DFKLQH$YDLODELOLW\ZLWK9LUWXDOL]DWLRQ
([SHULHQFH
)DXOW7ROHUDQFH0HFKDQLVP7KH-RXUQDORI6XSHUFRPSXWLQJ
>@ +H ; &KX / 4LX 5& $L 4  /LQJ =  $ 1RYHO 'DWD

'ULYHQ 6LWXDWLRQ $ZDUHQHVV $SSURDFK IRU )XWXUH *ULGV  8VLQJ /DUJH
5DQGRP0DWULFHVIRU%LJ'DWD0RGHOLQJ,((($FFHVV