2020 International Conference on Computer Communication and Network Security (CCNS)

$6XUYH\RI7H[W'DWD$XJPHQWDWLRQ

3HL/LX ;XHPLQ:DQJ
5HVHDUFK,QVWLWXHRI&KLQD7HOHFRP&RUSRUDWLRQ/LPLWHG 5HVHDUFK,QVWLWXHRI&KLQD7HOHFRP&RUSRUDWLRQ/LPLWHG
%HLMLQJ&KLQD %HLMLQJ&KLQD
OLXSHL#FKLQDWHOHFRPFQ 
 :HL\H0HQJ
&KDR;LDQJ 5HVHDUFK,QVWLWXHRI&KLQD7HOHFRP&RUSRUDWLRQ/LPLWHG
5HVHDUFK,QVWLWXHRI&KLQD7HOHFRP&RUSRUDWLRQ/LPLWHG %HLMLQJ&KLQD
%HLMLQJ&KLQD

Abstract²:KHQ QDWXUDO ODQJXDJH SURFHVVLQJ 1/3
WHFKQRORJ\LVDSSOLHGWRLQGXVWULDOLQWHUQHWSUREOHPVVXFKDVODFN
RIGDWDDQGLPEDODQFHRIGDWDDUHRIWHQHQFRXQWHUHG,QRUGHUWR
LPSURYH WKH DFFXUDF\ DQG UREXVWQHVV RI WKH PRGHO WH[W GDWD
DXJPHQWDWLRQ ZDV SURSRVHG WR H[SDQG GDWD 'DWD DXJPHQWDWLRQ
LVZLGHO\XVHGLQFRPSXWHUYLVLRQ)RUH[DPSOHWKHVHPDQWLFVRI
WKH LPDJH ZLOO QRW EH FKDQJHG LI WKH LPDJH LV URWDWHG VHYHUDO
GHJUHHVRUFRQYHUWHGWRJUD\OHYHO+RZHYHUDXJPHQWDWLRQRIWH[W
GDWD LQ 1/3 LV SUHWW\ UDUH 'DWD DXJPHQWDWLRQ LV D ORZFRVW
PHDQVWRH[SDQGWKHDPRXQWRIGDWDDQGLPSURYHWKHHIIHFWRIWKH
PRGHOZKLFKKDVDZLGHUDQJHRIDSSOLFDWLRQV
Keywords- text data augmentation; AI technology; natural
language processing
, ,1752'8&7,21
,Q UHFHQW\HDUV WKHUHDUH PRUHDQG PRUH H[FHOOHQWPRGHOV
ZLWK WKH UDSLG GHYHORSPHQW RI $, WHFKQRORJ\ %HWWHU PRGHO
UHTXLUHV PRUH GDWD 7KH DSSOLFDWLRQ PDUNHW RI DUWLILFLDO
LQWHOOLJHQFH LQ WKH ILHOGV RI FRPPXQLFDWLRQ ILQDQFH DQG
PHGLFDO WUHDWPHQW LV JURZLQJ UDSLGO\ +RZHYHU LQ LQGXVWULDO
LQWHUQHW WKH SUREOHP RI LQVXIILFLHQW GDWD LV RIWHQ HQFRXQWHUHG
GXH WR WKH GLIILFXOW\ RI HTXLSPHQW QHWZRUNLQJ DQG WKH ZHDN
DELOLW\ RI LQGXVWULDO GDWD FROOHFWLRQ :KHQ WKH QXPEHU RI
VDPSOHV FROOHFWHG GRHV QRW PHHW WKH QHHGV RI PRGHO WUDLQLQJ
WKH PRGHO ZLOO EH LQ WKH VWDWH RI XQGHU ILWWLQJ ,I ZH XVH GDWD
DXJPHQWDWLRQ ZH FDQ VLPSO\ HQFRXQWHU WKH SUREOHP WKDW
WKHQXPEHURIWUDLQLQJVDPSOHVLVDOZD\VOLPLWHG>@,QDGGLWLRQ
DQRWKHU SUREOHP RIWHQ HQFRXQWHUHG LV GDWD LPEDODQFH LQ WKH
FODVVLILFDWLRQWDVNZKLFKZLOOOHDGWRWKHORZDFFXUDF\DQGORZ
UHFDOOUDWHRIVPDOOQXPEHURIVDPSOHV,IGDWDHQKDQFHPHQWDUH
FDUULHG RXW IRU VPDOOQXPEHURIVDPSOHV XQEDODQFHG GDWD FDQ
EH FRQYHUWHG LQWR EDODQFHG GDWD RU WKH LPEDODQFH RI VDPSOHV
FDQEHUHGXFHGDQGWKHPRGHOHIIHFWFDQEHLPSURYHG>@7KH
HIIHFW RI WKH PRGHO JUHDWO\ UHOLHV RQ WKH TXDOLW\ RI WKH GDWD
7KHUHIRUH JUHDW VXFFHVV KDV EHHQ DFKLHYHG LQ VSHHFK
UHFRJQLWLRQ LQFOXGLQJ QRLVH HQKDQFHPHQW UDQGRP VDPH W\SH
H[WUDFWLRQ VSOLFLQJ WLPH VKLIW HQKDQFHPHQW SLWFK
WUDQVIRUPDWLRQ HQKDQFHPHQW VSHHG DGMXVWPHQW YROXPH
DGMXVWPHQW HWF 7KH GDWD DXJPHQWDWLRQ RI FRPSXWHU YLVLRQ LV
VKRZQLQ)LJXUH:HDOZD\VXVHDOLPLWHGQXPEHURIGDWDWR
WUDLQWKHPRGHOVRGDWDHQKDQFHPHQWLVDQLQGLVSHQVDEOHSDUW
7KURXJK GDWD HQKDQFHPHQW REWDLQLQJ PRUH KLJKTXDOLW\ GDWD
FDQKHOSWKHPRGHOWRLPSURYHLWVUREXVWQHVV
978-1-7281-4349-1/20/$31.00 ©2020 IEEE
DOI 10.1109/CCNS50731.2020.00049
Authorized licensed use limited to: ULAKBIM UASL - Uluslararasi Kibris Universitesi. Downloaded on May 19,2021 at 22:51:23 UTC from IEEE Xplore. Restrictions apply.
'DWD HQKDQFHPHQW ZDV ILUVWO\ XVHG LQ FRPSXWHU YLVLRQ ,W
PDLQO\XVHVYDULRXVWHFKQLTXHVWRJHQHUDWHQHZWUDLQLQJGDWD,W
FDQ FUHDWH QHZ GDWD E\ WUDQVODWLQJ URWDWLQJ FRPSUHVVLQJ DQG
DGMXVWLQJ FRORUV RI LPDJHV ,Q DGGLWLRQ LW KDV DOVR DFKLHYHG
JUHDW VXFFHVV LQ VSHHFK UHFRJQLWLRQ $OWKRXJK LQ WKH ILHOG RI
FRPSXWHU YLVLRQ DQG VSHHFK UHFRJQLWLRQ WKH QHZ VDPSOHV
JHQHUDWHGFKDQJHWKHDSSHDUDQFHWRVRPHH[WHQWWKHODEHOVRI
WKH VDPSOHV UHPDLQ XQFKDQJHG +RZHYHU LQ QDWXUDO ODQJXDJH
SURFHVVLQJWKHGDWDLVGLVFUHWHZKLFKPDNHVLWLPSRVVLEOHIRU
XV WR FRQYHUW WKH LQSXW GDWD GLUHFWO\ DQG VLPSO\ &KDQJLQJ D
ZRUG PD\ FKDQJH WKH PHDQLQJ RI WKH ZKROH VHQWHQFH
7KHUHIRUH GDWD HQKDQFHPHQW ZKLFK LV PRUH GLIILFXOW VWDUWV
ODWHLQWKHILHOGRIQDWXUDOODQJXDJHSURFHVVLQJ7KHWUDGLWLRQDO
WH[WGDWD HQKDQFHPHQW KDVWZR LGHDV RQHLV DGGLQJ QRLVH WKH
RWKHULVEDFNWUDQVODWLRQERWKRIZKLFKDUHVXSHUYLVHGPHWKRGV
$GGLQJQRLVHLVWRFUHDWHQHZGDWDVLPLODUWRWKHRULJLQDOGDWD
E\ VXEVWLWXWLQJ ZRUGV DQG GHOHWLQJ ZRUGV RQ WKH EDVLV RI WKH
RULJLQDO GDWD %DFN WUDQVODWLRQ LV WR WUDQVODWH WKH RULJLQDO GDWD
LQWR RWKHU ODQJXDJHV DQG WKHQ EDFN WR WKH RULJLQDO ODQJXDJH
'XH WR WKH GLIIHUHQW ORJLFDO RUGHU RI ODQJXDJHV WKH EDFN
WUDQVODWLRQ PHWKRG FDQ RIWHQ JHW QHZ GDWD ZKLFK LV GLIIHUHQW
IURP WKH RULJLQDO GDWD ,Q UHFHQW \HDUV ZLWK WKH UDSLG
GHYHORSPHQW RI GHHS OHDUQLQJ WHFKQRORJ\ LW KDV EHHQ ZLGHO\
XVHG LQ WKH ILHOG RI WH[W GDWD HQKDQFHPHQW ,W LQFOXGHV VHPL
VXSHUYLVHG 0L[0DWFK>@ DQG XQVXSHUYLVHG GDWD
DXJPHQWDWLRQ>@

)LJXUH 7KHGDWDDXJPHQWDWLRQRIFRPSXWHUYLVLRQ
,, '$7$$8*0(17$7,21
'DWD HQKDQFHPHQWLV DOVR FDOOHG GDWDDXJPHQWDWLRQZKLFK
PHDQV WKDW D OLPLWHG DPRXQW RI GDWD FDQ SURGXFH YDOXH
HTXLYDOHQW WR PRUH GDWD ZLWKRXW VXEVWDQWLDOO\ LQFUHDVLQJ GDWD
'DWD HQKDQFHPHQW FDQ EH GLYLGHG LQWR VXSHUYLVHG GDWD
HQKDQFHPHQW VHPLVXSHUYLVHG GDWD HQKDQFHPHQW DQG
XQVXSHUYLVHG GDWD HQKDQFHPHQW 7KH FODVVLILFDWLRQ RI GDWD
191
 HQKDQFHPHQW LV VKRZQ LQ )LJXUH  6XSHUYLVHG GDWD
HQKDQFHPHQWLVEDVHG RQWKHH[LVWLQJGDWDE\XVLQJ WKH SUHVHW
GDWD WUDQVIRUPDWLRQ UXOHV ZKLFK FDQ EH GLYLGHG LQWR VLQJOH
VDPSOHGDWDHQKDQFHPHQWDQGPXOWLVDPSOHGDWDHQKDQFHPHQW
7KH VRFDOOHG VLQJOH VDPSOH GDWD HQKDQFHPHQW WKDW LV WR
HQKDQFH D VDPSOH DOO RSHUDWLRQV DURXQG WKH VDPSOH LWVHOI
'LIIHUHQW IURP VLQJOH VDPSOH GDWD HQKDQFHPHQW PXOWLSOH GDWD
HQKDQFHPHQW PHWKRGV XVH PXOWLSOH VDPSOHV WR JHQHUDWH QHZ
VDPSOHV ZKLFK LQFOXGLQJ V\QWKHWLF PLQRULW\ RYHUVDPSOLQJ
WHFKQLTXH>@ 6DPSOH3DLULQJ>@ PL[XS>@ HWF 8QVXSHUYLVHG
GDWD HQKDQFHPHQW FDQ EH GLYLGHG LQWR WZR GLUHFWLRQV
JHQHUDWLQJ QHZ GDWD DQG OHDUQLQJ HQKDQFHPHQW VWUDWHJLHV
7KHUH DUH WZR W\SHV RI XQVXSHUYLVHG GDWD HQKDQFHPHQW
PHWKRGV2QHRIWKHPHWKRGLVOHDUQLQJWKHGLVWULEXWLRQRIGDWD
WKURXJKPRGHOUDQGRPO\JHQHUDWLQJLPDJHVFRQVLVWHQWZLWKWKH
GLVWULEXWLRQ RI WUDLQLQJ GDWD VHW UHSUHVHQWLQJ WKH PHWKRG
*$1>@ 7KH RWKHU LV WR OHDUQ D PHWKRG RI GDWD HQKDQFHPHQW
VXLWDEOH IRU WKH FXUUHQW WDVN WKURXJK WKH PRGHO 7KH
UHSUHVHQWDWLYHPHWKRGVLQFOXGH$XWR$XJPHQW>@
 (QJOLVK
'DWD HQKDQFHPHQW ZDV ILUVW XVHG LQ FRPSXWHU YLVLRQ DQG
VSHHFK UHFRJQLWLRQ $OWKRXJK WH[W GDWD HQKDQFHPHQW VWDUWHG
V WHDP VHSDUDWH
ODWH LW KDV PDGH JUHDW SURJUHVV LQ UHFHQW \HDUV LQFOXGLQJ WH[W
FODVVLILFDWLRQ TXHVWLRQ DQVZHULQJ V\VWHP PXOWLWXUQ GLDORJXH
DQGRWKHUILHOGV7KHPHWKRGRIWH[WGDWDHQKDQFHPHQWLQFOXGH
EDFN WUDQVODWLRQ UDQGRP ZRUG UHSODFHPHQW QRQFRUH ZRUG
UHSODFHPHQWGDWDHQKDQFHPHQWEDVHGRQWH[WJHQHUDWLRQPRGHO
HWF
'DWDDXJPHQWDWLRQFDQXVHWUDQVODWLRQPRGHOVRUWUDQVODWLRQ
WRROV &RPPRQ WUDQVODWLRQ PRGHOV LQFOXGH VHTVHT 107
WUDQVIRUPHU DQG VR RQ &RPPRQ WUDQVODWLRQ WRROV LQFOXGH
*RRJOH WUDQVODWLRQ EDLGX WUDQVODWLRQ <RXGDR WUDQVODWLRQ HWF
:LWK WKH QHHG RI PDVVGDWDTXDQWLW\H[SDQVLRQ EHDP VHDUFK
DQG UDQGRP VDPSOH VWUDWHJ\ RI WUDQVODWLRQ PRGHO RU DGGLQJ
PLGGOHODQJXDJHVWUDWHJ\RIWUDQVODWLRQWRROVFDQEHUHDOL]HG,Q
JHQHUDO WKH WH[W GDWD ZLWK WUDQVODWLRQ PRGHO KDV KLJKHU
ODQJXDJHULFKQHVVZKLOHWKHWH[WWUDQVODWHGE\WUDQVODWLRQWRROV
KDVEHWWHUVHPDQWLFDFFXUDF\DQGFRKHUHQFH
7KH GHYHORSPHQW RI EDFNWUDQVODWLRQ EHQHILWV IURP WKH
SURJUHVVRIPDFKLQHWUDQVODWLRQ,WZDVILUVWDSSOLHGLQPDFKLQH
WUDQVODWLRQ,Q6HQQULFKHWDODSSOLHGEDFNWUDQVODWLRQWR
WKH QHXUDO PDFKLQH WUDQVODWLRQ PRGHO DQG DFKLHYHG 
%/8( LPSURYHPHQW RQ :07  WDVN DQG  %/8(
SHUIRUPDQFHLPSURYHPHQWLQORZUHVRXUFH,:6/7WDVN>@
,QZLWKWKHXVHRIEDFNWUDQVODWLRQDJURXSRI)DFHERRN
DFTXLUHG QHZ VWDWHRIWKHDUW UHVXOWV RQ :07
*HUPDQ WHVW VHW>@ 7KH ZHOONQRZQ UHDGLQJ FRPSUHKHQVLRQ
PRGHOV4$1HW>@DQG8'$>@DOODGRSWEDFNWUDQVODWLRQIRU
GDWD HQKDQFHPHQW &08 DQG *RRJOH EUDLQ
EDFNWUDQVODWLRQDVDVSHFLDOL]HGGDWDDXJPHQWDWLRQWRRSWLPL]H
WKH SHUIRUPDQFH RI TXHVWLRQ DQVZHULQJ PRGHO 7KH\ WUDLQHG
WZR107PRGHOV(QJOLVKWR)UHQFKDQG)UHQFKWR(QJOLVKWR
LPSOHPHQW EDFNWUDQVODWLRQ ([SHULPHQWV VKRZ WKDW WKH EDFN
WUDQVODWLRQ FDQ LPSURYH WKH SHUIRUPDQFH RI WKH PRGHO E\ DW
OHDVW RQH SHUFHQWDJH SRLQW 7KLV WHFKQLTXH LV DOVR XVHG LQ WKH
1/3HPRWLRQFODVVLILFDWLRQWDVNRI.DJJOH,QWKHILUVWVROXWLRQ
RI 7R[LF &RPPHQW &ODVVLILFDWLRQ &KDOOHQJH WKH ZLQQHU
HQKDQFHV WKH WUDLQLQJ GDWD DQG HTXDOL]HV WKH SUHGLFWLRQ
SUREDELOLW\ RI (QJOLVK VHQWHQFHV DQG WKH UHYHUVH WUDQVODWLRQ LQ
 HQFRXQWHUDFFRXQWUHVWULFWLRQV
)LJXUH 7KHFODVVLILFDWLRQRIGDWDHQKDQFHPHQW
,,, 7+(0(7+2'62)7(;7'$7$$8*0(17$7,21
A. Back-translation
%DFNWUDQVODWLRQ LV RQH RI WKH PRVW ZLGHO\ XVHG GDWD
HQKDQFHPHQWLQHQJLQHHULQJSUDFWLFHZKLFKLVHDV\WRXVHDQG
FDQSURGXFHKLJKTXDOLW\GDWD,QUHFHQW\HDUVWKHILHOGRIWH[W
WUDQVODWLRQKDVGHYHORSHGUDSLGO\0DQ\WHFKQRORJ\FRPSDQLHV
KDYHRSHQHGWUDQVODWLRQLQWHUIDFHVVXFKDV%DLGXDQG*RRJOH
WKUHHODQJXDJHV)UHQFK *HUPDQDQG6SDQLVKGXULQJWKHWHVW
WRREWDLQWKHILQDOSUHGLFWLRQ
%DFNWUDQVODWLRQ LV RQH RI WKH PRVW ZLGHO\ XVHG GDWD
HQKDQFHPHQWPHWKRGVZKLFKLVHDV\WRXVHDQGKDVJUHDWHIIHFW
+RZHYHUWKHUHDUHDOVRVRPHSUREOHPV7KHGDWDJHQHUDWHGE\
EDFN WUDQVODWLRQ PHWKRG GHSHQGVRQ WKH TXDOLW\ RI WUDQVODWLRQ
DQG PRVW RI WKH WUDQVODWLRQ UHVXOWV PD\ QRW EH VR DFFXUDWH ,I
\RX XVH WKH LQWHUIDFH RI VRPH WUDQVODWLRQ VRIWZDUH \RX PD\
B. Lexical Substitution
$FFRUGLQJ WR WKH W\SH RI UHSODFHG ZRUGV OH[LFDO
VXEVWLWXWLRQ FDQ EH URXJKO\ GLYLGHG LQWR UDQGRP ZRUG
VXEVWLWXWLRQDQGQRQFRUHZRUGVXEVWLWXWLRQ'DWDDXJPHQWDWLRQ
EDVHGRQUDQGRPZRUGUHSODFHPHQWLVDJHQHUDOWHUPIRUDNLQG
RI WH[W GDWD DXJPHQWDWLRQ 7KH EDVLF PHWKRG LV VLPLODU WR
UDQGRPFOLSSLQJDQGLPDJHVFDOLQJLQLPDJHGDWDDXJPHQWDWLRQ
,W XVXDOO\ VHOHFWV D FHUWDLQ SURSRUWLRQ RI ZRUGV LQ WKH WH[W
UDQGRPO\DQGSHUIRUPVV\QRQ\PUHSODFHPHQWDQGGHOHWLRQRQ
WKHVH ZRUGV ,Q  D UHVHDUFK WHDP SURSRVHG D WH[W
7KH EDVLF SURFHVV RI EDFNWUDQVODWLRQ LV YHU\ VLPSOH 7KH
RULJLQDO &KLQHVH LV WUDQVODWHG LQWR (QJOLVK E\ XVLQJ WKH
WUDQVODWLRQPRGHODQGWKHQWKHH[SUHVVLRQEDVHGRQ(QJOLVKLV
WUDQVODWHGLQWR-DSDQHVHDQGILQDOO\GLUHFWO\WUDQVODWHGEDFNWR
&KLQHVHIURP-DSDQHVH7KHQZHFDQJHWWKHHQKDQFHGWH[WRI
WKHRULJLQDOWH[W7KHLQWHUODQJXDJHFDQEHRQHRUPRUHZKLFK
FDQEHVHOHFWHGDFFRUGLQJWRWKHWDVN
192
Authorized licensed use limited to: ULAKBIM UASL - Uluslararasi Kibris Universitesi. Downloaded on May 19,2021 at 22:51:23 UTC from IEEE Xplore. Restrictions apply.
HQKDQFHPHQW PHWKRG FDOOHG (DV\ 'DWD $XJPHQWDWLRQ ('$
ZKLFKPDLQO\LQFOXGHVIRXURSHUDWLRQVV\QRQ\PUHSODFHPHQW
UDQGRP LQVHUWLRQ UDQGRP H[FKDQJH DQG UDQGRP GHOHWLRQ>@
6\QRQ\P VXEVWLWXWLRQ LV JHQHUDOO\ WR VHOHFW QRQVWRS ZRUGV
UDQGRPO\ IURP VHQWHQFHV DQG UHSODFH WKHVH ZRUGV ZLWK
UDQGRPO\VHOHFWHGV\QRQ\PV5DQGRPLQVHUWLRQLVWRUDQGRPO\
ILQGDZRUGWKDWGRHVQRWEHORQJWRWKHVWRSZRUGVDQGILQGLWV
UDQGRP V\QRQ\P DQG LQVHUW WKH V\QRQ\P LQWR D UDQGRP
 SRVLWLRQ RI WKH VHQWHQFH 5HSHDW Q WLPHV 5DQGRP VZDS LV D
UDQGRPFKRLFHRIWZRZRUGVLQDVHQWHQFHDQGH[FKDQJLQJWKHLU
SRVLWLRQV 5DQGRP GHOHWLRQ LV WR GHOHWH HYHU\ ZRUG LQ D
VHQWHQFH ZLWK SUREDELOLW\ 3 $Q H[DPSOH RI WKHVH IRXU
RSHUDWLRQV LV VKRZQ LQ 7DEOH  DQG WKH RULJLQDO WH[W LV WH[W
HQKDQFHPHQW LV D NH\ WHFKQRORJ\ 7KHUH DUH WKUHH ZD\V WR
REWDLQZRUGVLQUDQGRPZRUGUHSODFHPHQWZKLFKDUHEDVHGRQ
V\QRQ\P GLFWLRQDU\ EDVHG RQ ZRUG YHFWRU DQG EDVHG RQ
ODQJXDJH PRGHO 7KH UHSODFHPHQW PHWKRG EDVHG RQ V\QRQ\P
GLFWLRQDU\DSSHDUHGHDUOLHU,Q=KDQJHWDOXVHFKDUDFWHU
OHYHOUHSODFHPHQWLQWH[WFODVVLILFDWLRQ>@7KHPHWKRGEDVHG
RQ ZRUG YHFWRU LV WR ILQG DGMDFHQW ZRUGV LQ WKH HPEHGGLQJ
VSDFHWRUHSODFH,QUHFHQW\HDUVVRPHIDPRXVSUHWUDLQHGZRUG
HPEHGGLQJV LQFOXGH :RUG9HF *OR9H )DVW7H[W 6HQW9HF
HWF 7LQ\%(57 DV ZH NQRZ LW XVHV *OR9H IRU GDWD
HQKDQFHPHQW>@ 0DVNHG /0 ZKLFK REWDLQV VXEVWLWXWLRQ
ZRUGVEDVHGRQODQJXDJHPRGHOUHIHUVWRWKH$XWRHQFRGHU/0
ZK\ ZH XVH GDWD DXJPHQWDWLRQ LV WKDW WKH DPRXQW RI GDWD LV
VPDOO VR WKH SUDFWLFDELOLW\ RI GHHS JHQHUDWLYH PRGHO LV SRRU
+RZHYHUWKHSUHWUDLQHGPRGHOLVGLIIHUHQWIURPWKLV,IZHFDQ
DGG WDJ LQIRUPDWLRQ WR WKH PRGHO ZH FDQ JHW JRRG UHVXOWV E\
XVLQJ D ODUJH QXPEHU RI XQODEHOHG GDWD IRU SUHWUDLQLQJ RI
ODQJXDJHPRGHO7KHILUVWRQHWRXVHWKHSUHWUDLQHGPRGHOVWR
HQKDQFH WKH GDWD DQG DGG WDJ LQIRUPDWLRQ LV &RQWH[WXDO
$XJPHQW %DVHG RQ /670 EL/0 SUHWUDLQLQJ LV FDUULHG RXW
DQGWKHWDJLQIRUPDWLRQLVLQWHJUDWHGLQWRWKHQHWZRUNVWUXFWXUH
IRU ILQHWXQH>@ ,W LV IRXQG WKDW WKH ZRUGV JHQHUDWHG E\
UHSODFHPHQW DUH FRPSDWLEOH ZLWK WKH WDJ LQIRUPDWLRQ 2Q WKLV
EDVLVLQDJURXSIURPWKH&KLQHVH$FDGHP\RI6FLHQFHV
SURSRVHG&%(57UHSODFLQJELGLUHFWLRQDO/0ZLWK%(57DQG
ILQHWXQH %(57>@ )LQHWXQH EDVHG RQ %(57 ZDV XVHG WR
LQWHJUDWH VHJPHQW HPEHGGLQJ LQWR ODEHO HPEHGGLQJ %DVHG RQ
*37WKH,%0XVHGWKHWDJJLQJLQIRUPDWLRQDQGWKHRULJLQDO
WH[W DV WUDLQLQJ GDWD IRU ILQHWXQH>@ ,Q DGGLWLRQ WKH\ XVH D
RI3/0VVXFKDV%(57KHXULVWLFDOO\PDVNVYRFDEXODU\DQG
SHUIRUPV SUHGLFWLYH UHSODFHPHQW 7KH WH[W JHQHUDWHG LQ WKLV
ZD\ WDNHV LQWR DFFRXQW WKH FRQWH[W DQG PDNHV WKH VHPDQWLFV
PRUH FRKHUHQW +RZHYHU WKHUH DUH VRPH ULVNV 7KH QHZO\
JHQHUDWHGWH[WPD\FKDQJHWKHVHPDQWLFVRIWKHRULJLQDOWH[WRU
WKHFDWHJRU\ODEHORIWKHRULJLQDOWH[W
7KH PHWKRG EDVHG RQ UHSODFHPHQW RI UDQGRP ZRUG LV
UDQGRP ZKHQ VHOHFWLQJ WKH UHSODFHG ZRUGV ,I WKH UDQGRPO\
VHOHFWHG ZRUGV FRQWDLQ LPSRUWDQW ZRUGV LW PD\ FKDQJH WKH
RULJLQDOVHPDQWLFVDQGDIIHFWWKHTXDOLW\RIWKHWH[W7KHUHIRUH
ZRUGVZLWKORZ7),')VFRUHVFDQEHUHSODFHGZKLFKZDVILUVW
SURSRVHG E\ 8'$ RI *RRJOH>@ 7KH NH\ LGHD RI WKH
WHFKQRORJ\ LV WR UHSODFH D FHUWDLQ SURSRUWLRQ RI XQLPSRUWDQW
ZRUGVLQWKHWH[WGDWDZLWKXQLPSRUWDQWZRUGVLQWKHGLFWLRQDU\
VRDVWRSURGXFHDQHZWH[W,QLQIRUPDWLRQUHWULHYDO7),')LV
XVXDOO\ XVHG WR PHDVXUH WKH LPSRUWDQFH RI D ZRUG WR D WH[W
V PDQXIDFWXULQJ LQGXVWU\ LV LQ WKH WUDQVLWLRQ VWDJH
6HOHFWLQJ ORZ 7),') VFRUHV WR UHSODFH FDQ HIIHFWLYHO\ DYRLG
UHSODFLQJRUGHOHWLQJVRPHNH\ZRUGVLQWKHWH[W
7$%/(, $1(;$03/(2)6<121<05(3/$&(0(175$1'20,16(57,21
5$1'20(;&+$1*($1'5$1'20'(/(7,21
7\SHRI 3URFHVVHGWH[W 6SHFLILFRSHUDWLRQ
RSHUDWLRQ
6\QRQ\P 7H[WGDWDDXJPHQWDWLRQLVD 5HSODFH³NH\´
5HSODFH LPSRUWDQWWHFKQRORJ\ ZLWK´LPSRUWDQW
5DQGRP,QVHUW 7H[WGDWDHQKDQFHPHQW ,QVHUW³HQKDQFHPHQW´
DXJPHQWDWLRQLVDNH\
WHFKQRORJ\
5DQGRP6ZDS 7H[WDXJPHQWDWLRQGDWDLVD ([FKDQJH
NH\WHFKQRORJ\ ³DXJPHQWDWLRQ´ZLWK
³GDWD´
5DQGRPGHOHWH 7H[WGDWDDXJPHQWDWLRQLVD 'HOHWH³GDWD´
WHFKQRORJ\
C. Conditional data augmentation
&RQGLWLRQDO GDWD DXJPHQWDWLRQ LV WR IRUFH WKH LQWURGXFWLRQ
RI WH[W ODEHO LQIRUPDWLRQ LQWR WKH PRGHO DQG WKHQ JHQHUDWH
V VHFUHWV PRVW FRPSDQLHV DUH QRW ZLOOLQJ WR SURYLGH
GDWD7KHPDLQSXUSRVHRIWKLVSDSHULVWRVROYHWKHSUREOHPRI
V SURGXFWLRQ GDWD 7KHUHIRUH WKH ODFN RI
LQWURGXFLQJ QRLVH E\ FKDQJLQJ WKH WH[W ODEHO LQ WKH SURFHVV RI
WH[W DXJPHQWDWLRQ 7KHUH DUH WZR NLQGV RI LPSOHPHQWDWLRQ RI
FRQGLWLRQDO GDWD DXJPHQWDWLRQ PRGHO GHHS JHQHUDWLYH PRGHO
DQG SUHWUDLQHG PRGHOV ,Q WKH &9$( PRGHO WKH FRQGLWLRQDO
FRGLQJ LV LQWURGXFHG>@ +RZHYHU IRU WKH JHQHUDWLRQ PRGHO
KLJKTXDOLW\PRGHOQHHGVDORWRIKLJKTXDOLW\WH[W7KHUHDVRQ
193
Authorized licensed use limited to: ULAKBIM UASL - Uluslararasi Kibris Universitesi. Downloaded on May 19,2021 at 22:51:23 UTC from IEEE Xplore. Restrictions apply.
GLVFULPLQDWRU WR ILOWHU DQG UHGXFH WKH QRLVH RI WKH JHQHUDWHG
GDWD
,9 7+($33/,&$7,2162)7(;7'$7$$8*0(17$7,21
A. The application of industry
'DWDLVWKHEDVLVRIWKHPRGHOEXWLW LVQRWHDV\WRFROOHFW
GDWD LQLQGXVWU\ $W SUHVHQWPRUHWKDQ  RIWKHPDFKLQHU\
DQGHTXLSPHQW DUH QRWFRQQHFWHGWRWKH,QWHUQHWRQO\  RI
WKH HTXLSPHQW DUH FRQQHFWHG WR WKH ,QWHUQHW +RZHYHU WKHVH
GHYLFHVIROORZGLIIHUHQWFRPPXQLFDWLRQSURWRFROVDQGWKHUHLV
D VHULRXV ODQJXDJH EDUULHU ZKLFK KDV EHFRPH D ERWWOHQHFN
UHVWULFWLQJ WKH GHYHORSPHQW RI LQGXVWULDO ,QWHUQHW 2Q WKH RQH
KDQG  RI WKH HTXLSPHQW LV QRW FRQQHFWHG WR WKH ,QWHUQHW
DQGWKHOHYHORIHTXLSPHQWGLJLWL]DWLRQLVORZ7KHRYHUDOOOHYHO
RI &KLQD
IURPWRZLWKPDQ\ROGHTXLSPHQWDQGORZGLJLWDOOHYHO
,Q  WKH GLJLWL]DWLRQ UDWH RI SURGXFWLRQ HTXLSPHQW RI
,QGXVWULDO (QWHUSULVHV DERYH GHVLJQDWHG VL]H ZDV  7KH
QHWZRUNLQJ UDWH RI GLJLWDO HTXLSPHQW ZDV  ,W ZDV
QHFHVVDU\WRLQVWDOOVHQVRUVWRUHDOL]HHTXLSPHQWQHWZRUNLQJ,W
LVGLIILFXOWWRFROOHFWGDWDZLWKKLJKFRVWDQGORZHIILFLHQF\2Q
WKHRWKHUKDQGRIWKHGHYLFHVDUHFRQQHFWHGWRWKH,QWHUQHW
EXWWKHFRPPXQLFDWLRQSURWRFROVDUHQRWXQLILHG,QWKHSDVW
\HDUV DOO NLQGV RI DXWRPDWLRQ PDQXIDFWXUHUV UHVHDUFK
LQVWLWXWLRQVDQGVWDQGDUGL]DWLRQRUJDQL]DWLRQVDURXQGWKHZRUOG
KDYH ODXQFKHG KXQGUHGV RI )LHOGEXV SURWRFROV LQGXVWULDO
(WKHUQHWSURWRFROVDQGZLUHOHVVSURWRFROVDURXQGWKHHTXLSPHQW
QHWZRUNLQJ 7KH SURWRFRO VWDQGDUGV DUH QXPHURXV DQG
UHODWLYHO\ FORVHG DQG WKH LQWHUFRQQHFWLRQ RI LQGXVWULDO
HTXLSPHQW LV GLIILFXOW ZKLFK VHULRXVO\ UHVWULFWV WKH HTXLSPHQW
WR FORXG ,W LV XUJHQW WR EXLOG D WHFKQLFDO SURGXFW V\VWHP WKDW
FDQ EH FRPSDWLEOH ZLWK DQG FRQYHUW PXOWLSOH SURWRFROV ,Q
DGGLWLRQ WR WKH REMHFWLYH FRQGLWLRQV LQGXVWULDO ,QWHUQHW GDWD
LQYROYHV WKH GHWDLOV RI LQGXVWULDO SURGXFWLRQ UHODWHG WR WKH
FRPSDQ\
WKHLU RZQ FRPSDQ\
GDWDLVYHU\VHULRXVLQLQGXVWULDO,QWHUQHW,IDVPDOODPRXQWRI
FROOHFWHGGDWDFDQEHH[SDQGHGE\XVLQJGDWDDXJPHQWDWLRQWKH
QHHG RI PRGHO WUDLQLQJ FDQ EH VDWLVILHG :KHQ FROOHFWLQJ GDWD
PDQXDOO\LWFDQDOVRUHGXFHWKHQXPEHURIGDWDDFTXLVLWLRQDQG
VDYHDORWRIPDQSRZHUDQGPDWHULDOUHVRXUFHV
 B. The application of communication
,Q UHFHQW \HDUV WKH ,QWHUQHW KDV DFKLHYHG D ZLGH UDQJH RI
FRYHUDJH DQG FRPPXQLFDWLRQ KDV EHHQ WKH PDLQ ZD\ RI
LQIRUPDWLRQ WUDQVPLVVLRQ 7KH FRPELQDWLRQ RI PRGHUQ
FRPPXQLFDWLRQ WHFKQRORJ\ DQG DUWLILFLDO LQWHOOLJHQFH KDV
FKDQJHG WKH WUDGLWLRQDO LQIRUPDWLRQ WUDQVPLVVLRQ LQWR WKH
PRGHUQ WHOHFRPPXQLFDWLRQ EDVHG LQIRUPDWLRQ WUDQVPLVVLRQ
PRGH DQG UHDOL]HG LQVWDQW FRPPXQLFDWLRQ +RZHYHU WKH
DSSOLFDWLRQ RI DUWLILFLDO LQWHOOLJHQFH QHHGV D ODUJH QXPEHU RI
ODEHOHG GDWD WKH ODFN RI GDWD LV RIWHQ HQFRXQWHUHG LQ WKH
FRPPXQLFDWLRQ:LWKWKHFRQWLQXRXVLQQRYDWLRQRIVFLHQFHDQG
WHFKQRORJ\WKHUHILQHGPDQDJHPHQWRIFXVWRPHUVHUYLFHLQWKH
FRPPXQLFDWLRQ LQGXVWU\ LV DOVR FRQVWDQWO\ DSSO\LQJ DUWLILFLDO
LQWHOOLJHQFH WHFKQRORJ\ WR FUHDWH LQWHOOLJHQW FXVWRPHU VHUYLFH
:KHQZHEXLOGLQWHOOLJHQWFXVWRPHUVHUYLFHLQFRPPXQLFDWLRQ
XVLQJWKHFROOHFWHGGDWDFDQQRWFRYHUWKHZKROHVLWXDWLRQGXH
WR WKH GLYHUVLW\ RI KXPDQ FRPPXQLFDWLRQ PHWKRGV DQG WKH
FRPSOH[LW\RIWKHVLWXDWLRQ,QDGGLWLRQWKHGHPDQGIRUYDULRXV
W\SHV RI FXVWRPHU VHUYLFH YDULHV JUHDWO\ )RU H[DPSOH WKH
QXPEHU RI FRQVXOWDWLRQ RQ WDULII LV ODUJH DQG WKH GHPDQG IRU
&5%7 VHUYLFHV LV VPDOO 8VLQJ WH[W GDWD DXJPHQWDWLRQ FDQ
V
LPSURYHWKHDPRXQWRIGDWDLPSURYHWKHTXDOLW\RIWKHPRGHO
DQGHQKDQFHWKHUREXVWQHVVRIWKHPRGHO,QRUGHUWRVROYHWKH
SUREOHPRIXQEDODQFHGVDPSOHVLQLQWHQWLRQFODVVLILFDWLRQWDVN
ZHFDQH[SDQGWKHVDPSOHVL]HWREDODQFHWKHDPRXQWRIGDWD
7KHDSSOLFDWLRQRIDUWLILFLDOLQWHOOLJHQFHRIFXVWRPHUVHUYLFHLQ
FRPPXQLFDWLRQ FDQ LQWHOOLJHQWO\ SURYLGH PRUH HIILFLHQW DQG
SURIHVVLRQDO VHUYLFHV IRU FXVWRPHUV 7KURXJK WKH SURIHVVLRQDO
FXVWRPHU LQIRUPDWLRQ PDQDJHPHQW V\VWHP WKH VHUYLFH VSHHG
DQG TXDOLW\ RI FXVWRPHU VHUYLFH FDQ EH IXUWKHU LPSURYHG DQG
WKH ZRUN OHYHO RI FXVWRPHU VHUYLFH LQ FRPPXQLFDWLRQ FDQ EH
SURPRWHG 7KH LQWHOOLJHQW PHDQV RI KXPDQFRPSXWHU
LQWHUDFWLRQ FDQ SURYLGH FXVWRPHUV ZLWK FRQYHQLHQW DQG TXLFN
EXVLQHVVFRQVXOWDWLRQEXVLQHVVPDQDJHPHQWDQGRWKHURQHVWRS
FRPSUHKHQVLYH VHUYLFHV ,Q DGGLWLRQ WR LQWHOOLJHQW FXVWRPHU
VHUYLFH DQRWKHU DSSOLFDWLRQ RI WH[W GDWD DXJPHQWDWLRQ LQ
FRPPXQLFDWLRQ LV VHFXULW\ SURWHFWLRQ 1HWZRUN VHFXULW\ KDV
DWWUDFWHG SHRSOH
V DWWHQWLRQ :KHQ XVHUV XVH QHWZRUN VHUYLFHV 'HHS/HDUQLQJWRWKH5HVFXH>-@
WKH\ZLOOORVHLPSRUWDQWXVHULQIRUPDWLRQZLWKQHWZRUNWUDIILF
V6R$QQR\LQJ$/H[LFDODQG)UDPH6HPDQWLF
ZKLFK ZLOO EULQJ KLGGHQ GDQJHUV WR QHWZRUN XVHUV +RZHYHU
WKH DPRXQW RI IDXOW GDWD LV JHQHUDOO\ IDU OHVV WKDQ WKH QRUPDO
GDWD DQG ZH QHHG PRUH IDXOW GDWD IRU IDXOW UHSRUWLQJ RU IDXOW
SUHGLFWLRQVRZHFDQH[SDQGWKHGDWDDFFRUGLQJWRWKHH[LVWLQJ
GDWD
C. The application of finance
7KH WDVN RI GDWD DQDO\VLV LQ ILQDQFH XVXDOO\ IDFHV WZR
DFKLHYH UHODWLYHO\ DFFXUDWH GDWD DQQRWDWLRQ DQG PHHW WKH
EXVLQHVV QHHGV 7KLV IXUWKHU LQFUHDVHV WKH FRVW RI GDWD
DQQRWDWLRQ :KHWKHU LQ RUGHU WR LPSURYH WKH DFFXUDF\ DQG
UREXVWQHVV RI WKH PRGHO RU WR XVH WKH GDWD DV HIIHFWLYHO\ DV
SRVVLEOHLQDVPDOOVDPSOHVFHQDULRWH[WGDWDHQKDQFHPHQWKDV
D JUHDW DSSOLFDWLRQ SURVSHFW LQ WKH ILQDQFH )RU H[DPSOH WKH
FODVVLILFDWLRQ WDVN RI ILQDQFLDO SXEOLF RSLQLRQ FODVVLILHV WKH
VKRUW WH[WV RI ILQDQFLDO SXEOLF RSLQLRQV LQWR  LQGXVWU\
FDWHJRULHVLQFOXGLQJFDWHULQJDQGWRXULVPFRPPHUFHDQGUHWDLO
FRDO WH[WLOH DQG FORWKLQJ DJULFXOWXUH IRUHVWU\ DQLPDO
KXVEDQGU\ DQG ILVKHU\ FRQVWUXFWLRQ SHWUROHXP DQG
SHWURFKHPLFDO KRXVHKROG DSSOLDQFHV FRPPXQLFDWLRQV DQG
FRPSXWHUV 2Q WKH RQH KDQG WKHUH DUH IHZ HIIHFWLYH GDWD WKDW
FDQEHFROOHFWHGDQGDQQRWDWHGRQWKHRWKHUKDQGWKHDPRXQW
RIGDWDRI HDFK FDWHJRU\ LVYHU\XQEDODQFHG%DFNWUDQVODWLRQ
('$DQG7),')EDVHGZRUGUHSODFHPHQWFDQHQODUJHWKHGDWD
YROXPHDQGLPSURYHWKHPRGHOHIIHFW
9 &21&/86,21
,Q UHFHQW \HDUV DUWLILFLDO LQWHOOLJHQFH WHFKQRORJ\ KDV EHHQ
DSSOLHG LQ YDULRXV ILHOGV WR SURYLGH FRQYHQLHQFH IRU SHRSOH
OLIH+RZHYHULQSUDFWLFDODSSOLFDWLRQVWKHSUREOHPRIODFNRI
GDWDLVEHFRPLQJPRUHDQGPRUHVHULRXVDQGWKHSUREOHPVRI
OHVV GDWD FROOHFWLRQ DQG KLJK FRVW RI PDQXDO DQQRWDWLRQ DUH
RIWHQ HQFRXQWHUHG ,Q QDWXUDO ODQJXDJH SURFHVVLQJ WH[W GDWD
HQKDQFHPHQW FDQ JUHDWO\ H[SDQG WKH DPRXQW RI GDWD DQG
LPSURYH WKH HIIHFW RI H[LVWLQJ PRGHOV :KHWKHU LW LV D ODUJH
QXPEHU RI VDPSOHV RU D VPDOO QXPEHU RI VDPSOHV WH[W GDWD
HQKDQFHPHQW WHFKQRORJ\ FDQ LPSURYH WKH DFFXUDF\ DQG
UREXVWQHVV RI WKH PRGHO RQ WKH H[LVWLQJ EDVLV 7KLV FDQ
IDFLOLWDWHWKHDSSOLFDWLRQRIQDWXUDOODQJXDJHSURFHVVLQJLQPRUH
VFHQHV DQG VROYH WKH SUREOHPV HQFRXQWHUHG LQ PRUH DFWXDO
VFHQHV
5()(5(1&(6
>@ $QDE\7DYRU $  &DUPHOL %  *ROGEUDLFK (  HW DO 1RW (QRXJK 'DWD"
>@ <DQJ:<:'7KDW
(PEHGGLQJ %DVHG 'DWD $XJPHQWDWLRQ $SSURDFK WR $XWRPDWLF
&DWHJRUL]DWLRQ RI $QQR\LQJ %HKDYLRUV XVLQJ SHWSHHYH 7ZHHWV>&@
3URFHHGLQJV RI WKH  &RQIHUHQFH RQ (PSLULFDO 0HWKRGV LQ 1DWXUDO
/DQJXDJH3URFHVVLQJ
>@ %HUWKHORW '  &DUOLQL 1  *RRGIHOORZ ,  HW DO 0L[0DWFK $ +ROLVWLF
$SSURDFKWR6HPL6XSHUYLVHG/HDUQLQJ>-@
>@ ;LH 4  'DL =  +RY\ (  HW DO 8QVXSHUYLVHG 'DWD $XJPHQWDWLRQ IRU
&RQVLVWHQF\7UDLQLQJ>-@
>@ &KDZOD 1 9  %RZ\HU . :  +DOO / 2  HW DO 6027( 6\QWKHWLF
0LQRULW\2YHUVDPSOLQJ7HFKQLTXH>-@-RXUQDORI$UWLILFLDO,QWHOOLJHQFH
SUREOHPV 2QH LV WKDW D ODUJH QXPEHU RI WLPHO\ DQG HIIHFWLYH
LQIRUPDWLRQ LV GLVWULEXWHG LQ XQVWUXFWXUHG WH[W GDWD VXFK DV
UHVHDUFK SDSHUV QHZV LQIRUPDWLRQ WZLWWHU DQG RWKHU VRFLDO
PHGLD 1/3 DQG RWKHU WHFKQRORJLHV DUH QHHGHG WR HIILFLHQWO\
DQG DFFXUDWHO\ PLQH VWUXFWXUHG LQIRUPDWLRQ 6HFRQGO\ PDQ\
DSSOLFDWLRQV UHODWHG WR VSHFLILF WDVNV LQ WKH ILQDQFH RIWHQ IDFH
WKH GLOHPPD RI IHZ VDPSOHV %HFDXVH RI WKH VPDOO DPRXQW RI
GDWDWKDWFDQEHFROOHFWHGLWWDNHVDORWRIWLPHWRFROOHFWGDWD
,QDGGLWLRQWKHFRVWRIPDQXDOGDWDDQQRWDWLRQLVKLJK1/3LVD
FRJQLWLYHWHFKQRORJ\DQGWKHGLIILFXOW\DQGXQFHUWDLQW\RIGDWD
DQQRWDWLRQ DUH KLJKHU WKDQ WKDW RI LPDJH UHFRJQLWLRQ )RU WKH
SUREOHPV LQ WKH ILQDQFH LW DOVR QHHGV WKH SDUWLFLSDWLRQ RI
EXVLQHVV SHUVRQQHO DQG HYHQ ILQDQFLDO DQDO\VWV LQ RUGHU WR
194
Authorized licensed use limited to: ULAKBIM UASL - Uluslararasi Kibris Universitesi. Downloaded on May 19,2021 at 22:51:23 UTC from IEEE Xplore. Restrictions apply.
5HVHDUFK
>@ ,QRXH +  'DWD $XJPHQWDWLRQ E\ 3DLULQJ 6DPSOHV IRU ,PDJHV
&ODVVLILFDWLRQ>-@
>@ =KDQJ+&LVVH0'DXSKLQ<1HWDOPL[XS%H\RQG(PSLULFDO5LVN
0LQLPL]DWLRQ>-@
>@ *RRGIHOORZ , -  3RXJHW$EDGLH -  0LU]D 0  HW DO *HQHUDWLYH
$GYHUVDULDO 1HWZRUNV>-@ $GYDQFHV LQ 1HXUDO ,QIRUPDWLRQ 3URFHVVLQJ
6\VWHPV
>@ &XEXN ( '  =RSK %  0DQH '  HW DO $XWR$XJPHQW /HDUQLQJ
$XJPHQWDWLRQ3ROLFLHVIURP'DWD>-@
>@ 6HQQULFK 5  +DGGRZ %  %LUFK $  ,PSURYLQJ 1HXUDO 0DFKLQH
7UDQVODWLRQ0RGHOVZLWK0RQROLQJXDO'DWD>-@&RPSXWHUHQFH
>@ (GXQRY 6  2WW 0  $XOL 0  HW DO 8QGHUVWDQGLQJ %DFN7UDQVODWLRQ DW
6FDOH>-@
 >@ <X $ :  'RKDQ '  /XRQJ 0 7  HW DO 4$1HW &RPELQLQJ /RFDO
&RQYROXWLRQZLWK*OREDO6HOI$WWHQWLRQIRU5HDGLQJ&RPSUHKHQVLRQ>-@

>@ ;LH 4  'DL =  +RY\ (  HW DO 8QVXSHUYLVHG 'DWD $XJPHQWDWLRQ IRU
&RQVLVWHQF\7UDLQLQJ>-@
>@ :HL - :  =RX .  ('$ (DV\ 'DWD $XJPHQWDWLRQ 7HFKQLTXHV IRU
%RRVWLQJ3HUIRUPDQFHRQ7H[W&ODVVLILFDWLRQ7DVNV>-@
>@ =KDQJ; =KDR- /HFXQ< &KDUDFWHUOHYHO&RQYROXWLRQDO1HWZRUNV
IRU7H[W&ODVVLILFDWLRQ>-@
>@ -LDR;<LQ<6KDQJ/HWDO7LQ\%(57'LVWLOOLQJ%(57IRU1DWXUDO
/DQJXDJH8QGHUVWDQGLQJ>-@

195
Authorized licensed use limited to: ULAKBIM UASL - Uluslararasi Kibris Universitesi. Downloaded on May 19,2021 at 22:51:23 UTC from IEEE Xplore. Restrictions apply.
>@ 0DODQGUDNLV1 6KHQ0*R\DO$HWDO&RQWUROOHG7H[W*HQHUDWLRQ
IRU'DWD$XJPHQWDWLRQLQ,QWHOOLJHQW$UWLILFLDO$JHQWV>-@
>@ .RED\DVKL6&RQWH[WXDO$XJPHQWDWLRQ'DWD$XJPHQWDWLRQE\:RUGV
ZLWK3DUDGLJPDWLF5HODWLRQV>-@
>@ :X ;  /Y 6  =DQJ /  HW DO &RQGLWLRQDO %(57 &RQWH[WXDO
$XJPHQWDWLRQ>0@ &RPSXWDWLRQDO 6FLHQFH ± ,&&6  WK
,QWHUQDWLRQDO&RQIHUHQFH)DUR3RUWXJDO-XQH±3URFHHGLQJV
3DUW,9
>@ $QDE\7DYRU$&DUPHOL%*ROGEUDLFK(HWDO'R1RW+DYH(QRXJK
'DWD"'HHS/HDUQLQJWRWKH5HVFXH>-@