2016 International Conference on Intelligent Transportation, Big Data & Smart City

$XGLR FODVVLILFDWLRQ PHWKRG EDVHG RQ PDFKLQH OHDUQLQJ

)HQJ 5RQJ
/LDRQLQJ -LDQ]KX 9RFDWLRQDO &ROOHJH /LDR\DQJ/LDRQLQJ&KLQD
#TTFRP

$EVWUDFW²$XGLR FODVVLILFDWLRQ KDV YHU\ ODUJH WKHRUHWLFDO DQG
SUDFWLFDO YDOXHV LQ ERWK SDWWHUQ UHFRJQLWLRQ DQG DUWLILFLDO
LQWHOOLJHQFH ,Q WKLV SDSHU ZH SURSRVH D QRYHO DXGLR
FODVVLILFDWLRQ PHWKRG EDVHG RQ PDFKLQH OHDUQLQJ WHFKQLTXH
)LUVWO\ ZH LOOXVWUDWH WKH KLHUDUFKLFDO VWUXFWXUH RI DXGLR GDWD
>@>@>@ 7R VROYH WKLV WDVN WKH DXGLR FODVVLILFDWLRQ
VKRXOG EH WDFNOHG ZHOO
7KH UHVW RI WKH SDSHU LV RUJDQL]HG DV IROORZV :H
LQWURGXFH GHVFULSWLRQ RI DXGLR GDWD LQ 6HFWLRQ  ,Q
ZKLFK LV PDGH XS RI IRXU OD\HUV  $XGLR IUDPH  $XGLR FOLS 6HFWLRQ  ZH SURSRVH D QRYHO DXGLR FODVVLILFDWLRQ
 $XGLR VKRW DQG  $XGLR KLJK OHYHO VHPDQWLF XQLW 6HFRQGO\ DOJRULWKP EDVHG RQ 690 7R SURYH WKH HIIHFWLYHQHVV RI
WKUHH W\SHV RI DXGLR GDWD IHDWXUH DUH H[WUDFWHG WR FRQVWUXFW RXU SURSRVHG DOJRULWKP H[SHULPHQWDO UHVXOWV DUH
IHDWXUH YHFWRU LQFOXGLQJ  6KRUW WLPH HQHUJ\  =HUR FURVVLQJ FRQGXFWHG LQ VHFWLRQ  6HFWLRQ  FRQFOXGHV WKH ZKROH
UDWH DQG  0HO)UHTXHQF\ FHSVWUDO FRHIILFLHQWV 7KLUGO\ ZH SDSHU
GLVFXVV KRZ WR FODVVLI\ DXGLR GDWD XVLQJ WKH 690 FODVVLILHU
ZLWK *DXVVLDQ NHUQHO )LQDOO\ H[SHULPHQWDO UHVXOWV
GHPRQVWUDWH WKDW WKH SURSRVHG PHWKRG LV DEOH WR DFKLHYH ,, '(6&5,37,21 2) $8',2 '$7$
KLJKHU DXGLR FODVVLILFDWLRQ DFFXUDF\

.H\ZRUGV $XGLR FODVVLILFDWLRQ 0DFKLQH OHDUQLQJ 690 ,Q WKLV VHFWLRQ ZH DQDO\]H PDLQ IHDWXUHV RI DXGLR GDWD
$XGLR IUDPH $XGLR VKRW DQG WKH KLHUDUFKLFDO VWUXFWXUH RI DXGLR GDWD LV LOOXVWUDWHG LQ
)LJ 
, ,1752'8&7,21 $V LV VKRZQ LQ )LJ  GHILQLWLRQV RI DXGLR VWUXFWXUDO
XQLWV ZLWK GLIIHUHQW WLPH JUDQXODULW\ LV SURSRVHG DQG WKH
7KH GHYHORSPHQW RI PXOWLPHGLD WHFKQRORJ\ DQG KLHUDUFKLFDO VWUXFWXUH RI DXGLR GDWD FRQWDLQV  $XGLR KLJK
,QWHUQHW KDV EURXJKW KXJH PXOWLPHGLD LQIRUPDWLRQ WR WKH OHYHO VHPDQWLF XQLW  $XGLR VKRW  $XGLR FOLS DQG 
SHRSOH DQG IXUWKHU UHVXOWHG LQ WKH SURGXFWLRQ RI XOWUD ODUJH $XGLR IUDPH
VFDOH PXOWLPHGLD LQIRUPDWLRQ GDWDEDVH >@>@ ,W LV YHU\
GLIILFXOW WR PDNH WKH GHVFULSWLRQ DQG UHWULHYDO RI PXOWLPHGLD
LQIRUPDWLRQ ZKLFK QHHGV D NLQG RI HIIHFWLYH UHWULHYDO
PHWKRG IRU PXOWLPHGLD +RZ WR HIIHFWLYHO\ KHOS SHRSOH WR
TXLFNO\ DQG DFFXUDWHO\ ILQG WKH QHHGHG PXOWLPHGLD
 $XGLR IUDPH $XGLR LV D QRQVWDWLRQDU\ UDQGRP
SURFHVV DQG LWV FKDUDFWHULVWLFV FKDQJH ZLWK WLPH YDU\LQJ
+RZHYHU LWV FKDQJH LV YHU\ VORZ 7KHUHIRUH WKH DXGLR
VLJQDO FDQ EH GLYLGHG LQWR D QXPEHU RI VKRUW SHULRGV RI
SURFHVVLQJ 7KHVH VKRUW VHJPHQWV DUH JHQHUDOO\ PV
LQIRUPDWLRQ KDV EHFRPH WKH FRUH LVVXH LQ WKH PXOWLPHGLD FDOOHG DV WKH DXGLR IUDPH DQG DXGLR IUDPH LV WKH VPDOOHVW
LQIRUPDWLRQ UHWULHYDO >@ &RQWHQW EDVHG LQIRUPDWLRQ XQLWV LQ WKH DXGLR SURFHVVLQJ
UHWULHYDO LV SURSRVHG XQGHU VXFK D EDFNJURXQG LW LV D NLQG  $XGLR FOLS $V WKH DXGLR IUDPH WLPH JUDQXODULW\ LV
RI QHZ UHWULHYDO WHFKQRORJ\ >@ WRR VPDOO DQG LW LV GLIILFXOW WR H[WUDFW PHDQLQJIXO VHPDQWLF
$XGLR LQIRUPDWLRQ UHIHUV WR RQH RI WKH PRVW LPSRUWDQW FRQWHQWV ZH VKRXOG GHILQH D QHZ DXGLR XQLW ZLWK ODUJHU WLPH
VRXUFHV RI KXPDQ SHUFHSWLRQ ,W LV XUJHQW WR RUJDQL]H PDVV JUDQXODULW\ QDPHG DV $XGLR FOLS $XGLR FOLS LV PDGH XS RI
DXGLR ILOHV LQ WHUPV RI WKH VHPDQWLF GHVFULSWLRQ ZLWK WKH D QXPEHU RI IUDPHV RI ZKLFK WKH OHQJWK RI WLPH LV IL[HG
UDSLG LQFUHDVLQJ RI DXGLR DQG YLGHR ILOHV >@ 'XH WR WKH 7KH FKDUDFWHULVWLFV RI WKH DXGLR VHJPHQW DUH FDOFXODWHG RQ
FRPSOH[LW\ RI DXGLR UHWULHYDO LW LV PRUH GLIILFXOW WKDQ WKH WKH EDVLV RI DXGLR IUDPH
LPDJH DQG YLGHR UHWULHYDO $V WKH RULJLQDO DXGLR GDWD LV
PDGH XS RI QRQVHPDQWLF DQG QRQVWUXFWXUHG ELQDU\ VWUHDP
LW ODFNV RI VHPDQWLF GHVFULSWLRQ DQG VWUXFWXUHG RUJDQL]DWLRQ
>@>@ 0RUHRYHU WKH DXGLR GDWD KDV WKH FKDUDFWHULVWLFV RI
FRPSOH[ VWUXFWXUH PDVVLYH GDWD DQG KLJK UHTXLUHPHQW RI
GDWD SURFHVVLQJ >@>@ 7KHUHIRUH LW EULQJV JUHDW GLIILFXOWLHV
 $XGLR VKRW 7KLV FRQFHSW LV JHQHUDWHG IURP WKH
YLGHR IRRWDJH $V DXGLR VHJPHQW DUH WRR VKRUW LW LV QRW
VXLWDEOH WR EH XVHG IRU VHPDQWLF FRQWHQW DQDO\VLV $Q DXGLR
VWUXFWXUDO XQLW FRQWDLQLQJ WKH VDPH DXGLR FODVV LV GHILQHG DV
DQ DXGLR VKRW 7KH DXGLR VKRW LV FRPSRVHG RI VHYHUDO DXGLR
VHJPHQWV ZLWKLQ D VDPH FODVV
WR GHHSO\ SURFHVV DQG DQDO\]H DXGLR LQIRUPDWLRQ DQG WKH  $XGLR KLJK OHYHO VHPDQWLF XQLW ,W UHIHUV WR DQ DXGLR
DXGLR UHWULHYDO DQG FRQWHQW ILOWHULQJ DSSOLFDWLRQV DUH KDUG WR VWUXFWXUDO XQLW ZLWK ULFK VHPDQWLF FRQWHQWV ZKLFK DUH IRUPHG
GHVLJQ ,W LV RI JUHDW LPSRUWDQFH WR H[WUDFW VWUXFWXUHG E\ WKH GLIIHUHQW FRPELQDWLRQV RI WKH DXGLR VKRWV
LQIRUPDWLRQ DQG VHPDQWLF FRQWHQWV IURP DXGLR GDWD

978-1-5090-6061-0/17 $31.00 © 2017 IEEE 81

DOI 10.1109/ICITBS.2016.98
 )LJ  +LHUDUFKLFDO VWUXFWXUH RI DXGLR GDWD

 1 
,,, 7+( 352326(' $8',2 &/$66,),&$7,21 $/*25,7+0
=&5 ¦ VJQ  [ >Q @  VJQ  [ >Q  @
Q 


%$6(' 21 690 )HDWXUH  0HO)UHTXHQF\ FHSVWUDO FRHIILFLHQWV

GHQRWHG DV 0)&& LW LV GHILQHG EDVHG RQ GLVFUHWH FRVLQH
,Q WKLV VHFWLRQ ZH GLVFXVV KRZ WR FODVVLI\ DXGLR GDWD WUDQVIRUP DV IROORZV
E\ WKH 690 FODVVLILHU 7KH WDVN RI DXGLR GDWD FODVVLILFDWLRQ
LV LPSOHPHQWHG EDVHG RQ DXGLR GDWD IHDWXUH H[WUDFWLRQ ,Q  . § ·
RXU ZRUN WKH IROORZLQJ WKUHH W\SHV RI DXGLR IHDWXUHV DUH FQ ˜ ¦  ORJ 6 N  ˜ FRV ¨ ˜ Q N   S  ¸ 
XWLOL]HG . N ©. ¹
)HDWXUH  6KRUW WLPH HQHUJ\ GHQRWHG DV 67( LV D
> @
GLVFUHWH VLJQDO [ Q LV GHILQHG DV WKH VXP RI VTXDUHV RI WKH ZKHUH . GHQRWHV WKH QXPEHU RI EDQG SDVV ILOWHUV
VLJQDO VDPSOHV 1  $VVXPH WKDW WUDLQLQJ VDPSOHV DUH GHILQHG DV  [L  \L  
DQG L  ^  " O `  L  ^  " O `  [L  5 Q 
 1 
67( ˜ ¦ [  >Q @  \L  ^ˈ
` DUH VDWLVILHG 690 FODVVLILHU LV GHVLJQHG WR
1 Q
WDFNOH DQ RSWLPL]DWLRQ SUREOHP DV IROORZV
)HDWXUH  =HUR FURVVLQJ UDWH GHQRWHG DV =&5 )RU D
JLYHQ IUDPH =&5 LV GHILQHG DV WKH QXPEHU RI WLPHV WKH § O
·
DXGLR IURP SRVLWLYH WR QHJDWLYH LQ WKH JLYHQ IUDPH DV PLQ ¨ Z7 Z  & ¦ [L ¸ 
Z E  [ 
IROORZV © L  ¹
VW
\L  Z ]L  E  t   [L  [L t  L  ^ "  O`
7


82
ZKHUH [L LV PDSSHG E\ IXQFWLRQ M    DQG & UHIHUV WR D ,9 (;3(5,0(17
SHQDOW\ SDUDPHWHU
$IWHUZDUGV WKH DXGLR GDWD FODVVLILFDWLRQ SUREOHP FDQ EH ,Q WKLV VHFWLRQ ZH FKRRVH WZR VWDQGDUG DXGLR GDWDEDVHV
VROYHG DV IROORZV WR PDNH SHUIRUPDQFH HYDOXDWLRQ WKDW LV  ˅ *HQHUDO
6RXQGV *6 HJ DSSODXVH ELUGV FDUV HWF DQG  ˅
§ O
· $XGLR 6FHQHV $6 HJ SDUN EDU VWDWLRQ HWF
VJQ  Z7 I  [   E  VJQ ¨ ¦ DL \L .  [L  [   E ¸  3DUWLFXODUO\ WKH DXGLR VDPSOHV RI WKH DERYH WZR DXGLR
©L ¹ GDWDEDVHV DUH FROOHFWHG IURP YDULRXV RULJLQV WR JXDUDQWHH
GDWD YDULDELOLW\ )XUWKHUPRUH HDFK DXGLR GDWDEDVH
1H[W LQ RUGHU WR HQKDQFH SHUIRUPDQFH RI 690 DOJRULWKP FRQWDLQV QHDUO\  KRXUV RI DXGLR DQG HDFK FODVV LV PDGH
ZH XWLOL]H *DXVVLDQ NHUQHO LQ RXU SURSRVHG FODVVLILHU ZKLFK XS RI DXGLR VDPSOHV ZLWK WKH QXPEHU UDQJHG EHWZHHQ
LV GHILQHG DV IROORZV  DQG 

§  ·
.  [L  [  H[S ¨   [  [L ¸ 
© V ¹

)LJ  $XGLR FODVVLILFDWLRQ UHVXOW XVLQJ WKH *6 GDWDEDVH

)LJ  $XGLR FODVVLILFDWLRQ UHVXOW XVLQJ WKH $6 GDWDEDVH

&RPELQLQJ H[SHULPHQWDO UHVXOWV LQ )LJ  DQG )LJ 
WRJHWKHU LW FDQ EH REVHUYHG WKDW RXU SURSRVHG DXGLR
FODVVLILFDWLRQ FDQ DFKLHYH KLJKHU FODVVLILFDWLRQ DFFXUDF\
)XUWKHUPRUH WKH DYHUDJH FODVVLILFDWLRQ DFFXUDF\ RI WKH
9 &21&/86,21
7KLV SDSHU DLPV WR GHVLJQ DQ HIILFLHQW DXGLR
FODVVLILFDWLRQ DOJRULWKP EDVHG RQ VXSSRUW YHFWRU PDFKLQH
PHWKRG 7KH KLHUDUFKLFDO VWUXFWXUH RI DXGLR GDWD FRQWDLQV
GDWDEDVH *6 DQG $6 DUH  DQG  UHVSHFWLYHO\ IRXU OD\HUV  $XGLR IUDPH  $XGLR FOLS  $XGLR VKRW
DQG  $XGLR KLJK OHYHO VHPDQWLF XQLW 1H[W WKUHH W\SHV RI
DXGLR GDWD IHDWXUH DUH H[WUDFWHG WR HVWDEOLVK IHDWXUH YHFWRUV

83
$IWHUZDUGV ZH SURSRVH D QRYHO DXGLR FODVVLILFDWLRQ
DOJRULWKP EDVHG RQ 690 ZLWK *DXVVLDQ NHUQHO ,Q WKH
IXWXUH ZH ZLOO WU\ WR WHVW WKH SHUIRUPDQFH RI RXU DOJRULWKP
LQ RWKHU DXGLR GDWDEDVH

5()(5(1&(

>@ ; . <DQJ / +H ' 4X : 4 =KDQJ DQG 0 7 -RKQVRQ 6HPL

VXSHUYLVHG IHDWXUH VHOHFWLRQ IRU DXGLR FODVVLILFDWLRQ EDVHG RQ
FRQVWUDLQW FRPSHQVDWHG /DSODFLDQ VFRUH (XUDVLS -RXUQDO RQ $XGLR
6SHHFK DQG 0XVLF 3URFHVVLQJ  
>@ % . %DQL\D DQG - /HH ,PSRUWDQFH RI DXGLR IHDWXUH UHGXFWLRQ LQ
DXWRPDWLF PXVLF JHQUH FODVVLILFDWLRQ 0XOWLPHGLD 7RROV DQG
$SSOLFDWLRQV   
>@ 6 =DKLG ) +XVVDLQ 0 5DVKLG 0 + <RXVDI DQG + $ +DELE
2SWLPL]HG $XGLR &ODVVLILFDWLRQ DQG 6HJPHQWDWLRQ $OJRULWKP E\
8VLQJ (QVHPEOH 0HWKRGV 0DWKHPDWLFDO 3UREOHPV LQ (QJLQHHULQJ

>@ = 4 6KL - 4 +DQ DQG 7 5 =KHQJ 6RIW 0DUJLQ %DVHG /RZ5DQN
$XGLR 6LJQDO &ODVVLILFDWLRQ 1HXUDO 3URFHVVLQJ /HWWHUV  

>@ $ 5DNRWRPDPRQM\ DQG * *DVVR +LVWRJUDP RI *UDGLHQWV RI 7LPH
)UHTXHQF\ 5HSUHVHQWDWLRQV IRU $XGLR 6FHQH &ODVVLILFDWLRQ ,HHH$FP
7UDQVDFWLRQV RQ $XGLR 6SHHFK DQG /DQJXDJH 3URFHVVLQJ  

>@ 0 %HQDWDQ DQG . 1J &URVVFRYDULDQFHEDVHG IHDWXUHV IRU VSHHFK
FODVVLILFDWLRQ LQ ILOP DXGLR -RXUQDO RI 9LVXDO /DQJXDJHV DQG
&RPSXWLQJ  
>@ 6 )DJHUOXQG DQG 8 . /DLQH &ODVVLILFDWLRQ RI DXGLR HYHQWV XVLQJ
SHUPXWDWLRQ WUDQVIRUPDWLRQ $SSOLHG $FRXVWLFV  
>@ $ &KHQ DQG 0 $ +DVHJDZD-RKQVRQ 0L[HG 6WHUHR $XGLR
&ODVVLILFDWLRQ 8VLQJ D 6WHUHR,QSXW 0L[HGWR3DQQHG /HYHO )HDWXUH
,HHH$FP 7UDQVDFWLRQV RQ $XGLR 6SHHFK DQG /DQJXDJH 3URFHVVLQJ
  
>@ 6 =XEDLU ) <DQ DQG : : :DQJ 'LFWLRQDU\ OHDUQLQJ EDVHG VSDUVH
FRHIILFLHQWV IRU DXGLR FODVVLILFDWLRQ ZLWK PD[ DQG DYHUDJH SRROLQJ
'LJLWDO 6LJQDO 3URFHVVLQJ   
>@ / ;LQJ 4 0D DQG 0 =KX 7HQVRU VHPDQWLF PRGHO IRU DQ DXGLR
FODVVLILFDWLRQ V\VWHP 6FLHQFH &KLQD,QIRUPDWLRQ 6FLHQFHV 

>@ = 4 6KL - 4 +DQ DQG 7 5 =KHQJ $XGLR &ODVVLILFDWLRQ ZLWK
/RZ5DQN 0DWUL[ 5HSUHVHQWDWLRQ )HDWXUHV $FP 7UDQVDFWLRQV RQ
,QWHOOLJHQW 6\VWHPV DQG 7HFKQRORJ\  
>@ 0 $ +DTXH DQG - 0 .LP $Q DQDO\VLV RI FRQWHQWEDVHG
FODVVLILFDWLRQ RI DXGLR VLJQDOV XVLQJ D IX]]\ FPHDQV DOJRULWKP
0XOWLPHGLD 7RROV DQG $SSOLFDWLRQV   

84