2020 International Conference on Wireless Communications and Smart Grid (ICWCSG)
7KHDQDO\VLVRISURGXFWHYDOXDWLRQDQGVDOHV
FKDUDFWHULVWLFPRGHOEDVHGRQGDWDPLQLQJ
;LQJ/LX
6FKRRORI%XVLQHVV
6LFKXDQ1RUPDO8QLYHUVLW\
&KHQJGX&KLQD
&RUUHVSRQGLQJDXWKRUOLX[LQJVLFQX#FRP
-LD\DQJ=KDQJ
6FKRRORI%XVLQHVV
6LFKXDQ1RUPDO8QLYHUVLW\
&KHQJGX&KLQD
MHUU\B]KDQJ#FRP
;LDRKXL/L
6FKRRORI%XVLQHVV
6LFKXDQ1RUPDO8QLYHUVLW\
&KHQJGX&KLQD
[LDRKXLOL#FRP

Abstract²6LQFH D ORW RI RQOLQH HYDOXDWLRQ LQIRUPDWLRQ LV
DFFXPXODWHG ZLWK WKH DSSOLFDWLRQ DQG GHYHORSPHQW RI H
FRPPHUFHLQGXVWU\VHQWLPHQWDQDO\VLVWHFKQRORJ\FDQEHXVHGWR
PLQH DQG XWLOL]H LW HIIHFWLYHO\ VR DV WR SURYLGH UHIHUHQFH IRU H
FRPPHUFH LQGXVWU\ PDQDJHPHQW )LUVW D VHQWLPHQW VHPDQWLF
FODVVLILFDWLRQ GLFWLRQDU\ ZDV FRQVWUXFWHG EDVHG RQ WKH IUDPH
VHPDQWLFVWKHRU\7KHQEDVHGRQWKHGLFWLRQDU\DQGVRPHUXOHV
WKH VHQWLPHQW RI RQOLQH UHYLHZV ZDV DQDO\]HG )LQDOO\ WKURXJK
WKH WHVW RI RQOLQH UHYLHZ GDWD D KLJKHU DFFXUDF\ UDWH DQG UHFDOO
UDWHZHUHREWDLQHGZKLFKSURYHGWKHYDOLGLW\DQGHIIHFWLYHQHVVRI
WKHUHVHDUFKPHWKRG
Keywords-frame semantics; sentiment analysis; online reviews
, ,1752'8&7,21
 RQOLQH VKRSSLQJ VHUYLFH H[SHULHQFH .DQJ HW DO >@
:LWK WKHGHYHORSPHQW RI WKH LQWHUQHW WKH HFRPPHUFHKDV
GHYHORSHGUDSLGO\2QOLQHVKRSSLQJDFFRXQWVIRUDQLQFUHDVLQJ
SURSRUWLRQ RI PDUNHW FRQVXPSWLRQ 0RUH DQG PRUH FXVWRPHUV
DUH ZLOOLQJ WR VKDUH WKHLU RSLQLRQV RU H[SHULHQFHV RQ SURGXFWV
RQWKHLQWHUQHWWKXVIRUPLQJDZHDOWKRIUHYLHZVRQWKHXVHRI
 RSLQLRQV DERXW D SURGXFW DQG
RQOLQH VKRSSLQJ SURGXFWV )RU PDVVLYH SURGXFW UHYLHZV WR
REWDLQYDOXDEOHLQIRUPDWLRQ$JUHDWGHDORIUHVHDUFKDWWHQWLRQ
KDVEHHQGHYRWHGWRRQOLQHVKRSSLQJUHYLHZV>@WKHIROORZLQJ
HPHUJHGVHQWLPHQWDQDO\VLVWHFKQRORJ\VKRZVDEHWWHUVXSSRUW
WR WKLV SRLQW >@ =KDR HW DO DSSOLHG DSSUDLVDO H[SUHVVLRQV WR
VHQWHQFH VHQWLPHQW FODVVLILFDWLRQ LQFOXGLQJ VHPDQWLF IHDWXUHV
V\QWDFWLF IHDWXUHV OH[LFDO IHDWXUHV DQG SRODULW\ IHDWXUHV ZHUH
GHVLJQHGWRFODVVLI\VHQWLPHQWVHQWHQFHVDVSRVLWLYHRUQHJDWLYH
>@ :LWK WKH DQDO\VLV RI WH[W UHYLHZV FXVWRPHUV
 VHQWLPHQW PDQDJHU PDNH GHFLVLRQV SDUWLFXODUO\ DV WKH\ FRQYH\ WKH UHDO
SRODULW\ WRZDUGV WKH SURGXFWV DUH REWDLQHG 7KDW LV SRVLWLYH
-LQIHQJ/LX
6FKRRORI%XVLQHVV
6LFKXDQ1RUPDO8QLYHUVLW\
&KHQJGX&KLQD
OMM#LFORXGFRP
<X'HQJ
6FKRRORI&RPSXWHU6FLHQFH
6LFKXDQ1RUPDO8QLYHUVLW\
&KHQJGX&KLQD
GHQJ\XILJKW#FRP







GHFLVLRQV EXW DOVR KHOSV PDQDJHUV XQGHUVWDQG FRQVXPHUV¶
QHHGV VR DV WR LPSURYH SURGXFWV VHUYLFH >@ 7KHUHIRUH EDVHG
RQ WKH IUDPHZRUN VHPDQWLF WKHRU\ WKLV SDSHU FRQVWUXFWV D
VSHFLDOVHPDQWLFFODVVLILFDWLRQGLFWLRQDU\LQWKHILHOGRIRQOLQH
VKRSSLQJ UHYLHZV WDJJLQJ WKH EDVLF VHQWLPHQW LQIRUPDWLRQ RI
UHYLHZVHQWHQFHVZLWKWKHPHWKRGRIGLFWLRQDU\DQGUXOHVWKHQ
WR UHDOL]H WKH VHPDQWLF XQGHUVWDQGLQJ RI WKH VHQWLPHQW
LQIRUPDWLRQRIRQOLQHVKRSSLQJUHYLHZV
,, /,7(5$785(5(9,(:
:LWK WKH UDSLG GHYHORSPHQW RI WKH LQWHUQHW HFRPPHUFH
LQGXVWU\LVGHYHORSLQJUDSLGO\WKHGHPDQGIRURQOLQHVKRSSLQJ
LV LQFUHDVLQJ 6RPH VFKRODUV KDYH VWXGLHG KRZ WR RSWLPL]H
FXVWRPHUV
VXJJHVWHGDIUDPHZRUNIRUPHDVXULQJ FXVWRPHU VDWLVIDFWLRQLQ
PRELOH VHUYLFHV ZLWK HPSOR\LQJ VHQWLPHQW DQDO\VLV WR H[WUDFW
LQIRUPDWLRQRQFXVWRPHUVDWLVIDFWLRQ3XMDULHWDO>@GHVLJQHG
DQHZIUDPHZRUNFRPSULVLQJRIWKHLQEXLOWSDFNDJHVRIS\WKRQ
ZKLFK PLQHV PDQ\ FXVWRPHUV
JURXSVWKHPDFFRUGLQJO\EDVHGRQWKHLUVHQWLPHQWVZKLFKDLGV
WKHSRWHQWLDOEX\HUVWRIRUPDFDSLWDOL]HGYLHZRQWKHSURGXFW
<XVVXSRYD HW DO >@ GHVFULEHG WKH DSSOLFDWLRQ RI D QRYHO
GRPDLQLQGHSHQGHQW GHFLVLRQ VXSSRUW DSSURDFK IRU FXVWRPHU
VDWLVIDFWLRQ UHVHDUFK WKURXJK GHHS DQDO\VLV RI FRQVXPHU
UHYLHZV SRVWHG RQ WKH LQWHUQHW LQ QDWXUDO ODQJXDJH &XVWRPHU
UHYLHZV DUH UHFRJQL]HG DV IUXLWIXO LQIRUPDWLRQ VRXUFHV IRU
PRQLWRULQJDQGHQKDQFLQJFXVWRPHUVDWLVIDFWLRQOHYHOVDQGKHOS
YRLFHV RI DFWXDO FXVWRPHUV H[SUHVVLQJ UHODWLYHO\ XQDPELJXRXV
VDWLVILHG RU QHJDWLYH GLVVDWLVILHG 6HQWLPHQW DQDO\VLV QRW RSLQLRQV
RQO\ SURYLGHV VXSSRUW IRU FRQVXPHUV WR PDNH SXUFKDVH

978-1-7281-9820-0/20/$31.00 ©2020 IEEE 151

DOI 10.1109/ICWCSG50807.2020.00040

Authorized licensed use limited to: CALIFORNIA INSTITUTE OF TECHNOLOGY. Downloaded on September 26,2020 at 13:40:23 UTC from IEEE Xplore. Restrictions apply.
 $ JURZLQJ QXPEHU RI UHFHQW VWXGLHV KDYH IRFXVHG RQ WKH
HFRQRPLFYDOXHVRIUHYLHZVH[SORULQJWKHUHODWLRQVKLSEHWZHHQ
WKH VDOHV SHUIRUPDQFH RI SURGXFWV DQG WKHLU UHYLHZV >@ DQG
VHYHUDOVHQWLPHQWVDQDO\VLV,WKDVEHHQIRXQGWKDWLQWKHHDUO\
UHVHDUFKWKHUHDUHVHYHUDOJHQHUDODQGRSHQ(QJOLVKVHQWLPHQW
GLFWLRQDU\ UHVRXUFHV DSSURDFKHV KDYH SURSRVHG H[WUDFWLRQ RI
WKHVHQWLPHQWLQIRUPDWLRQIURPFXVWRPHUUHYLHZV.DQJHWDO>@
GHYHORSHG D QHZ IUDPHZRUN IRU PHDVXUHPHQW RI FXVWRPHU
VDWLVIDFWLRQ IRU PRELOH VHUYLFHV E\ FRPELQLQJ 9,.25
DSSURDFKDQGVHQWLPHQWDQDO\VLV7KHIRUHJRLQJOLWHUDWXUHVKDYH
FRQGXFWHG RQ D PHDQLQJIXO H[SORUDWLRQ RQ VHQWLPHQW DQDO\VLV
RI RQOLQH UHYLHZV 7KLV SDSHU FRQVWUXFWV D VHQWLPHQW VHPDQWLF
FODVVLILFDWLRQ GLFWLRQDU\ EDVHG RQ WKH IUDPH VHPDQWLFV WKHRU\
EDVHGRQWKHGLFWLRQDU\DQGVRPHUXOHVWKHVHQWLPHQWRIRQOLQH
UHYLHZVZDVDQDO\]HG
,,, 5(6($5&+'(6,*1
7KHUHVHDUFKUHJDUGLQJRQOLQHUHYLHZVLQFOXGHVWKUHHSDUWV
WH[W H[WUDFWLRQ SUHSURFHVVLQJ RI UHYLHZ WH[W DQG VHQWLPHQW
VHPDQWLF WDJJLQJ 7H[W H[WUDFWLRQ LQFOXGHV EDVLF LPSOHPHQW
SULQFLSOH RI ZHE FUDZOHU DQG LPSOHPHQWDWLRQ RI RQOLQH
VKRSSLQJ UHYLHZV GDWD FUDZOLQJ LQ 3\WKRQ SUHSURFHVVLQJ RI
UHYLHZ WH[W LQFOXGHV ZRUG VHJPHQWDWLRQ DQG SDUWRIVSHHFK
WDJJLQJ6HQWLPHQWVHPDQWLFWDJJLQJRIRQOLQHUHYLHZVFRQWDLQV
HVWDEOLVKPHQW RI VHQWLPHQW GLFWLRQDU\ IUDPH DQG VHQWLPHQW
WKHPHWDJJLQJDQGWKHFDOFXODWLRQRIVHQWLPHQWWHQGHQF\YDOXH
7KHUHVHDUFKPRGHOLVSUHVHQWHGLQ)LJXUH
6HQWLPHQWVHPDQWLFWDJJLQJ
2QOLQH
UHYLHZV
7H[WH[WUDULRQ (VWDEOLVKPHQWRI
VHQWLPHQWGLFWLRQDU\
%DVLFLPSOHPHQWSULQFLSOHRIZHE
FUDZOHU
)UDPHDQGVHQWLPHQW
WKHPHWDJJLQJ
,PSOHPHQWDWLRQRIRQOLQHVKRSSLQJ
UHYLHZVGDWDFUDZOLQJLQ3\WKRQ
7KHFDOFXODWLRQRI
VHQWLPHQWWHQGHQF\YDOXH
3UHSURFHVVLQJRI
YLHZWH[W
:RUGVHJPHQWDWLRQ
2QOLQHUHYLHZV
3DUWRIVSHHFKWDJJLQJ
VHQWLPHQWLQIRUPDWLRQ
 RIWHQ LUUHJXODU 7KHUHIRUH ZRUG VHJPHQWDWLRQ DQG SDUW RI
)LJXUH6HQWLPHQWDQDO\VLVRIRQOLQHUHYLHZVEDVHGRQIUDPHVHPDQWLFV
,9 7(;7(;75$&7,21
A. Basic implement principle of web crawler
&UDZOHU WHFKQRORJ\ DV DQ LPSRUWDQW WHFKQLFDO PHDQV WR
REWDLQQHWZRUNGDWDFDQEHZLGHO\XVHGLQVHDUFKHQJLQHVGDWD
DQDO\VLV DQG RWKHU ILHOGV DQG FDQ DOVR EH XVHG WR FROOHFW
YDOXDEOH GDWD *HQHUDO ZHE FUDZOHU EDVLF LPSOHPHQWDWLRQ
SULQFLSOHLVDVIROORZV
6WHSDFFRUGLQJWRWKHRULJLQDO85/WRFUDZOWKHSDJHWR
JHW WKH GDWD VWRUHG LQ WKH GDWD ILOH RU GDWDEDVH DQG JHW D QHZ
85/
6WHS SXW WKH QHZ 85/ LQWR WKH TXHXH DFFRUGLQJ WR WKH
QHZ85/WRFUDZOZHESDJHVDQGVWRUDJHGDWDDQGUHSHDWWKH
DERYH FUDZOLQJ SURFHVV :KHQ PHHWLQJ WKH VWRS FRQGLWLRQ RI
WKHFUDZOHUVWRSFUDZOLQJWRJHWGDWD
:HE FUDZOHUV DUH PRVWO\ LPSOHPHQWHG LQ -DYD 3\WKRQ
& DQG RWKHU SURJUDPPLQJ ODQJXDJHV ,Q RUGHU WR VDYH WLPH
DQG LPSURYH WKH TXDOLW\ RI WKH SURJUDP VRPH FUDZOHU IUDPHV
DUH XVHG WR GHYHORS FUDZOHU SURJUDPV LQ SUDFWLFDO SURMHFWV
&XUUHQWO\LQWKHILHOGRIPDFKLQHOHDUQLQJ3\WKRQLVSUHIHUUHG
DVWKHSURJUDPPLQJODQJXDJHZKLFKKDVDYHU\SRZHUIXOWKLUG
SDUW\SURJUDPOLEUDU\DQGSURYLGHVDKLJKTXDOLW\RSHQVRXUFH
FUDZOHUIUDPHZRUN
B. Implementation of online shopping reviews data crawling
in Python
$V IRU PDFKLQH OHDUQLQJ WKH FUDZOLQJ RI RQOLQH VKRSSLQJ
UHYLHZ GDWD LV UHDOL]HG YLD 3\WKRQ 7KH VSHFLILF VWHSV DUH
VKRZHGDVIROORZV
6WHS SUHSDUH WKH ³5HTXHVWV´ OLEUDU\ DQG ³8VHU $JHQW´
OLEUDU\ 7KH ³5HTXHVWV´ OLEUDU\ LV XVHG WR LPSOHPHQW WKH
FUDZOHU IXQFWLRQ 7KH ³8VHU $JHQW´ OLEUDU\ LV XVHG WR PDNH
UHTXHVWV WR WKH VHUYHU RI WKH WDUJHW SDJH YLD WKH EURZVHU
GLVJXLVHGDVDQRUPDOXVHU
6WHS GHWHUPLQH WKH WDUJHW SDJH DQG DQDO\]H LWV VWUXFWXUH
7KLV SDUW RI LQIRUPDWLRQ LV WKH GDWD WR EH FUDZOHG E\ WKH ZHE
FUDZOHUZKLFKFRQWDLQVRQOLQHVKRSSLQJUHYLHZGDWD
6WHS FUDZO WKH WDUJHW SDJH DQG VDYH LW DV D ORFDO ILOH LQ
3\WKRQ7KH³5HTXHVWV´OLEUDU\LVXVHGWRUHTXHVWWKHFRQWHQWRI
WKH UHTXLUHG SDJH WKH ³%HDXWLIXO6RXS´ OLEUDU\ LV XVHG IRU
+70/ SDUVLQJ DQG WKH ³UH´ OLEUDU\ SURYLGHV UHJXODU
H[SUHVVLRQIXQFWLRQV
9 35(352&(66,1*2)5(9,(:7(;7
7H[WSUHSURFHVVLQJLVDNH\VWHSLQGDWDSURFHVVLQJZKLFK
LVWRJLYHDEHWWHUHIIHFWWRWKHDOJRULWKP'XHWRWKHIUHHGRPRI
RQOLQH UHYLHZV DQG FROORTXLDO H[SUHVVLRQ VRPH UHGXQGDQW
LQIRUPDWLRQ LV LQYROYHG 'LUHFWO\ H[WUDFWHG RQOLQH UHYLHZV DUH
VSHHFKWDJJLQJVKRXOGEHFDUULHGRXWEHIRUHVHPDQWLFWDJJLQJ
A. Word segmentation
7KHZRUGLVWKHEDVLFFRQVWLWXHQWXQLWRI(QJOLVKVHQWHQFH
7KHVSDFHLVXVHGDVWKHVHSDUDWRUEHWZHHQ(QJOLVKZRUGVDQG
WKH SXQFWXDWLRQ LV XVHG DV WKH SDUWLWLRQ EHWZHHQ (QJOLVK
VHQWHQFHV 7KHUHIRUH IRU JHQHUDO (QJOLVK SDUDJUDSKV
SXQFWXDWLRQ FDQ EH XVHG IRU VHQWHQFH VHJPHQWDWLRQ DQG ZKLWH
VSDFH IRU ZRUG VHJPHQWDWLRQ ZKLOH IRU FRPSOH[ WH[W ZLWK
VSHFLDO H[SUHVVLRQV WKH QDWXUDO ODQJXDJH SURFHVVLQJ SODWIRUP
1/7. EDVHG RQ 3\WKRQ FDQ EH XVHG IRU ZRUG VHJPHQWDWLRQ
6WHSREWDLQWKHLQLWLDO85/GRFXPHQW WRRO
6WHS˖XVH WRNHQL]H ZRUG VHJPHQWDWLRQ SDFNDJH WR ZRUG
VHJPHQWDWLRQ˗

152

Authorized licensed use limited to: CALIFORNIA INSTITUTE OF TECHNOLOGY. Downloaded on September 26,2020 at 13:40:23 UTC from IEEE Xplore. Restrictions apply.
 6WHS˖UHPRYHSXQFWXDWLRQDQGVWRSZRUGV$IWHUDVLPSOH  *, 7KH *HQHUDO ,QTXLUHU >@ ZKLFK JLYHV YHU\
ZRUGVHJPHQWDWLRQSURFHVVWKHUHDUHVWLOOPHDQLQJOHVVDUWLFOHV FRPSUHKHQVLYHLQIRUPDWLRQDERXWHDFKHQWU\
SUHSRVLWLRQV DGYHUEV DQG FRQMXQFWLRQV WKDW KDYH QR LQIOXHQFH 034$6XEMHFWLYLW\&XHV/H[LFRQ>@ZKLFKFRQWDLQV
RQ WKH VHQWHQFH PHDQLQJ RI WKH ZKROH VHQWHQFH VXFK DV ³D´  QHJDWLYH VHQWLPHQW ZRUGV DQG  SRVLWLYH VHQWLPHQW
³WKH´³RU´³DQG´HWFZKLFKQHHGWREHILOWHUHGE\WKH(QJOLVK ZRUGV
VWRSZRUGGLFWLRQDU\SURYLGHGE\1/7.
6WHS ˖ ZRUG VWHP SURFHVVLQJ :RUG VWHP H[WUDFWLRQ LV
UHDOL]HG E\ UHPRYLQJ WKH URRW DQG DIIL[ RI WKH ZRUG DQG
REWDLQLQJWKHZRUGSURWRW\SH6XFKDVZHDULQJDQGZRUHVRFN
DQGVRFN$OWKRXJKWKHVHZRUGVDUHGLIIHUHQWLQIRUPWKH\DOO
FRUUHVSRQG WR WKH VDPH URRW 7KH\ VKRXOG EH WKH VDPH ZRUGV
 %LQJ /LX 2SLQLRQ /H[LFRQ >@ ZKLFK FRQWDLQV 
QHJDWLYH VHQWLPHQW ZRUGV DQG  SRVLWLYH VHQWLPHQW ZRUGV
%XW WKH GLFWLRQDU\ FRQWDLQV PDQ\ VSHOOLQJ PLVWDNHV 6XFK DV
PXOWLSOH OHWWHUV PLVVLQJ OHWWHUV VODQJ DQG JUDPPDWLFDO
LQIOHFWLRQV
VRLWLVQHFHVVDU\WRH[WUDFWWKHVWHP³VWHP´SDFNDJHLQ1/7. /,:&/LQJXLVWLF,QTXLU\DQG:RUG&RXQW>@ZKLFK
SURYLGHV /DQFDVWHU 6WHPPHU 3RUWHU DQG RWKHU PRGXOHV IRU GHVFULEHVWKHODZRIVHQWLPHQWZRUGVLQGLIIHUHQWW\SHV
ZRUGVWHPSURFHVVLQJ
B. Part-of-speech tagging
'XHWRDWWULEXWHH[WUDFWLRQRIVHQWLPHQWZRUGVLQYROYHVWKH
QRXQDGMHFWLYHVYHUEVDQGDGYHUEVDQGVRRQZKLFKQHHGVWR
WDJWKHSDUWRIVSHHFK7KHSDUWRIVSHHFKWDJJLQJFDQEHFDUULHG
RXW ZLWK ³WDJ´ SDFNDJH LQ 1/7. WKH WDJ SDFNDJH SURYLGHV
VRPH FODVV DQG SDUW RI VSHHFK WDJJLQJ LQWHUIDFHV DQG GHILQHV
VHYHUDOSDUWRIVSHHFKWDJJHUV)RUWKHJLYHQZRUGVWKHWDJJHU
ORRNVIRUWKHPRVWSDUWRIVSHHFKFRUUHVSRQGLQJWRHDFKZRUGLQ
WKHWUDLQLQJGDWDVHWDQGPDUNVLW)RUWKHZRUGVWKDWDUHQRWLQ
WKH WUDLQLQJ GDWDVHW WKHLU SDUWV RI VSHHFK ZLOO EH PDUNHG DV
QRQH7KLVSDSHUHPSOR\VWKH3RVWDJIXQFWLRQWRWDJSDUWRI
VSHHFK LQ VSHFLILHG ZRUG OLVW ZLWK WKH SDUW RI VSHHFK WDJJHU
UHFRPPHQGHGE\1/7.7KHUHVXOWLVDOLVWRIZRUGVDQGWXSOHV
IRUPHGE\WKHFRUUHVSRQGLQJSDUWRIVSHHFKDVHOHPHQWV
W ILW ZHOO ,Q WKH HDUO\ VWXGLHV DGMHFWLYHV
7KH VHQWLPHQW DQDO\VLV RI SURGXFWV LV WKH VHQWLPHQW
H[SUHVVLRQ DQG DWWULEXWH RI FRQVXPHUV WR WKH SURGXFWV 7KLV
SDSHUVFRUHVWKHVHQWLPHQWH[SUHVVLRQRIFRQVXPHUVZKLFKDUH
SRVLWLYH DQG QHJDWLYH 1HJDWLYH LV WKH H[SUHVVLRQ RI UHODWLYH
GLVVDWLVIDFWLRQSRVLWLYHLVWKHH[SUHVVLRQRIUHODWLYHVDWLVIDFWLRQ
$W SUHVHQW WKH PHWKRGV RI VHQWLPHQW DQDO\VLV DUH PDLQO\
GLYLGHG LQWR WZR W\SHV VHQWLPHQW GLFWLRQDU\ DQG PDFKLQH
OHDUQLQJ7KHPHWKRGEDVHGRQPDFKLQHOHDUQLQJLVHTXLYDOHQW
WR D FODVVLILFDWLRQ SUREOHP ZKLFK UHTXLUHV D ORW RI PDQXDO
WDJJLQJLQWKHWUDLQLQJWH[WFRQVXPHVDORWRIWLPHDQGHIIRUW
DQG WKH WUDLQLQJ UHVXOWV DUH DSSOLHG LQ D VSHFLDOL]HG ILHOG
ZLWKRXW XQLYHUVDOLW\ 7KHUHIRUH WKLV SDSHU FKRRVHV WKH
VHQWLPHQW DQDO\VLV PHWKRG EDVHG RQ WKH VHQWLPHQW GLFWLRQDU\
7KHQH[WVWHSLVWRFRQVWUXFWWKHVHQWLPHQWGLFWLRQDU\
9, 6(17,0(176(0$17,&7$**,1*
 6HQ :RUG1HW >@ ZKLFK FODVVLILHV :RUG1HW HQWULHV
LQWR DIIHFWLYH W\SHV DQG PDUNV WKH ZHLJKW RI HDFK HQWU\
DFFRUGLQJWRWKHSRVLWLYHDQGQHJDWLYHW\SHV
$VWKHDERYHGLFWLRQDULHVDUHDOOJHQHUDO(QJOLVKVHQWLPHQW
GLFWLRQDULHV ZKLFK FRQWDLQ PDQ\ JHQHUDO (QJOLVK VHQWLPHQW
ZRUGV+RZHYHULWLVIRXQGWKDWWKHVHVHQWLPHQWZRUGVDUHWRR
FRPPRQ WR VDWLVI\ WKH VHQWLPHQW DQDO\VLV LQ D SDUWLFXODU ILHOG
0RUHRYHU WKHVH GLFWLRQDULHV RU VHQWLPHQW ZRUGV PD\ EH
PLVFODVVLILHG VR LW LV QRW HIIHFWLYH WR XVH WKHVH VHQWLPHQW
GLFWLRQDULHVDORQH7KHUHIRUHWKLVSDSHUFODVVLILHVWKHZRUGVLQ
WKH DERYH VHQWLPHQW GLFWLRQDULHV FXW RXW WKH UHSHDWHG ZRUGV
WKHQDQRYHOVHQWLPHQWGLFWLRQDU\LVREWDLQHG,QDGGLWLRQWKLV
SDSHU DGGV WKHVH VSHFLDO UHYLHZV LQ HDFK VSHFLILF ILHOG WR EH
VWXGLHGWRWKHVHQWLPHQWDOGLFWLRQDU\)RUH[DPSOHIRUFORWKLQJ
7KH FORWKHV DUH WRR WLJKW WR EH ZRUQ LV DGGHG 7KH FORWKHV
DUH YHU\ ELJ , GRQ
ZHUHXVXDOO\XVHGDVVHQWLPHQWZRUGV/DWHULWZDVIRXQGWKDW
QRW RQO\ DGMHFWLYHV EXW PDQ\ QRXQV DQG YHUEV FRXOG H[SUHVV
VHQWLPHQWV DQG MXGJH WKH VHQWLPHQWDO WHQGHQF\ ,I LW RQO\
FRQVLGHUV DGMHFWLYHV DV VHQWLPHQW ZRUGV WKH DFFXUDF\ RI
VHQWLPHQWDQDO\VLVZLOOEHPXFKORZHU$VDUHVXOWQRXQVDQG
YHUEV VKRXOG DOVR EHLQJ FRQVLGHUHG LQ WKH VHQWLPHQWDO
GLFWLRQDU\0RUHRYHUFRQYHQWLRQDOGLFWLRQDULHVRIVHQWLPHQWGR
QRWLQFOXGHYHUEDORULQWHUQHWODQJXDJH)RUH[DPSOH<DKRR
2K ER\ :KRRSHH :KDW QHUYH 2K GHU %RRERR
HWFZHUHDGGHGWRWKHGLFWLRQDU\RISUDLVHVLQDPDQXDOZD\
B. Frame and sentiment theme tagging
7KHRQOLQHUHYLHZVHQWLPHQWDQDO\VLVLQFOXGHVGHWHUPLQLQJ
WKHIUDPHRIWKHVHQWLPHQWZRUGVLGHQWLI\LQJWKHVXEMHFWRIWKH
VHQWLPHQWZRUGVDQGFDOFXODWLQJWKHVHQWLPHQWWHQGHQF\YDOXHV
ZKLFKLVIRUPDOO\GHILQHGDVIROORZV

A. Establishment of sentiment dictionary
6HQWLPHQW GLFWLRQDU\ LV D GLFWLRQDU\ ZKLFK MXGJHV WKH
SRODULW\ RI VHQWLPHQW EDVHG RQ VHPDQWLFV 7KH TXDOLW\ RI
VHQWLPHQWGLFWLRQDU\DWWDFKHVDJUHDWLQIOXHQFHRQWKHDFFXUDF\
RI VHQWLPHQW DQDO\VLV %DVHG RQ VHYHUDO FRPPRQ (QJOLVK
VHQWLPHQWGLFWLRQDULHVWKHVHQWLPHQWGLFWLRQDU\LQWKLVSDSHULV
FRQVWUXFWHG E\ DGGLQJ VHQWLPHQW ZRUGV DQG QHWZRUN
H[SUHVVLRQVLQWKLVILHOG7KHUHOHYDQWGLFWLRQDULHVDQGOLWHUDWXUH
KDYHSURYLGHGDQH[FHOOHQWUHIHUHQFHLQ,WKDVEHHQIRXQGWKDW
LQWKHHDUO\UHVHDUFKWKHUHDUHVHYHUDOJHQHUDODQGRSHQ(QJOLVK
VHQWLPHQWGLFWLRQDU\UHVRXUFHV
153
Authorized licensed use limited to: CALIFORNIA INSTITUTE OF TECHNOLOGY. Downloaded on September 26,2020 at 13:40:23 UTC from IEEE Xplore. Restrictions apply.
Fi  Ei  vi   ˄˅
+HUHLQ Fi GHQRWHV WKH IUDPH RI WKH VHQWLPHQW ZRUGV
Ei UHSUHVHQWVWKHVHQWLPHQW WKHPHDQG vi HTXDOV WKH VHQWLPHQW
WHQGHQF\ YDOXHV 7KH IUDPH Fi LQ WKH VHQWLPHQW VHPDQWLF
VWUXFWXUH FDQ EH GHWHUPLQHG E\ SRVLWLRQLQJ WKH YHUEV DQG
DGMHFWLYHV LQ WKH VHQWHQFH DQG PDWFKLQJ WKH IUDPH VHPDQWLF
GLFWLRQDU\ 7KH VHQWLPHQW WKHPH Ei LQ WKH VHQWLPHQW VHPDQWLF
VWUXFWXUHLVRQHRIWKHFRUHIUDPHZRUNHOHPHQWVLQWKHVHPDQWLF
UROH WKDW LV WKH REMHFWV HYDOXDWHG RU WKH HYDOXDWHG VXEMHFW
ZKRVH V\QWDFWLF IHDWXUHV DUH VWURQJO\ FRUUHVSRQGLQJ WR WKH
GHSHQGHQWV\QWDFWLF VWUXFWXUH7KHUHIRUH WKH PHWKRGEDVHG RQ
 GHSHQGHQWV\QWDFWLFVWUXFWXUHLVHPSOR\HG7KHPDWFKLQJUXOHV VHQWLPHQW DQDO\VLV LQWR WKH RQOLQH VKRSSLQJ UHYLHZV RI H
RIIUDPHDQGVHPDQWLFWKHPHDUHDVIROORZV FRPPHUFHLQGXVWU\
LU frame > SBV † ATT  head theme @> ADVd GHJ ree @>Vnegative @  ˄˅
+HUHLQ LU GHQRWHVWKHVHQWLPHQWZRUGRIWKHUHYLHZWH[W
DQG LWV FRUUHVSRQGLQJ IUDPH LV GHWHUPLQHG DFFRUGLQJ WR WKH
IUDPHVHPDQWLFGLFWLRQDU\'XHWRWKHFKDUDFWHULVWLFVRIRQOLQH
UHYLHZV VXFK DV VKRUW VHQWHQFHV VXEMHFW HOOLSVLV DQG HYHQ
VLQJOHZRUGVHQWHQFHVLQDGGLWLRQWRWKHHPRWLRQDOZRUG LU 
LV D QHFHVVDU\ VXEMHFW ZKLOH RWKHU VXEMHFWV DQG PRGLILHUV DUH
RSWLRQDO ZKLFK VKRXOG EH H[SUHVVHG DV>@ DFFRUGLQJ WR WKH
UHVXOWRIGHSHQGHQF\SDUVLQJ
%DVHG RQ WKH UHVXOW RI GHSHQGHQF\ V\QWD[ DQDO\VLV LI WKH
W PDNH VHQVH WR RWKHU
+RZHYHU IRU VHQWLPHQW FODVVLILFDWLRQ WKLV SDSHU DVVXPHV
WKDW HLWKHU SRVLWLYH RU QHJDWLYH ZKLFK LJQRUHV WKH QHXWUDO
IHDWXUH YLHZ 7KDW LV ODFNLQJ WKH REMHFWLYH GHVFULSWLRQ RI WKH
SURGXFW 7KH FODVVLILFDWLRQ RI QHXWUDO VHQWLPHQW SRODULW\ QHHGV
WREHIXUWKHUVWXGLHG5HYLHZOHQJWKFDQLQFUHDVHWKHFRJQLWLYH
QDWXUH RI WKH LQIRUPDWLRQ HVSHFLDOO\ LI LW LV DYDLODEOH DW QR
DGGLWLRQDOVHDUFKFRVW7KHUHIRUHLWLVSRVVLEOHWRPHDVXUHWKH
DPRXQW RI XVHIXO LQIRUPDWLRQ FRQWDLQHG LQ D UHYLHZ E\
FRPELQLQJ WKH OHQJWK RI WKH UHYLHZ +RZHYHU WKHUH PD\ EH
VRPHOHQJWK\UHYLHZVWKDWGHVFULEHLQIRUPDWLRQXQUHODWHGWRWKH
SURGXFW RU WKH EXVLQHVV ZKLFK GRQ
VHQWLPHQW ZRUG GRPLQDWHV D VXEMHFW FRPSRQHQW 6%9 WKH FRQVXPHUV,QWKHFRQWH[WRIWKLVIXWXUHUHVHDUFKFDQIRFXVRQ
FRPSRQHQW LV WDJJHG DV WKH IUDPH HOHPHQW RI WKH FODVV RI WKH DSSOLFDWLRQ RI WH[W PLQLQJ WR PHDVXUH WKH XVHIXO
VHQWLPHQWWKHPH,IWKHVHQWLPHQWZRUGLVLQWKHDWWULEXWHKHDG LQIRUPDWLRQ FRQWDLQHG LQ WKHUHYLHZ FRQWHQW VR DV WR LPSURYH
$77KHDGSRVLWLRQLQWKHELDVHGVWUXFWXUHLWLVWDJJHGDVWKH WKH UHOLDELOLW\ DQG HIIHFWLYHQHVV RI WKH UHYLHZ VHQWLPHQW
VHQWLPHQWWKHPH7KHV\PEROLQGLFDWHVWKDWWKHUHLVDORJLFDO DQDO\VLV
H[FOXVLYHRU UHODWLRQVKLS EHWZHHQ WZR FDVHV 7KDW LV HLWKHU
6%9LVWUXHRU$77KHDGLVWUXHEXWQHLWKHUFDQEHWUXHDWWKH 5()(5(1&(6
VDPH WLPH ,I DGYHUE RI GHJUHH $'9G DSSHDUV LQ WKH >@ =KDQJ / /LX %  6HQWLPHQW $QDO\VLV DQG 2SLQLRQ 0LQLQJ ,Q
GHSHQGHQF\ JUDPPDU VWUXFWXUH LW LV WDJJHG DV GHJUHH RI 6DPPXW & :HEE *, HGV (QF\FORSHGLD RI 0DFKLQH /HDUQLQJ DQG
IUDPHHOHPHQWGHJUHH,IWKHUHLVDQDGYHUELDO$'9QZLWK
QHJDWLYHWLPHVDQGLWLVWDJJHGDVQHJDWLYH´ERWKZLOOEHXVHG
DVWKHMXGJPHQWEDVLVIRUWKHYDOXHRIVHQWLPHQWWHQGHQF\
'DWD0LQLQJ6SULQJHU%RVWRQ0$
>@ 1LVVLP 0 DQG 9 3DWWL 6HPDQWLF $VSHFWV LQ 6HQWLPHQW $QDO\VLV
6HQWLPHQW$QDO\VLVLQ6RFLDO1HWZRUNV
>@ .DUOJUHQ - 6DKOJUHQ 0 2OVVRQ ) (VSLQR]D ) +DPIRUV 2
8VHIXOQHVV RI VHQWLPHQW DQDO\VLV ,Q WK (XURSHDQ &RQIHUHQFH RQ
C. The calculation of sentiment tendency value ,QIRUPDWLRQ5HWULHYDO
%DVHGRQWKHVHQWLPHQWWHQGHQF\YDOXHRIWKHZRUGVLQWKH >@ =KDR < 4LQ % &KH : HW DO $SSUDLVDO ([SUHVVLRQ 5HFRJQLWLRQ ZLWK
IUDPHVHPDQWLFGLFWLRQDU\WKHILQDODVVLJQPHQWLVREWDLQHGE\ 6\QWDFWLF 3DWK IRU 6HQWHQFH 6HQWLPHQW &ODVVLILFDWLRQ>-@ ,QWHUQDWLRQDO
DGMXVWLQJWKHGHJUHHDQGQHJDWLYHPRGLILFDWLRQLQIRUPDWLRQ -RXUQDORI&RPSXWHU3URFHVVLQJRI/DQJXDJHV
LQWKHIUDPHHOHPHQWWDJJLQJUHVXOWV >@ .DQJ'3DUN<5HYLHZEDVHGPHDVXUHPHQWRIFXVWRPHUVDWLVIDFWLRQ
LQ PRELOH VHUYLFH 6HQWLPHQW DQDO\VLV DQG 9,.25 DSSURDFK>-@ ([SHUW
7KHQIRUWKHZRUGVZLWKWKHVHQWLPHQWYDOXHRIWKDWLV 6\VWHPVZLWK$SSOLFDWLRQSW
WKH FHQWUDO ZRUG WKH VHQWLPHQW WHQGHQF\ YDOXHV RI ZRUGVDUH
GHWHUPLQHGDFFRUGLQJWRWKHVXEMHFWLQIRUPDWLRQ)RUH[DPSOH
WKH FHQWUDO ZRUG KLJK ZDV  LQ WKH UHYLHZ VHQWHQFH KLJK
FRVWZKLOHLWZDVLQWKHKLJKWHFKQRORJ\)RUWKHZRUGV
ZKRVHVHQWLPHQWWHQGHQF\YDOXHLVQRWHTXDOWRLIWKHUHLV
DQ DGYHUE RI GHJUHH LW VKRXOG EH DGMXVWHG DFFRUGLQJ WR WKH
DGYHUE DGMXVWPHQW DPRXQW LI WKHUH LV D QHJDWLYH PRGLILFDWLRQ
LQWKHUHYLHZVHQWHQFHWKHGHJUHHYDOXHVKRXOGEHDVVLJQHGDV
WKHRULJLQDOYDOXH
>@ 3XMDUL&KHWDQD$LVZDU\D6KHWW\1LVKD3&RPSDULVRQRIFODVVLILFDWLRQ
WHFKQLTXHVIRU )HDWXUH 2ULHQWHG6HQWLPHQW$QDO\VLV RI 3URGXFW 5HYLHZ
'DWD>-@
>@ </LX;<X;+XDQJDQG$$Q%ORJ'DWD0LQLQJ7KH3UHGLFWLYH
3RZHU RI 6HQWLPHQWV 'DWD 0LQLQJ IRU %XVLQHVV $SSOLFDWLRQV SS 
6SULQJHU
>@ <XVVXSRYD 1  %R\NR 0  %RJGDQRYD '  HW DO $ 'HFLVLRQ 6XSSRUW
$SSURDFKEDVHGRQ6HQWLPHQW$QDO\VLV&RPELQHGZLWK'DWD0LQLQJIRU
&XVWRPHU6DWLVIDFWLRQ5HVHDUFK>-@
>@ .DQJ'3DUN<5HYLHZEDVHGPHDVXUHPHQWRIFXVWRPHUVDWLVIDFWLRQ
LQ PRELOH VHUYLFH 6HQWLPHQW DQDO\VLV DQG 9,.25 DSSURDFK>-@ ([SHUW
6\VWHPVZLWK$SSOLFDWLRQV±
9,,&21&/86,216$1')8785(:25.6
>@ 3KLOLS - 6WRQH *HQHUDO ,QTXLUHU &RPSXWHU $SSURDFK WR &RQWHQW
7KLV SDSHU VWXGLHV WKH VHQWLPHQW DQDO\VLV RI RQOLQH
VKRSSLQJUHYLHZVEDVHGRQIUDPHVHPDQWLFVZKLFKUHILQHVWKH
H[SUHVVLRQ RI VHQWLPHQW LQIRUPDWLRQ LQWR VHQWHQFHV DQG
SURYLGHV DQ HIIHFWLYH FODVVLILFDWLRQ V\VWHP RI VHQWLPHQW
VHPDQWLFVDQGVHPDQWLFWDJJLQJWHFKQRORJ\2QWKHRQH KDQG
WKLV SDSHU HVWDEOLVKHV D IUDPHZRUN VHPDQWLF FODVVLILFDWLRQ
GLFWLRQDU\ LQ HFRPPHUFH LQGXVWU\ ZKLFK SURYLGHV SUDFWLFDO
DQG XVHIXO GLFWLRQDU\ NQRZOHGJH UHVRXUFHV IRU VHPDQWLF
DQDO\VLVRIRQOLQHVKRSSLQJUHYLHZV2QWKHRWKHUKDQGEDVHG
RQ WKH IUDPHZRUN VHPDQWLF FODVVLILFDWLRQ GLFWLRQDU\ DQG WKH
GHSHQGHQF\V\QWDFWLFUXOHVWKHIUDPHZRUNVHPDQWLFWDJJLQJRI
RQOLQH VKRSSLQJ UHYLHZV LV FDUULHG RXW 7KH UHVHDUFK RI WKLV
SDSHU LV D EHQHILFLDO H[SORUDWLRQ IRU WKH GHYHORSPHQW RI
>@ 
154
Authorized licensed use limited to: CALIFORNIA INSTITUTE OF TECHNOLOGY. Downloaded on September 26,2020 at 13:40:23 UTC from IEEE Xplore. Restrictions apply.
$QDO\VLV>-@LQIRUPDWLRQVWRUDJH UHWULHYDO
>@ :LOVRQ7:LHEH-+RIIPDQQ3HWDO5HFRJQL]LQJ&RQWH[WXDO3RODULW\
LQ 3KUDVH/HYHO 6HQWLPHQW $QDO\VLV>&@ HPSLULFDO PHWKRGV LQ QDWXUDO
ODQJXDJHSURFHVVLQJ
>@ +X 0  /LX %  0LQLQJ DQG VXPPDUL]LQJ FXVWRPHU UHYLHZV>&@
3URFHHGLQJV RI WKH 7HQWK $&0 6,*.'' ,QWHUQDWLRQDO &RQIHUHQFH RQ
.QRZOHGJH 'LVFRYHU\ DQG 'DWD 0LQLQJ 6HDWWOH :DVKLQJWRQ 86$
$XJXVW$&0
>@ -: 3HQQHEDNHU 5- %RRWK DQG 0( )UDQFLV /LQJXLVWLF ,QTXLU\ DQG
:RUG&RXQW/,:&RSHUDWRU¶VPDQXDO
>@ %DFFLDQHOOD6(VXOL$6HEDVWLDQL)6HQWL:RUG1HW$Q(QKDQFHG
/H[LFDO 5HVRXUFH IRU 6HQWLPHQW $QDO\VLV DQG 2SLQLRQ 0LQLQJ>&@
3URFHHGLQJVRIWKH,QWHUQDWLRQDO&RQIHUHQFHRQ/DQJXDJH5HVRXUFHVDQG
(YDOXDWLRQ/5(&0D\9DOOHWWD0DOWD'%/3