UG,QWHUQDWLRQDO6HPLQDURQ5HVHDUFKRI,QIRUPDWLRQ7HFKQRORJ\DQG,QWHOOLJHQW6\VWHPV ,65,7,

$&RPSDUDWLYH6WXG\RI-DYDDQG.RWOLQIRU
$QGURLG0RELOH$SSOLFDWLRQ'HYHORSPHQW
2020 3rd International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) | 978-1-7281-8406-7/20/$31.00 ©2020 IEEE | DOI: 10.1109/ISRITI51436.2020.9315483
%DPEDQJ3XUQRPRVLGL'ZL3XWUDQWR 5REHUWXV6DSWRWR
0DVWHURI,QIRUPDWLRQ7HFKQRORJ\ 0DVWHURI,QIRUPDWLRQ
670,.$NDNRP 7HFKQRORJ\
<RJ\DNDUWD,QGRQHVLD 670,.$NDNRP
ESGS#DNDNRPDFLG <RJ\DNDUWD,QGRQHVLD
UREHUWXVVDSWRWR#JPDLOFRP

 
$EVWUDFW² 7KHUH DUH VHYHUDO SURJUDPPLQJ ODQJXDJHV WKDW
FDQ EHXVHGWRGHYHORS$QGURLGDSSOLFDWLRQVXFKDV&-DYD
.RWOLQ -DYD6FULSW DQG PDQ\ PRUH (DFK SURJUDPPLQJ
ODQJXDJH FHUWDLQO\ KDV VRPH DGYDQWDJHV DQG GLVDGYDQWDJHV LQ
WKH GHYHORSPHQW RI $QGURLG DSSOLFDWLRQ 7KHUHIRUH D
FRPSDULVRQ WR VHH WKH YDOXHV RI WKRVH SURJUDPPLQJ ODQJXDJHV
LV QHHGHG 7KLV UHVHDUFK FRPSDUHG WZR SRSXODU SURJUDPPLQJ
ODQJXDJHV IRU $QGURLG DSSOLFDWLRQ GHYHORSPHQW QDPHO\ -DYD
DQG .RWOLQ 7KH WHVWLQJ ZDV GRQH E\ EXLOGLQJWZRDSSOLFDWLRQV
XVLQJ -DYD DQG .RWOLQ WKDWDFFHVVGDWDLQDUHPRWHVHUYHU2XU
FRPSDULVRQ LQFOXGHV VRXUFH FRGH HYDOXDWLRQ WHVWLQJ RQ WKH
SHUIRUPDQFH RI WKH DSS SHUIRUPHG RQ WZRGHYLFHVDQGWHVWLQJ
RQ WKH GDWD XVDJH )URP WKH WHVW UHVXOWV LW ZDV SURYHG WKDW
.RWOLQ LV VXSHULRU LQ WHUPV RI PRUH FRQFLVH OLQHV RI FRGH DQG
OHVV GDWD XVDJH ZKLFK ZLOO UHGXFH EXJV VXEVWDQWLDOO\ WKHUHIRUH
ZLOOOHDGWRIDVWHUGHYHORSPHQWWLPH2QWKHRWKHUKDQG-DYDLV
VXSHULRU LQ LWV FRPSLOLQJ WLPH IRU ILUVW WLPH EXLOG EXW RQ SDU
ZLWK .RWOLQ IRU LQFUHPHQWDO EXLOG  DQG $3. VL]H DOEHLW QRW
VLJQLILFDQW :H DOVR FRPSDUH HFRV\VWHP DQG SURJUDPPLQJ
ODQJXDJH FRQVWUXFWV IRUERWKSURJUDPPLQJODQJXDJHV2YHUDOO
IRU $QGURLG PRELOH DSSOLFDWLRQ GHYHORSPHQW -DYD VKRXOG EH
XVHG LIPRELOHDSSOLFDWLRQGHYHORSPHQWSULRULW\LVWKH$3.VL]H
DQG FRPSLODWLRQ  EXLOG WLPH ZKLOH .RWOLQ VKRXOG EH XVHG LI
PRELOH DSSOLFDWLRQ GHYHORSPHQW SULRULW\ LV OHVVHUEXJVFRQFLVH
FRGHDQGIDVWHUGHYHORSPHQWWLPH
.H\ZRUGV² 3URJUDPPLQJ /DQJXDJH -DYD .RWOLQ$QGURLG
&RPSDULVRQ
, ,̵1752'8&7,21
3URJUDPPLQJ ODQJXDJH SOD\V DQ LPSRUWDQW UROH LQ
GHYHORSLQJ DQ DSSOLFDWLRQ DQG DOORZV SURJUDPPHUV WR
SURYLGH FRPSXWHUXQGHUVWDQGDEOH LQVWUXFWLRQV DQG DOORZ
FRPSXWHUVWRSURFHVVODUJHDQGFRPSOH[LQIRUPDWLRQTXLFNO\
DQG HIILFLHQWO\ >@ >@ >@ 3URJUDPPLQJ ODQJXDJH LV
FRQVLGHUHG DV D PHDQV RI H[SUHVVLQJ FRPSXWDWLRQV LQ D
FRPSUHKHQVLEOH IRUP IRU ERWK SHRSOH DQG PDFKLQHV 0XFK
OLNH KXPDQ ODQJXDJH WKHUH DUH PDQ\ FRPSXWHU
SURJUDPPLQJ ODQJXDJHV ZKLFKFDQEHXVHGE\SURJUDPPHUV
WR FRPPXQLFDWH ZLWK FRPSXWHUV >@ >@  7KH V\QWD[ RI D
ODQJXDJH VSHFLILHV KRZ YDULRXV VRUWV RI SKUDVHV
H[SUHVVLRQV FRPPDQGV GHFODUDWLRQVHWF DUHFRPELQHGWR
IRUPSURJUDPV>@>@
Authorized licensed use limited to: University of Exeter. Downloaded
k,(((


2YDQGU\&KDQGUD-DNDULD :LG\DVWXWL$QGUL\DQL
0DVWHURI,QIRUPDWLRQ7HFKQRORJ\ 0DVWHURI,QIRUPDWLRQ
670,.$NDNRP 7HFKQRORJ\
<RJ\DNDUWD,QGRQHVLD 670,.$NDNRP
RYDQGU\FKDQGUDMDNDULD#JPDLOFRP <RJ\DNDUWD,QGRQHVLD
ZLG\XJP#JPDLOFRP
6RPH SURJUDPPLQJ ODQJXDJHV WKDW FDQ EH XVHG WR
GHYHORS $QGURLGDSSOLFDWLRQVDUH-DYDDQG.RWOLQ-DYDLVDQ
REMHFWRULHQWHG SURJUDPPLQJ ODQJXDJH DQG FXUUHQWO\ DOVR
LQFOXGHV IXQFWLRQDOSURJUDPPLQJ WKDWOLIWVREMHFWVWKDWH[LVW
LQ WKH UHDO ZRUOG DQG KDV JRRG IOH[LELOLW\ DV RQH RI WKH
SURJUDPPLQJ ODQJXDJHVEHFDXVHRILWVPXOWLSODWIRUPZKLFK
PHDQV WKDW LW FDQ EH UXQ RQ YDULRXV SODWIRUPV VXFK DV
/LQX[ :LQGRZV 6RODULV DQG YDULRXV PRELOH GHYLFHV
ZLWKRXW KDYLQJ WR FKDQJH WKH H[LVWLQJ FRGH ZKLFK LV
FRPPRQO\ UHIHUUHG WR WKH WHUP ZULWH RQFH UXQ DQ\ZKHUH
>@ >@ %\ FRPSLOLQJ VRXUFH FRGH LQWR LQWHUPHGLDWH -DYD
E\WH FRGH DQG WKHQ H[HFXWLQJ LWRQDYLUWXDOPDFKLQHRQWKH
WDUJHW V\VWHP -DYD SURYLGHV SRUWDELOLW\ DQG SODWIRUP
LQGHSHQGHQF\ ZKLFK IHZ RWKHU ODQJXDJHV FDQ RIIHU >@
+RZHYHU -DYD LV D YHUERVH ODQJXDJH WKXV RQH RI WKH PDLQ
GUDZEDFNV RI WKH ODQJXDJH LV WKDW HYHQ VLPSOH WDVNV RIWHQ
QHHG DVLJQLILFDQWDPRXQWRIFRGH7RDOORZSURJUDPPHUVWR
ZULWH FRQFLVHFRGH-HW%UDLQVFUHDWHGDQHZODQJXDJHQDPHG
.RWOLQ >@ .RWOLQ KDV PRUHPRGHUQODQJXDJHIHDWXUHVWKDQ
-DYD .RWOLQ LV D SUDJPDWLF SURJUDPPLQJ ODQJXDJH WKDW
FRPELQHV REMHFWRULHQWHG 22 DQGIXQFWLRQDOSURJUDPPLQJ
>@ >@ .RWOLQ KDV DWWUDFWHG PDQ\ GHYHORSHUV EHFDXVHRI
LWV VLPSOH V\QWD[ DQG LWVPDLQIRFXVRQPRELOHGHYHORSPHQW
LQ WKH EHJLQQLQJ <HW LW LV PDLQO\ EHFDXVH RI LWV
FRPSDWLELOLW\ZLWK-DYD>@>@
,Q WKLV VWXG\ WKH DXWKRUV XVHG DQ DSSOLFDWLRQ WR GLVSOD\
LQWHUQDWLRQDO DFWRUV DQG DUWLVWV WKDW DUH DW WKH SHDN RI WKHLU
FDUHHU WKH DSSOLFDWLRQ ZLOO IHDWXUH SKRWRV RI  DFWRUV DQG
WKH EHVW LQWHUQDWLRQDO DUWLVW DFFRUGLQJ WR 7KH 0RYLH
'DWDEDVH 70'E 
,, %̵$&.*5281'
$ -DYD
-DYD LV D ODQJXDJH DQG D SODWIRUP RULJLQDWHG E\ 6XQ
0LFURV\VWHPV >@ >@ >@ -DYD ODQJXDJH LV DQ
REMHFWRULHQWHG SURJUDPPLQJ ODQJXDJH FUHDWHG E\ -DPHV
*RVOLQJ DQG VHYHUDO RWKHU HQJLQHHUV DW 6XQ 0LFURV\VWHPV
-DYD ZDV ILUVW GHYHORSHG LQ  DV SDUW RI WKH *UHHQ
3URMHFW ,QLWLDOO\ -DYD ZDV GHVLJQHG WR UHSODFH WKH &
ODQJXDJHDQGLWZDVNQRZQDV2DN
on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.

 JHW LQWR WKH ODQJXDJH E\ PLJUDWLQJ VPDOO SDUWV RI WKH FRGH
)LJ-DYD3ODWIRUP
-DYD SODWIRUP LVGLIIHUHQWIURPPRVWRWKHUSODWIRUPV:LWKLQ
WKH -DYD SODWIRUP WKH VRIWZDUH SODWIRUP UXQV RQ WRS RI WKH
KDUGZDUHEDVHG SODWIRUP 0RVW RWKHU SODWIRUPV DUH D
FRPELQDWLRQ RI KDUGZDUH DQG RSHUDWLQJ V\VWHPV -DYD
3ODWIRUPKDVWZRFRPSRQHQWV>@
 -DYD9LUWXDO0DFKLQH -90 
 -DYD $SSOLFDWLRQ 3URJUDPPLQJ ,QWHUIDFH -DYD
$3, 
-DYD$3,LVDFROOHFWLRQRIUHDG\PDGHVRIWZDUHFRPSRQHQWV
WKDW SURYLGHV D YDULHW\ RI IDFLOLWLHV VXFK DV PDQ\ *8,
ZLGJHWV FROOHFWLRQV GDWD VWUXFWXUHV DQG PDQ\ PRUH 7KH
-DYD $3, LV JURXSHG LQ WKH SDFNDJHV RI UHODWHG FRPSRQHQWV
>@>@>@>@
SHUIRUPDQFH LQWHURSHUDELOLW\ IRRWSULQW FRPSLODWLRQ WLPH
DQG OHDUQLQJ FXUYH >@ .RWOLQ LV FRPSLOHG WR -DYD
E\WHFRGHZKLFKPHDQVWKDWDQDSSOLFDWLRQZULWWHQLQ.RWOLQ
FDQ EH H[HFXWHG RQ WKH -DYD YLUWXDO PDFKLQH DQG .RWOLQ LV
IXOO\ LQWHURSHUDEOH ZLWK -DYD >@ >@ >@ $V D UHVXOW
.RWOLQEHFRPHVYHU\HDV\WRJHWLQWRIRUGHYHORSHUV$VZLWK
WKH IXOO LQWHURSHUDELOLW\ ZLWK -DYD LW EHFRPHV YHU\ HDV\ WR
LQWR.RWOLQ>@
& 7KH0RYLH'DWDEDVH 70'E 
7KH 0RYLH 'DWDEDVH 70'E  LV DQ RQOLQH GDWDEDVH WKDW
SURYLGHV LQIRUPDWLRQ UHODWHG WR PRYLHV DQG 79 SURJUDPV
>@ 7KHLQIRUPDWLRQSURYLGHGDPRQJRWKHUSRSXODUPRYLHV
DQG 79 OLVWLQJV GHWDLOHG LQIRUPDWLRQ VXFK DV UHOHDVH GDWH
GLUHFWRU PRYLH VWDU DFWRU V\QRSVLV SKRWRV YLGHR WUDLOHUV
HWF 70'E SURYLGHV $3, VHUYLFHV VR WKDW WKH DSSOLFDWLRQ
GHYHORSHUV FDQ DGG LQIRUPDWLRQ DERXW PRYLHV DQG 79
SURJUDPV RQ WKHLUDSSOLFDWLRQV6LQFH70'EKDVEHHQ
XVHGE\PRUHWKDQGHYHORSHUVDQGFRPSDQLHV
' $QGURLG3URILOHU
$QGURLG 6WXGLR KDV DJUHDWWRROIRUDSSOLFDWLRQSURILOLQJ
,Q DGGLWLRQ LW SURYLGHV WKH FORVHVW PHWDOWRPHWDO LQWHUIDFH
ZLWK WKH PRELOH $QGURLG GHYLFH +RZHYHU LWV XVDJH LV QRW
VLPSOH DQG WKHUHIRUH LW EHFRPHV WKH WKLUG SURILOLQJ WRROV
FRPSDUHG WR RWKHUWRROV$QGURLGSURILOHUSURYLGHVUHDOWLPH
GDWD DSSOLFDWLRQV VXFK DV &38 XVDJH PHPRU\ QHWZRUN
DQG EDWWHU\ $QGURLG 3URILOHU KHOSVGHYHORSHUVLQPHDVXULQJ
DSSOLFDWLRQSHUIRUPDQFH>@

,,, 5̵(6($5&+0̵
(7+2'2/2*<

7KLV UHVHDUFK ZLOO GHYHORS WZR DSSOLFDWLRQV LQ ZKLFK

HDFK UHSUHVHQWV WKH SURJUDPPLQJ H[DPSOHV ODQJXDJHV RI
-DYD DQG .RWOLQ %RWK DSSOLFDWLRQV KDYH WKH VDPH
UHTXLUHPHQWV DQG HQG UHVXOWV VR WKH\ FDQ EH DQDO\]HG DQG
FRPSDUHG IRU WKHLU SHUIRUPDQFH 5HVHDUFK IORZV LQ WKLV
VWXG\FDQEHVHHQLQ)LJ


)LJ-DYD0XOWLSODWIRUP

$V FDQ EH VHHQ LQ)LJDERYH-DYDSURJUDPUXQVRQWRSRI

WKH-DYDSODWIRUP-DYD3ODWIRUPLVRODWHV-DYDSURJUDPVZLWK
KDUGZDUH VR -DYD SURJUDPV GR QRW UHO\ RQ KDUGZDUH
LQGHSHQGHQWO\ -DYD KDV VHYHUDO DGYDQWDJHV ZKHQFRPSDUHG
WR RWKHU SURJUDPPLQJ ODQJXDJHV VXFK DV REMHFWRULHQWHG
ODQJXDJH PXOWLWKUHDGLQJ JDUEDJH FROOHFWRU VXSSRUW
VWDWLFDOO\W\SHGPXOWLSODWIRUP
% .RWOLQ
.RWOLQ LV D VWDWLFDOO\ W\SHG SURJUDPPLQJ ODQJXDJH WKDW
WDUJHWV -DYD 9LUWXDO 0DFKLQH -90  $QGURLG -DYD6FULSW
DQG 1DWLYH $W ILUVW .RWOLQ ZDV GHYHORSHGE\-HW%UDLQVDQG
.RWOLQ SURMHFW ZDV VWDUWHG LQ  7KHQ LW EHFDPH DQ
RSHQVRXUFH SURJUDPPLQJ ODQJXDJH .RWOLQ YHUVLRQZDV
RIILFLDOO\ UHOHDVHG LQ )HEUXDU\  .RWOLQ LVDJUHDWILWIRU 
GHYHORSLQJ $QGURLG DSSOLFDWLRQV EULQJLQJ DOO RI WKH )LJ5HVHDUFK)ORZV
DGYDQWDJHV RI D PRGHUQ ODQJXDJH WR WKH $QGURLG SODWIRUP
ZLWKRXW LQWURGXFLQJ DQ\ QHZ UHVWULFWLRQV OLNH FRPSDWLELOLW\

Authorized licensed use limited to: University of Exeter. Downloaded

on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.
$ /LWHUDWXUH5HYLHZ
7KH SXUSRVH RI D OLWHUDWXUH UHYLHZ LV WR JDLQ DQ
XQGHUVWDQGLQJ RI WKH H[LVWLQJ UHVHDUFK DQG GHEDWHV UHOHYDQW
WR D SDUWLFXODU WRSLF RU DUHD RI VWXG\ DQG WR SUHVHQW WKDW
NQRZOHGJH LQ D ZULWWHQ UHSRUW IRUP ,Q WKLV VWXG\ PDQ\
UHVHDUFK SDSHUV RQOLQH DUWLFOHV DQG SUHYLRXV SURMHFWV RQ
GLIIHUHQW WRSLFVDUHUHYLHZHGWRFRPHXSZLWKDQDSSURSULDWH
VROXWLRQ RI KRZ SURJUDPPLQJ ODQJXDJHV DIIHFW DSSOLFDWLRQ
SHUIRUPDQFH
% $SSOLHG0HWKRGRORJ\
7KLV VWDJH DLPV WR DQDO\]H WKH DSSOLFDWLRQ QHHGVGHVLJQ
RI WKH V\VWHP DV D ZKROH DSSOLFDWLRQ LPSOHPHQWDWLRQ DQG
UXQWLPH WHVWLQJWRHQVXUHWKDWWKHDSSOLFDWLRQXVHGLVUXQQLQJ
EDVHG RQ WKH SDUWLFXODU UHTXLUHPHQWV 7KH DSSOLFDWLRQ LV D
SRSXODU SHUVRQ DSSOLFDWLRQ D XVHIXO DSSOLFDWLRQ IRU
VKRZFDVLQJ SRSXODU SHRSOH LQ WKH ZRUOG $SSOLFDWLRQV DUH
EXLOW XVLQJ -DYD DQG .RWOLQ SURJUDPPLQJ ODQJXDJH 1H[W
ERWK DSSOLFDWLRQV ZLOO EH PHDVXUHG E\ WKHLU SHUIRUPDQFH
PHDVXUHPHQW DQG HIILFLHQF\ SHUIRUPDQFH WR GHWHUPLQH
ZKLFK DSSOLFDWLRQ DQG HIILFLHQF\ SHUIRUPDQFH DUH EHWWHU $
8VH &DVH GLDJUDP LQ )LJ  LV FUHDWHG WR GHVFULEH
LQWHUDFWLRQV EHWZHHQ XVHUV DQG DSSOLFDWLRQV ,Q JHQHUDO WKH
DSSOLFDWLRQ WDNHV SHUVRQDO GDWD REWDLQHG IURP D VHUYHU DQG
XVHUVFDQRQO\VHHWKHSHUVRQ VGDWD
5DQGRP $FFHVV 0HPRU\ 5DQGRP $FFHVV 0HPRU\
5$0 *% 5$0 *%
66'*%
+DUG'LVN7HUDE\WH
+DUG'LVN7HUDE\WH

,9 5̵
(68/7̵
$1'$̵
1$/<6,6
'DWD SURFHVVLQJ DQG SUHVHQWDWLRQ DUH REWDLQHG IURP WKH
H[SHULPHQW UHVXOWV IRU FRPSLODWLRQ WLPH DQG OLQHV RI FRGH
ZKLOH HFRV\VWHP DQG SURJUDPPLQJ ODQJXDJH FRQVWUXFWV DUH
EDVHG RQ FXUUHQW DYDLODEOH UHVRXUFHV %DVHGRQWKHUHVXOWLQJ
GDWD WKH SHUIRUPDQFH RI ERWK DSSOLFDWLRQV FDQEHVHHQ2XU
DQDO\VLV ZLOO VKRZ ZKLFK SURJUDPPLQJ ODQJXDJH LV PRUH
HIILFLHQW WR EH XVHG RQ $QGURLGEDVHG DSSOLFDWLRQ
GHYHORSPHQW 2XU PHDVXUHPHQWV DUH GRQH E\ EXLOGLQJ
DSSOLFDWLRQV RQ HDFK SURJUDPPLQJ ODQJXDJH -DYD DQG
.RWOLQ 1H[W ZH PHDVXUH WKH DSSOLFDWLRQ V HIILFLHQF\ E\
UXQQLQJ WKH DSSOLFDWLRQ 7KH PHWULFV LWVHOI LV REWDLQHG E\
XVLQJ OLQHV RI FRGH FODVV DQG FRPSLODWLRQ WLPH LQ $QGURLG
6WXGLR
$ &RPSLODWLRQ7LPHDQG$3.6L]H5HVXOWV
&RPSDULVRQ IRU FRPSLODWLRQ WLPH RQ WKH DSSOLFDWLRQ
SURMHFW DSSOLHG WR ERWK SURJUDPPLQJ ODQJXDJHV DW WZR
FRPSXWHUV VKRZHG WKDW -DYD LV VXSHULRU LQ  WLPHV WHVWLQJ
FRPSDUHG WR .RWOLQ DV VKRZQ LQ )LJ  )LUVW FRPSLODWLRQ
DOZD\V KDV WKH ORQJHVW FRPSLODWLRQ WLPH VLQFH *UDGOH ZLOO
IHWFK DQ\ OLEV MDU  QHHGHG IRU FRPSLODWLRQ 6XEVHTXHQW
FRPSLODWLRQ WLPH LV UHGXFHG VLJQLILFDQWO\ VLQFH *UDGOH
FDFKHV DOO XQFKDQJHG UHVXOWV DQG RQO\ EXLOGV WKH FKDQJHG
SDUWV 
7DEOH&RPSLODWLRQ7LPH LQVHFRQGV 

'HYLFH$ 'HYLFH%
7HVWLQJ
-DYD .RWOLQ -DYD .RWOLQ
 7HVW    
)LJ8VH&DVH'LDJUDP
7HVW    
& ([SHULPHQW 7HVW    
([SHULPHQWV DUH SHUIRUPHG E\ SHUIRUPLQJ SHUIRUPDQFH 7HVW    
PHDVXUHPHQWV RQ LQGLYLGXDO -DYD DQG .RWOLQDSSOLFDWLRQVLQ 7HVW    
$QGURLG VWXGLR ZKLFK XVHV *UDGOH IRU EXLOG WRROV DQG DQ
HPXODWRU WR UXQ WKH DSSOLFDWLRQ 7KH PHDVXUHPHQW VFHQDULR 7HVW    
LV WR GR DSSOLFDWLRQ FRGLQJ DQG EXLOGLQJ IRU  VHVVLRQV ,Q 7HVW    
HDFK FRGLQJ DQG EXLOGLQJ VHVVLRQ ZH FKDQJH VRPH VRXUFH 7HVW    
FRGH IRU IHDWXUH DGGLWLRQ DQGRU EXJV IL[HV GRQH RQ 7HVW    
SXUSRVH WR UHFRUGLQFUHPHQWDOEXLOG  )RUWKRVHVHVVLRQV
WKH UHVXOWV IRU FRPSLODWLRQ DQG EXLOG WLPH DUH DYHUDJHG 7HVW    
$SSOLFDWLRQ ZLWK IHZHU QXPEHU RI OLQHV RI FRGH IHZHU $YHUDJH    
QXPEHU RI FODVVHV DQG ORZHU FRPSLODWLRQ DQG EXLOG WLPH LV 
FRQVLGHUHGDVDQDSSOLFDWLRQZLWKEHWWHUSHUIRUPDQFH
([SHULPHQWV DUH SHUIRUPHG XVLQJ 2UDFOH -'. 
XSGDWH  WDUJHWLQJ $QGURLG 6'. YHUVLRQ  )RU .RWOLQ
ZH XVH WKH ODWHVW .RWOLQ YHUVLRQ   DV RI QRYHPEHU
 RQ 2UDFOH -'.  XSGDWH  :H XVH *UDGOH 
IRU RXU EXLOG WRROV )RU KDUGZDUH RXU H[SHULPHQWV DUH
SHUIRUPHGRQWZRGHYLFHVZLWKVSHFLILFDWLRQ
7DEOH'HYLFH6SHFLILFDWLRQV

'HYLFH$ 'HYLFH%
3URFHVVRU ,QWHOŠ &RUHŒ L8
,QWHOŠ&RUHŒL8 &38#*+]
&38#*+]*+]

Authorized licensed use limited to: University of Exeter. Downloaded

on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.

)LJ&RPSLODWLRQ7LPH&RPSDULVRQ
7KH ILQDO UHVXOWV RI WKH $3. VL]H EHWZHHQ WKH -DYD DQG
.RWOLQ YHUVLRQV GLIIHU E\ DERXW  7KH -DYD YHUVLRQ LV
 .% LQ VL]H DQG WKH .RWOLQ YHUVLRQ LV 
.%
% /LQHVRI&RGH
)RU OLQHV RI FRGH FRPSDULVRQ LQ DSSOLFDWLRQ SURMHFWV IRU
ERWK SURJUDPPLQJ ODQJXDJHV -DYD¶V OLQHV RI FRGH LV 
OLQHVFRPSDUHGWR.RWOLQZLWKOLQHVRIFRGH7KHUHIRUH
LQWKLVFDVH.RWOLQLVVXSHULRUWR-DYDDVLWLVVKRZQLQ)LJ
' (FRV\VWHP
%RWK SURJUDPPLQJ ODQJXDJHV DUH -90 SURJUDPPLQJ
ODQJXDJHV DQG ERWK DUH RIILFLDOO\ VXSSRUWHG E\ *RRJOH IRU
$QGURLG DSSOLFDWLRQ GHYHORSPHQW ,W LPSOLHV WKDW ERWK DUH
LQWHURSHUDEOH PHDQV .RWOLQ FDQ XVH -DYD OLEUDULHV DQG YLFH
YHUVD ,Q WKLV UHJDUG DOO PDYHQ UHSRVLWRULHV FDQ EH XVHG E\
ERWKSURJUDPPLQJODQJXDJHV
)RU ,'( FXUUHQWO\ $QGURLG 6WXGLR VXSSRUWV ERWK
SURJUDPPLQJ ODQJXDJHV WKHUHIRUH -DYD DQG .RWOLQ DUH
VXSSRUWHG IURP LQLWLDO SURMHFWV GXULQJ LWHUDWLYH
GHYHORSPHQW GHEXJJLQJ SURILOLQJ DQG SDFNDJLQJ IRU
GHSOR\PHQW ,I GHYHORSHUV SUHIHU GHYHORSPHQW ZLWKRXW
$QGURLG 6WXGLR PDQ\ DYDLODEOH GHYHORSPHQW WRROV H[LVW WR
VXSSRUW WKLV NLQG RI GHYHORSPHQW  IRU H[DPSOH 6SDFH9LP
HQDEOHV V\QWD[ KLJKOLJKWLQJ FRPSOHWLRQ DQG PDQ\ PRUH
XVLQJ /63 /DQJXDJH 6HUYHU 3URWRFRO  IRU ERWK -DYD DQG
.RWOLQ
)RU DSSOLFDWLRQ GHYHORSPHQW HYHQ WKRXJK ZH GR QRW
GLVFXVV PXOWL SODWIRUP GHYHORSPHQW LQ WKLV SDSHU QRWH WKDW
.RWOLQ KDV PRUH PDWXUH IUDPHZRUN ZKLFK LV IUHH DQG RSHQ
VRXUFH .00  .RWOLQ 0XOWL 0RELOH ̵ ZKLOH -DYD KDV
VLPLODU IUHH  SURSULHWDU\ FRPPHUFLDO RIIHULQJ ZLWK *OXRQ

0RELOH̵  7KLV KDV WR EH FRQVLGHUHG XSIURQW EHIRUH
DSSOLFDWLRQGHYHORSPHQWLVVWDUWHG
( 3URJUDPPLQJ/DQJXDJH&RQVWUXFWV
(IIHFWLYH GHYHORSPHQW DQG OHVV GHYHORSPHQW WLPH DUH
XVXDOO\ DWWULEXWHG WR SURJUDPPLQJ ODQJXDJH FRQVWUXFWV :H
GLVFXVV FRPSDULVRQ EHWZHHQ -DYD DQG .RWOLQ LQ 7DEOH 
1RWH WKDW ZH XVH -'.  DQG .RWOLQ  IRU WKLV
FRPSDULVRQ :H FRPSDUH VWDQGDUG SURJUDPPLQJ ODQJXDJH
FRQVWUXFWV ZLWKRXW WKLUG SDUW\ OLEUDULHV DQGDGGRQV:HXVH
 
.RWOLQ GRFXPHQWDWLRQ̵  DQG -DYD GRFXPHQWDWLRQ̵  IRU WKLV
SXUSRVH

7DEOH &RPSDULVRQRI3URJUDPPLQJ/DQJXDJH&RQVWUXFWV

3DUDPHWHU -DYD .RWOLQ

 &RPSLODWLRQ %\WHFRGHVIRU
%\WHFRGHVIRU
)LJ/LQHVRI&RGH&RPSDULVRQ WDUJHW -901DWLYH
-90QDWLYH
WDUJHWDYDLODEOH
-DYD6FULSW
& 1XPEHURI&ODVV XVLQJ*UDDO90
1XOOVDIHW\ 1R <HV
$ FRPSDULVRQ FKDUW IRU WKH QXPEHU RI FODVVHV RQ
DSSOLFDWLRQ SURMHFWV LQ ERWK ODQJXDJHV VKRZHG WKDW-DYDKDV /DPEGD <HVDOVRLQOLQH
1R
PRUH FODVVHV VLQFH LW XVHVFODVVHVZKLOH.RWOLQRQO\XVHV H[SUHVVLRQV IXQFWLRQV
 FODVVHV 7KHUHIRUH LW FDQ EH FRQFOXGHG WKDW .RWOLQ LV ([WHQVLRQ
1R <HV
VXSHULRUWR-DYDDVLWFDQEHVHHQLQ)LJ IXQFWLRQV
6PDUWFDVWV 1R <HV
,QYDULDQWDUUD\ 1R <HV
1RQSULYDWH 1RIRUFHVVHWWHU
ILHOG <HV DQGJHWWHUIRU
SURSHUWLHV
6WDWLFPHPEHU 1REXWFDQEH
UHSODFHGZLWK
<HV
FRPSDQLRQ
REMHFWVWRSOHYHO


̵
KWWSVNRWOLQODQJRUJOSPRELOH
 
̵
KWWSVJOXRQKTFRPSURGXFWVPRELOH
)LJ1XPEHURI&ODVV&RPSDULVRQ 
̵
KWWSVNRWOLQODQJRUJGRFVUHIHUHQFHFRPSDULVRQWRMDYDKWPO

̵
KWWSVGRFVRUDFOHFRPMDYDVH

Authorized licensed use limited to: University of Exeter. Downloaded

on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.
 IXQFWLRQV  )URP D SURJUDPPLQJ ODQJXDJH FRQVWUXFWV SRLQW RI
H[WHQVLRQ YLHZ .RWOLQ KDV PRUH DGYDQWDJHV DQG OHVV
IXQFWLRQVRU GLVDGYDQWDJHV FRPSDUHG ZLWK -DYD $OVR VRXUFH
#-YP6WDWLF FRGHIRU-DYDLVIDUPRUHYHUERVHWKDQ.RWOLQZKLFK
:LOGFDUGW\SHV 1REXWFDQEH FDQOHDGWRPRUHEXJVDQGRUFRGHVPHOO
UHSODFHGZLWK
<HV GHFODUDWLRQVLWH  %DVHG RQ WKH RYHUDOOPHDVXUHPHQWUHVXOWVLWFDQEH
YDULDQFHDQGW\SH FRQFOXGHG WKDW -DYD VKRXOG EH XVHG LI PRELOH
SURMHFWLRQV DSSOLFDWLRQ GHYHORSPHQW SULRULW\ LV WKH $3. VL]H
6LQJOHWRQV DQG FRPSLODWLRQ  EXLOG WLPH ZKLOH .RWOLQ VKRXOG
<HV <HV
REMHFWV EH XVHG LI PRELOH DSSOLFDWLRQ GHYHORSPHQW SULRULW\
&KHFNHG LV OHVVHU EXJV FRQFLVH FRGH DQG IDVWHU
<HV 1R
H[FHSWLRQV GHYHORSPHQWWLPH
3ULPLWLYHW\SHV
WKDWDUHQRW <HV 1R 5̵
()(5(1&(6
FODVVHV >@ $ 6WHILN 6 6LHEHUW . 6ODWWHU\ DQG 0 6WHILN ³7RZDUG LQWXLWLYH
7HUQDU\ 1REXWFDQEH SURJUDPPLQJ ODQJXDJHV´ ̵ ,((( ,QW &RQI 3URJU &RPSU SS
<HV ±
RSHUDWRU UHSODFHGZLWKLI
>@ % )UH\ - 'RGGULGJHDQG&6HDPDQ³&KDVLQJWKH$+$PRPHQW
5DZW\SHV <HV 1R ([SORULQJ LQLWLDO OHDUQDELOLW\ RI SURJUDPPLQJ ODQJXDJHV´ ̵ 3URF
3URSHUWLHV 1R <HV ,((( 6\PS 9LV /DQJ +XPDQ&HQWULF &RPSXW 9/+&& YRO
3ULPDU\ 2FWRESS±
1R <HV >@ 0 *X]GLDO : 0 0F&UDFNHQ DQG $ (OOLRWW ³7DVN VSHFLILF
FRQVWUXFWRUV SURJUDPPLQJ ODQJXDJHV DV D ILUVW SURJUDPPLQJ ODQJXDJH´ ̵ 3URF 
6WULQJWHPSODWH 1R <HV )URQW(GXF&RQIYROSS±
)LUVWFODVV >@ / 1 7KLQ DQG 0 + +XVLQ ³6PDUW IO\HUV PRELOH DSSOLFDWLRQ´
1R <HV 3URFHHGLQJ   UG ,QW &RQI 6FL ,QI 7HFKQRO 7KHRU\ $SSO,7
GHOHJDWLRQ
(GXF ,QG 6RF %LJ 'DWD (UD ,&6,7HFK  YRO -DQXDSS
7\SHLQIHUHQFH
±
IRUYDULDEOHDQG 1R <HV >@ 77&KHQJ('/RFNDQG163U\ZHV³8VHRI9HU\+LJK/HYHO
SURSHUW\W\SHV /DQJXDJHV DQG 3URJUDP *HQHUDWLRQE\0DQDJHPHQW3URIHVVLRQDOV´
'HFODUDWLRQVLW ,(((7UDQV6RIWZ(QJYRO6(QRSS±
HYDULDQFH  >@ 5 +DUSHU ̵ 3UDFWLFDO IRXQGDWLRQV IRU SURJUDPPLQJ ODQJXDJHV
1R <HV VHFRQGHGLWLRQ&DPEULGJH8QLYHUVLW\3UHVV
W\SH
SURMHFWLRQV >@ 6 7LJUHN DQG 0 2EDGDW ³7HDFKLQJ VPDUWSKRQHV SURJUDPPLQJ
XVLQJ $QGURLG-DYD 3HGDJRJ\DQGLQQRYDWLRQ´̵ ,QW&RQI,QI
5DQJH
1R <HV 7HFKQRO%DVHG+LJK(GXF7UDLQLQJ,7+(7
H[SUHVVLRQV >@ ' *UDFDQLQ 0 0DWLMDVHYLF DQG . 3 9DODYDQLV ³9LUWXDO
2SHUDWRU HQYLURQPHQW WHVWEHGIRUXQGHUZDWHUURERWLFVDSSOLFDWLRQV´̵ ,QW&RQI
1R <HV
RYHUORDGLQJ $GY5RERW3URFHHGLQJV,&$5SS±
&RPSDQLRQ >@ & &RWD / $JXLODU DQG * /LFHD ³$ MDYD FRPSDWLEOH YLUWXDO
1R <HV PDFKLQH DV DQ HPEHGGHG PLGGOHZDUHIRUZLUHOHVVVHQVRUQHWZRUNV´
REMHFWV
3URF   ,((( (OHFWURQ 5RERW $XWRPRW 0HFK &RQI &(50$
'DWDFODVVHV 1R <HV SS±
6HSDUDWH >@ 3 6FKZHUPHU ³3HUIRUPDQFH (YDOXDWLRQ RI .RWOLQ DQG -DYD RQ
LQWHUIDFHVIRU $QGURLG5XQWLPH´̵ 'HJUHH3URM&RPSXW6FL(QJ
UHDGRQO\DQG 1R <HV >@ 0 )ODX]LQR - 9HUtVVLPR 5 7HUUD ( &LULOR 9+6'XUHOOLDQG
PXWDEOH 56'XUHOOL³$UH\RXVWLOOVPHOOLQJLW"´SS±
>@ ' *RWVHYD < 7RPRY DQG 3 'DQRY ³&RPSDUDWLYH VWXG\ -DYD YV
FROOHFWLRQV .RWOLQ´ ̵WK 1DWO &RQI ZLWK ,QW 3DUWLFLS :D\VWR&RQQHFW)XWXU
&RURXWLQHV 1R <HV 7(/(&203URFSS±
9HUERVLW\ 9HU\YHUERVH &RQFLVH >@ ' 6WHSDQRY 0 $NKLQ DQG 0 %HO\DHY ³5HGX.WRU +RZ ZH
VWRSSHG ZRUU\LQJ DERXW EXJV LQ NRWOLQ FRPSLOHU´ ̵ 3URFWK
 ,((($&0 ,QW &RQI $XWRP 6RIWZ (QJ $6(  SS ±

9&̵21&/86,21 >@ + =$<$7 ³.RWOLQ DQG $QGURLG DSSOLFDWLRQVಞ GLIIXVLRQ DQG
DGRSWLRQ RI FKDUDFWHULVWLFFRQVWUXFWV´32/,7(&1,&2',725,12
%DVHG RQ WKH UHVHDUFK WKDW KDV EHHQ GRQH LW FDQ EH 
FRQFOXGHGDVIROORZV >@ 9 2OLYHLUD/7HL[HLUDDQG)(EHUW³2QWKH$GRSWLRQRI.RWOLQRQ
$QGURLG'HYHORSPHQW$7ULDQJXODWLRQ6WXG\´̵ 6$1(53URF
 7HVWLQJ RQ DQ DSSOLFDWLRQ SURMHFW VKRZHG WKDW  ,((( WK ,QW &RQI 6RIWZ $QDO (YRO 5HHQJLQHHULQJ SS
.RWOLQ LV VXSHULRU LQ WHUPV RI OLQHV RI FRGH DQGWKH ±
QXPEHU RIFODVVHVZKLOH-DYDLVVXSHULRULQWHUPVRI >@ -)ULHVHQ̵/HDUQ-DYDIRU$QGURLG'HYHORSPHQW
FRPSLODWLRQ WLPH DQG $3. VL]H DOWKRXJK WKH\ DUH >@ = 0X < 3HQJ DQG < /LX ³(UHDGLQJ V\VWHP EDVHG RQ DQGURLG´
QRWWRRVLJQLILFDQW 3URF WK,QW&RQI,QWHOO&RPSXW7HFKQRO$XWRP,&,&7$
SS±
 (FRV\VWHP IRU ERWK SURJUDPPLQJ ODQJXDJHV LV >@ $ 3UDPRQR ³)LUVW $LG ,QVWUXFWLRQDO 0HGLD XVLQJ $QGURLG
FRPSOHWH DQG LQWHURSHUDELOLW\ EHWZHHQ .RWOLQ DQG 3ODWIRUP´ ̵  WK ,QW &RQI&RPSXW$SSO,QI3URFHVV7HFKQRO
SS±
-DYD LV HDV\ DQG VHDPOHVV WKHUHIRUH ERWK FDQ XVH >@ / 5DSDQRWWL-*+DOODQG=/L³3UREOHP5HGXFWLRQDV\VWHPDWLF
DYDLODEOH GHYHORSPHQW WRROV OLEUDULHV DQG WHFKQLTXH IRU GHULYLQJ 6SHFLILFDWLRQV IURP 5HTXLUHPHQWV´ ̵ ,((
IUDPHZRUNV +RZHYHU IRU PXOWL SODWIRUP 3URFHHGLQJV±6RIWZDUHYROQRSS±
GHYHORSPHQW .RWOLQ LVEHWWHULQIUDPHZRUNVXSSRUW >@ . -H]HN - 'LHWULFK DQG 3 %UDGD ³+RZ -DYD $3,V EUHDN  $Q
DV.00LVIUHHO\DYDLODEOHDQGIXOO\VXSSRUWHG HPSLULFDOVWXG\´̵ ,QI6RIWZ7HFKQROYROSS±
>@ ' /DUVVRQ DQG:0RVWRZVNL³6SHFLI\LQJ-DYD&DUG$3,LQ2&/´

Authorized licensed use limited to: University of Exeter. Downloaded

on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.
 (OHFWURQ1RWHV7KHRU&RPSXW6FLYROSS±
>@ / $UGLWR5&RSSROD*0DOQDWLDQG07RUFKLDQR³(IIHFWLYHQHVV
RI .RWOLQ YV -DYD LQ DQGURLG DSS GHYHORSPHQW WDVNV´ ̵
,QI 6RIWZ
7HFKQROYROQR-XO\
>@ È *DPD]D * 2UWL] - %RXEHWD3XLJ DQG $ *DUFLDGH3UDGR
³5(67&(3 5(67IXO $3,V IRU FRPSOH[ HYHQW SURFHVVLQJ´ ̵ 6FL
&RPSXW3URJUDPYROS
>@ -HW%UDLQV³.RWOLQ/DQJXDJH'RFXPHQWDWLRQ´
>@ 0 0DUWLQH] DQG % * 0DWHXV ³+RZ DQG :K\ GLG GHYHORSHUV
PLJUDWH $QGURLG$SSOLFDWLRQVIURP-DYDWR.RWOLQ"$VWXG\EDVHGRQ
FRGHDQDO\VLVDQGLQWHUYLHZVZLWKGHYHORSHUV´SS±
>@ 66DPXHODQG6%RFXWLX̵ 3URJUDPPLQJ.RWOLQ

Authorized licensed use limited to: University of Exeter. Downloaded
on June 01,2021 at 14:13:51 UTC from IEEE Xplore. Restrictions apply.
>@ 36SlWK̵
/HDUQ.RWOLQIRU$QGURLG'HYHORSPHQW
>@ 1 (YHUO|QQ 6 *DNLV DQG $ 1LOVVRQ ³-DYD DQG .RWOLQ D
SHUIRUPDQFHFRPSDULVRQ´
>@ 0 %XUFK ̵HW DO ³,0'E ([SORUHU 9LVXDO H[SORUDWLRQ RI D PRYLH
GDWDEDVH´̵$&0,QW&RQI3URFHHGLQJ6HUSS±
>@ 0 /DQKDP ̵ /HDUQ $5&RUH  )XQGDPHQWDOV RI *RRJOH $5&RUHಞ
/HDUQ WR EXLOG DXJPHQWHG UHDOLW\ DSSV IRU $QGURLG 8QLW\ DQG WKH
ZHEZLWK*RRJOH$5&RUH