6WXG\RQ7KH&RQYHUJHQFH6SHHGRI,WHUDWLYH/HDUQLQJ&RQWURO

$OJRULWKP
+RQJELQ:DQJ;LDR\DQ&KHQJ-LDQ'RQJ3LQJ=KDQJ;LDRVKXDL*XR<LPLQJ+X
WKH6FKRRORI(OHFWULFDO(QJLQHHULQJ<DQVKDQ8QLYHUVLW\4LQKXDQJGDR&KLQD
(PDLOP#VLQDFQ
$EVWUDFW ,QWKHILHOGRILWHUDWLYHFRQWUROWKH FRQYHUJHQFH VSHHG RILWHUDWLYHOHDUQLQJFRQWURODOJRULWKPLVDQLPSRUWDQW
FKDUDFWHULVWLFIRUMXGJLQJZKHWKHUWKLVDOJRULWKP LVDSSOLFDEOH7KHUHIRUHWKLVSDSHUSURSRVHVHYHUDOPHWKRGVRIMXVWLI\ LQJWKH
FRQYHUJHQFHVSHHGRILWHUDWLYHOHDUQLQJFRQWURODOJRULWKPWRSURYLGH WKHEDVLVIRUFRPSDULQJVSHHGRIFRQYHUJHQFHRIGLIIHUHQW
LWHUDWLYHOHDUQLQJFRQWURODOJRULWKP
.H\:RUGVLWHUDWLYHOHDUQLQJFRQWUROFRQYHUJHQFHVSHHG


LV FRQYHUJHQWXQGHUWKLVFRQGLWLRQVR ZH WKLQN RI
 ,QWURGXFWLRQ
v VXS  p  DV WKH FRQYHUJHQFHVSHHG RI WKLV LWHUDWLYH
6LQFH $ULPRWR HW DO SURSRVHGW KH FRQFHSW RI LWHUDWLYH
OHDUQLQJDOJRULWKPXQGHUWKLVV\VWHP>@
OHDUQLQJ FRQWURO,/& WKHUH DUHP DQ\ VWXGLHV>@ KDYH
SURYLQJ WKHFRQYHUJHQFHFRQGLWLRQVRILWHUDWLYHDOJRULWKP 
IURPYDULRXVDVSHFWV%XWWKHUHDUHIHZHUVWXGLHV >@RQWKH
VSHHG RIFRQYHUJHQFH*HQHUDO O\ VFKRODUV HYDOXDWH D
LWHUDWLYH DOJRULWKP E\WKUHH UXOHV ZKLFKDUHDFFXUDF\
VWDELOLW\ DQG UDSLGLW\ 7KHUH KDYH EHHQ VR PDQ\
EUHDNWKURXJK SURJUHVVHVDQGVWXGLHVRQ DFFXUDF\>@ DQG
VWDELOLW\>@RIWKHDOJRULWKP%XWWKHSDSHURQVSHHGRIWKH
DOJRULWKPLVQRWVRPXFK:HFDQHYDOXDWHLWVVWDELOLW\DQG
DFFXUDF\ EXWQRWLQFOXGLQJVS HHG GXULQJWKHSURFHVV RI
SURYLQJWKHFRQYHUJHQFHFRQGLWLRQV $WSUHVHQWDOPRVWDOO
:H VHW ek ek  p DQG ek ek  p  ,I p  p  WKHQ
WKHILUVWLWHUDWLYHDOJRULWKPKDVIDVWHUFRQYHUJHQFHVSHHG,I
p p  WKHQ WKHVH WZR LWHUDWLYH DOJRULWKP KDYH VDPH
FRQYHUJHQFH VSHHG7KHFRQYHUJHQFHVSHHGRI LWHUDWLYH
FRQWURODOJRULWKPLVGHWHUPLQHGE\WKHYDOXHRI p LQIDFW
DFFRUGLQJ WR 'HILQLWLRQ  WKH VPDOOHU p LV WKH IDVWHU
FRQYHUJHQFHVSHHGLV
&RQVLGHU WKH IROORZLQJ VHFRQGRUGHUO LQHDU FRQWLQXRXV
V\VWHP
WKHSURYLQJPDWKHPDWLFDOSURRISURFHVVRQWKHFRQYHUJHQFH ª x t  º ª  º ª x t  º ª º ª u t  º
RILWHUDWLYHOHDUQLQJFRQWURODUHEDVHGRQWKHFRQGLWLRQWKDW « » 
WKHQXPEHURIOHDUQLQJ k WHQGVWRLQILQLW\+RZHYHULQ ¬ x t  ¼
«
¬ »¼ ¬« x t  ¼» «¬  »¼ «¬u t  »¼ 
SUDFWLFHSURMHFWWKHFRQYHUJHQFHVSHHGL VDOVRUHTXLUHGWR ª y t  º ª  º ª x t  º
OLPLWWR DILQ LWH WLPH UDQJH ZKLFK PHDQV WKDW VWXG\LQJ RQ « y t  »
FRQYHUJHQFHVSHHGKDVLPSRUWDQWVLJQLILFDQFH ¬  ¼
«
¬  »¼ «¬ x t  »¼
7KLV SDSHUSURSRVHVVHYHUDO  FRPSDUDWLYH PHWKRGV FDQ 7KHLWHUDWLYHLQLWLDOVWDWHRIWKHV\VWHPLVUHSHDWHGVWULFWO\
HYDOXDWHWKHFRQYHUJHQFHVSHHGRILWHUDWLYHOHDUQLQJFRQWURO DQGWKHGHVLUHGWUDMHFWRU\LV
DOJRULWKP UDSLGO\ DWDQ \ VLWXDWLRQV $EVROXWHO\ WKHUH DUH
ª yG t  º ªVLQt  º
«FRVt  » ˈ t  > @ 
VRPH VSHFLDO PHWKRGV WR HYDOXDWH WKH FRQYHUJHQFHVSHHG
DPRQJGLIIHUHQWDOJRULWKPVEXWWKH\QHHGVRPHSDUWLFXODU « y t  »
¬ G ¼ ¬ ¼
FRQGLWLRQV 7 7

 7KH PHWKRGV RI MXVWLI\LQJWKHFRQYHUJHQFH

7KHLQLWLDOFRQGLWLRQLV ª¬ x  x  º¼ >  @ 
VSHHG :HXVHWKHFORVHGORRS3W\SH,/&DOJRULWKP
7KH VSHHGRIFRQYHUJHQFHL V RQHRIW KH PRVW LPSRUWDQW
uk  t  uk t   Lek  t  
SUREOHPVRILWHUDWLYHOHDUQLQJFRQWURO7KHHVVHQFHLVKRZ
WKH V\VWHP¶V SUDFWLFDO RXWSXW FDQFRQYHUJHW R WKH
H[SHFWDWLRQ RXWSXW 7KLV SDSHU LQWURGXFHV WKUHH FRPPRQ
MXGJPHQW PHWKRGV WKH VLPXODWHG UHVXOWV ZRXOG SURYH WKH
S DQGS 

SUDFWLFDELOLW\RIWKHPHWKRGSURSRVHGLQWKLVSDSHU
 0HWKRGRQH
'HILQLWLRQ  $VVXPLQJ WKDW WKLV V\VWHP LV XQGHU WKH
FRQGLWLRQRIWKHVDPHSDUDPHWHUVDQGLQLWLDOYDOXHVIRUWKH
JLYHQ LWHUDWLYH OHDUQLQJ DOJRULWKP ek ek  p   
 ek PD[ yd  yk LQGLFDWHVWKDWWKLVLWHUDWLYHDOJRULWKP 
)LJ,WHUDWLYH6SHHGZLWK7LPHV


7KLVZRUNLVVXSSRUWHGE\1DWLRQDO1DWXUDO6FLHQFH)RXQGDWLRQ116)
RI&KLQDXQGHU*UDQWQR

978-1-5090-4657-7/17/$31.00 2017
c IEEE 7490

Authorized licensed use limited to: ULB Darmstadt. Downloaded on December 13,2022 at 03:19:26 UTC from IEEE Xplore. Restrictions apply.
 7 :HXVHWKHFORVHGORRS3W\SH,/&DOJRULWKP
:H FKRRVH L >  @  WKH VLPXODWLRQ UHVXOWV
˗
uk  t  uk t   Lek  t  
DUHVKRZQLQ)LJ
:HXVHWKHFORVHGORRS3'W\SH,/&DOJRULWKP 7

uk  t  uk t   īek  t   Lek  t  

:H FKRRVH L >  @ WKH VLPXODWLRQ UHVXOWV
˗
 DUHVKRZQLQ)LJ
7
:HFKRRVH ī >   @ DQG
7 HUURU 
L > ˗
 @  WKH VLPXODWLRQ UHVXOWV DUHVK RZQ LQ HUURU 

)LJ

HUURUDQGHUURU
SDQGS 

WLPHV 
)LJ&KDQJHRI0D[LPXP$EVROXWH9DOXHRI(UURUDQG(UURU
ZLWK7LPHV
:HXVHWKHFORVHGORRS3'W\SH,/&DOJRULWKP

)LJ,WHUDWLYH6SHHGZLWK7LPHV uk  t  uk t   īek  t   Lek  t  

7
,Q WKH VLPXODWLQJ H[DPSOH WKHYDOXHRI ȡ LQ WKH :HFKRRVH ī >   @  DQG
FORVHGORRS3'W\SHLWHUDWLYHOHDUQLQJDOJRULWKPLVVPDOOHU 7
WKDQ WKH YDOXH RI ȡ LQ WKH FORVHGORRS 3W\SH LWHUDWLYH L > ˗
 @  WKH VLPXODWLRQ UHVXOWV DUHVK RZQ LQ
OHDUQLQJ DOJRULWKP DW VDPH SURSHUSDUDP HWHUV 7KH )LJ
FORVHGORRS3'W\SHLWHUDWLYHOHDUQLQJDOJRULWKPKDVDIDVWHU
FRQYHUJHQFH VSHHG &RQVLGHULQJ RIW KDW DFWXDO RXWSXW KDV
WRWDOO\WUDFNHGWKHGHVLUHGWUDMHFWRU\DIWHUVHYHUDOLWHUDWLRQV
ZKLOH FRQYHUJHQFHVSHHGL V EHFRPLQJ YHU\ VORZ HTXDOLQJ
HUURUDQGHUURU

QHDUO\WR]HUR ȡ  

 0HWKRGWZR

'HILQLWLRQ:HVHW E DVLQLWLDOV\VWHPHUURUXQGHUWKH
JLYHQ LWHUDWLYH OHDUQLQJ DOJRULWKP LW FRQYHUJHG WR
SHUPLVVLEOH HUURUUDQJH EP  DIWHUOHDUQLQJ k WLPHV :H
FDOO v VXS   k    WKH FRQYHUJHQFHVSHHGRIW KLV
LWHUDWLYHOHDUQLQJDOJRULWKPXQGHUWKLVV\VWHP>@:KHQWKH
GLIIHUHQFHEHWZHHQWKHDFWXDORXWSXWDQGWKHGHVLUHGRXWSXW
LVLQDOLPLWHGDUHDWKHVPDOOHUWKHQXPEHURILWHUDWLRQVLV
WKHIDVWHUFRQYHUJHQFHVSHHGLV
&RQVLGHU WKH IROORZLQJ VHFRQGRUGHUO LQHDU FRQWLQXRXV
V\VWHP
)LJ&KDQJHRI0D[LPXP$EVROXWH9DOXHRI(UURUDQG(UURU
ZLWK7LPHV
,Q WKH VLPXODWLQJ H[DPSOH WKH FORVHGORRS 3W\SH
LWHUDWLYHOHDUQLQJDOJRULWKPLWHUDWHVHYHQWLPHVWRUHDFKHUURU
SUHFLVLRQZKLOHFORVHGORRS3'W\SHLWHUDWLYHOHDUQLQJ
DOJRULWKP ZRXOG LWHUDWH RQO\IRXUWLP HV WRUHDFKDW
VDPHSURSHUSDUDPHWHUV7KHFORVHGORRS3'W\SHLWHUDWLYH
ª x t  º ª  º ª x t  º ª º ª u t  º OHDUQLQJDOJRULWKPKDVDIDVWHUFRQYHUJHQFHVSHHG
« x t  » 
¬  ¼
«
¬ »¼ «¬ x t  »¼ «¬  »¼ «¬u t  »¼   0HWKRGWKUHH
ª y t  º ª  º ª x t  º 'HILQLWLRQ:HVHW E DVLQLWLDOV\VWHPHUURUWKHJLYHQ
« y t  » «  »¼ «¬ x t  »¼
¬  ¼ ¬ LWHUDWLYH OHDUQLQJ DOJRULWKP LWHUDWH k WLPHV V\VWHPDWLF
7KHLWHUDWLYHLQLWLDOVWDWHRIWKHV\VWHPLVUHSHDWHGVWULFWO\ HUURU LV EP PD[ yd - yk  ZHFDOO v VXS  EP  
DQGWKHGHVLUHGWUDMHFWRU\LV
WKH FRQYHUJHQFH VSHHG RIW KLV LWHUDWLYH OHDUQLQJ DOJRULWKP
ª yG t  º ªVLQt  º XQGHUWKLVV\VWHP:LWKWKHVDPHLWHUDWLRQWLPHVWKHVPDOOHU
« y t  » «FRVt  » ˈ t  > @  WKH GLIIHUHQFH EHWZHHQ WKH DFWXDO RXWSXW DQGW KH GHVLUHG
¬ G ¼ ¬ ¼
RXWSXWLVWKHIDVWHUFRQYHUJHQFHVSHHGLV
7 7
7KHLQLWLDOFRQGLWLRQLV ª¬ x  x  º¼ >  @  &RQVLGHU WKH IROORZLQJ VHFRQGRUGHUO LQHDU FRQWLQXRXV
V\VWHP

2017 29th Chinese Control And Decision Conference (CCDC) 7491

Authorized licensed use limited to: ULB Darmstadt. Downloaded on December 13,2022 at 03:19:26 UTC from IEEE Xplore. Restrictions apply.
 ª x t  º ª  º ª x t  º ª º ª u t  º     
« x t  »      
¬  ¼
«
¬ »¼ «¬ x t  »¼ «¬  »¼ «¬u t  »¼ 
)RU WKH VHFRQGRUGHUO LQHDU FRQWLQXRXV V\VWHP DW WKH
ª y t  º ª  º ª x t  º VDPH SDUDPHWHUV DQG LQLWLDO YDOXHV WKH PD[LPXP HUURU RI
« y t  » «  »¼ «¬ x t  »¼
WKH FORVHGORRS 3W\SH LWHUDWLYH OHDUQLQJ DOJRULWKP LV 
¬  ¼ ¬ DIWHULWHUDWLRQVZKLOHPD[LPXPHUURURIW KHFORVHGORRS
7KHLWHUDWLYHLQLWLDOVWDWHRIWKHV\VWHPLVUHSHDWHGVWULFWO\ 3'W\SHLWHUDWLYHOHDUQLQJDOJRULWKPLVOHVVWKDQDIWHU
DQGWKHGHVLUHGWUDMHFWRU\LV LWHUDWLRQV ,W VKRZV WKDW WKH FORVHGORRS 3'W\SH LWHUDWLYH
ª yG t  º ªVLQt  º OHDUQLQJDOJRULWKPFRQYHUJHPRUHTXLFNO\DWWKHVDPHHUURU
« y t  » «FRVt  » ˈ t  > @  SUHFLVLRQ
¬ G ¼ ¬ ¼
7
 &RQFOXVLRQV
7
7KHLQLWLDOFRQGLWLRQLV ª¬ x  x  º¼ >  @  7KH FRQYHUJHQFHVSHHGL V RQHRIW KH PRVW LPSRUWDQW
:HXVHWKHFORVHGORRS3W\SH,/&DOJRULWKP EUDQFKHV RIL WHUDWLYH OHDUQLQJ FRQWURO 6WXG\LQJ RQ
uk  t  uk t   Lek  t   FRQYHUJHQFH VSHHGRIL WHUDWLYH OHDUQLQJ FRQWURO GLUHFWO\
DIIHFWV SUDFWLFDELOLW\ RI LWHUDWLYH OHDUQLQJ FRQWURO LQ WKH
7
:H FKRRVH L >  @  WKH GDWD UHVXOWV DUH
˗ SUDFWLFDO SURMHFW ZKLFK QHHGV V\VWHP
V UHDOWLPH
SHUIRUPDQFH KLJKO\ $W SUHVHQW PRVW RIW KH SDSHUV
VKRZQLQ7DEOHDQG7DEOH
SXEOLVKHG RQO\ IRFXVRQW KH SURRI RI FRQYHUJHQFH XVLQJ
7DEOH0D[LPXP$EVROXWH9DOXHRI(UURUZLWK YDULRXV WKHRULHV RURSW LPL]LQJ V\VWHP XVLQJ WKH ZD\
7LPHV ERQGLQJZLWKRWKHUDGYDQFHGFRQWUROWKHRULHV+RZHYHUWKH
k  yd  yk  yd  y k  Em  UHVHDUFK LQ WKH FRQYHUJHQFHVSHHG RI LWHUDWLYH OHDUQLQJ
FRQWURODOJRULWKPLVHYHQIHZHU7KLVSDSHULVIRUWKHVHFRQG
    
RUGHU OLQHDU FRQWLQXRXV V\VWHP WR VWXG\ RQ FRQYHUJHQFH
    
VSHHG RIFO RVHG ORRS 3' W\SH LWHUDWLYH OHDUQLQJ FRQWURO
    
)XUWKHUPRUH KRZ WKH FRQYHUJHQFHVSHHGRIL WHUDWLYH
    
OHDUQLQJFRQWURODOJRULWKPFDQEHLQFUHDVHGLVDQ LPSRUWDQW
    


DQGSURVSHFWLYHUHVHDUFKGLUHFWLRQLQWKHIXWXUH
7DEOH0D[LPXP$EVROXWH9DOXHRI(UURUZLWK
7LPHV 5HIHUHQFHV
k  yd  yk  yd  y k  Em  >@ +HTLQJ 6XQDQG$QGUHZ*$ OOH\QH $ FRPSXWDWLRQDOO\
HIILFLHQWQRUPRSWLPDOLWHUDWLYHOHDUQLQJFRQWURODSSURDFKIRU
     /79V\VWHPVAutomatica
     >@ 'H %HVW-/DQFKHQJ/LX  DQGYDQGH0ROHQJUDIW
     6HFRQG2UGHU,WHUDWLYH/HDUQLQJ&RQWUROIRU6FDOHG6HWSRLQWV
     IEEE Transactions on Control Systems Technology

     ±
>@ 6DPSVRQ 3 )UHHPDQ & DQG &RRWH 68VLQJ)XQFWLRQDO
:HXVHWKHFORVHGORRS3'W\SH,/&DOJRULWKP (OHFWULFDO 6WLPXODWLRQ 0HGLDWHG E\ ,WHUDWLYH /HDUQLQJ
uk  t  uk t   īek  t   Lek  t   
&RQWURODQG5RERWLFVWR,PSURYH$UP0RYHPHQWIRU3HRSOH
7
:LWK 0XOWLSOH6FOHURVLV IEEE Transactions on Neural
:HFKRRVH ī >   @ DQG Systems and Rehabilitation Engineering
>@ ;LDRH5XDQDQG-LDQ\ RQJ=KDR&RQYHUJHQFHPRQRWRQLFLW\ 
7
L > ˗
 @ WKHGDWDUHVXOWVDUHVKRZQLQ7DEOH DQGVSHHGFRPSDULVRQRILWHUDWLYHOHDUQLQJFRQWURODOJRULWKPV
IRUQRQOLQHDUV\VWHPVIMA Journal of Mathematical Control
DQG7DEOH and Information
7DEOH0D[LPXP$EVROXWH9DOXHRI(UURUZLWK >@ =+8 =KDQORQJ<$1**RQJOLXDQG<$1* 6KXMLH
7LPHV $FFHOHUDWHG/DQGZHEHU,WHUDWLRQ0HWKRGIRUWKH 'RZQZDUG
&RQWLQXDWLRQ RI3RWHQWLDO)LHOG Acta Geodaetica et
k  yd  yk  yd  y k  Em  Cartographica Sinica
     >@ 58$1 ;LDRH 3$5. .ZDQJK\XQ DQG%,(1==HQQ 
     5HWURVSHFWLYH UHYLHZ RI VRPHLWHUDWLYHOHDUQLQJFRQWURO
     WHFKQLTXHV ZLWK D FRPPHQWRQSURVSHFWLYHORQJWHUP
OHDUQLQJ Control Theory &amp; Applications 
    


     >@ ;L[LDQJ /LX;LDRVX;XD QG <LWLQJ/LX$IDVWDQG
7DEOH0D[LPXP$EVROXWH9DOXHRI(UURUZLWK KLJKDFFXUDF\WUDQVIHUDOLJQPHQWPHWKRGEHWZHHQ06,16
7LPHV IRU VKLS EDVHGRQLWHUDWLYHFDOFXODWLRQ Measurement 

k  yd  yk  yd  yk  Em  >@ +HH6XN 3$1* -XQ6HRN/,0  DQG 2K-LQ .:21
     ,WHUDWLYH)UHTXHQF\(VWLPDWLRQIRU$FFXUDF\,PSURYHPHQWRI
     7KUHH ')73KDVH%DVHG0HWKRGV IEICE Transactions on
     fundamentals of electronics, communications &amp;
computer sciences($

7492 2017 29th Chinese Control And Decision Conference (CCDC)

Authorized licensed use limited to: ULB Darmstadt. Downloaded on December 13,2022 at 03:19:26 UTC from IEEE Xplore. Restrictions apply.
>@ /HQJ+DQG=KDQJ4$QLWHUDWLYHDOJRULWKPIRUWKHVWDELOLW\
DQDO\VLV RIG\ QDPLF LQWHUYDOV \VWHPV Applied Numerical
Mathematics: Transactions of IMACS
>@ .D]PL. $KPDG1DQG6KDK]DG0 &RQYHUJHQFH DQG
VWDELOLW\RIDQLWHUDWLYHDOJRULWKPIRUDV\VWHPRIJHQHUDOL]HG
40th IEEE conference on Decision and Control Orlando
)ORULGD86$
>@ =+28;LX\LQJ&+(13HQJQLDQDQG;,(PLQ 6WXG\RQ
FRQYHUJHQFH VSHHGRIKLJKRUGHU3W\ SH LWHUDWLYHOHDUQLQJ
FRQWURODOJRULWKPJournal Of China Institute Of Metrology
LPSOLFLWYDULDWLRQDOOLNHLQFOXVLRQVLQ%DQDFKVSDFHVApplied 
mathematics and computation >@ 7LDQ63;LH 6/  DQG )X;/  )DVW DOJRULWKP RILWH UDWLYH
>@ 2ODWLQZR 02DQG 3RVWRODFKH0 6WDELOLW\ UHVXOWVIRU OHDUQLQJ FRQWURO Journal of South China University of
-XQJFNW\SH LWHUDWLYHSURFHVVHVLQFRQYH[P HWULF VSDFHV Technology (Natural Science Edition)
Applied mathematics and computation >@ :(, <DQGLQJ 5HVHDUFKRQ&RQYHUJHQW6SHHGRI,WHUDWLYH
 /HDUQLQJ&RQWURO[20] Control Theory And Applications
>@ -,$1;,1;8DQG<,1*7$12QWKHFRQYHUJHQFHVSHHGRI 
DFODVVRI+LJKHU2U GHU,/&VFKHPHVLQ proceedings of the

2017 29th Chinese Control And Decision Conference (CCDC) 7493

Authorized licensed use limited to: ULB Darmstadt. Downloaded on December 13,2022 at 03:19:26 UTC from IEEE Xplore. Restrictions apply.