Lecun 98b PDF

!#"%$'&)(*,+.-!"/$0132406575701(,+'-98:$;!$<>=?$<1$@2:A9BDCECEF6-*6*G3H@IJ6(*KMLON0 P,$C75RQT(*S IUI?$CWV
XY[Z]\;^;_a`cbed.fW_Wghghikjl^]m_Wgh_n\befMop4_Wq>\rbhseZ_Wj.stvuwxuzy9\;{lg|vm)_Egh_n\befMo9}*~n; fMo6lkRp4beik'_}
m_n\;jl}1R@ ~E|[6}!a t
ikkU\Z_Eshse_a4j1ik'_Ebeghis[.}1;6sM\rse_
6shbe_W_7sn} \;k_WZ}l4mT;; ~}>a1t
a pY[m41u4} m> dr_Eb4 o>\lghgh_W_
¡.},~r¢r£'¤;_Ebekikj9} _7beZ]\;j.
¥ .\;jlj*} ¦_Edj6{!§¨)be_Wgh_n\befMo9© \rshdsn©befEi¦d^;Zikj>\;}>k^;d;bhq1b7¨)l{lkikikghk¦ol\;_WZ_Eikshj se_© _n 9}l ¦\lgM¨)ªlbegOsn© ^;Z]*© 1_
)bhbn} ©>\j> #l« kk_Ebn}¬@©v[4_E1bM\;*4_7s[®dbe6gW¯1shbeikfM gd°cseol_4shbM\;1_W± }
q1beikj1^_Ebn}*~n;¤ ©
u®o1_fWdj6'_Ebe^;_WjlfE_ºd°{>\f7.|»q1bed;q>\;^\seikdj¼k_n\rbejlikjl^#ikg\;jl\; W_n
gh²]d³c\;´Wg4µW¶rse·>d]¸;_Eµ½ ¹ q1U\ikjºfEdZZdjq1ol_Wj1dZ_Wj1djd;{lgh_Ebe_n{6q1bM\fEseisei¦d;jl_EbegW© \j6
1j>1_EghikbM\{lk_]{_Wo>\n6ikd;beg
d;°{>\f76q bedqfn\j#{_]\n'di¦1_W3ikseoshbeikfM6g
seol\sD\be_
bM\rbe_W¾_7½1qd;gh_n¾ikjºgh_Ebeikd1gse_Ef7o1jlikfn\;%q1l{lkikfn\rsei¦d;jlgW©,u®olikgaq>\q_Ebîk'_EgaghdZ_
d °c\sej6oldgh\;_R shsebeolikfMd;6begWgD}>o>\\nj>'_dgh¿!1_E^be^g_E_EgOse½ _nql¦\;sejlo>\\sesDikdghj1_Wg)fWd;dj>°6|Ào.d]bM1se_EolbD_Ed]q ®seikdZbei¦W© \seikdjÁZ_Eseo1d61g
\rbe_®\ \j.sM\;^_Edlg*°Jdbcjl_W bM\;.j1_Es9shbM\ikjlikjl^ ©rYÀsikggho1dnjseol\s,ZdgOs)[fW¦\;ghghikfn\k±
gh_WfEdj>6|»d;bM1_7bDZ_7seold61gR\be_ikZq1bM\fEseikfn\;c°Jdb
U\rbe^_]jl_E1bM\;%j1_Es[d;be6gW©t°J_E
Z_Eseo1d61g\rbe_aq1bedqd;gh_nseol\s)1dDjld;sol\r_4seol_Wgh_akikZisM\seikdj1gW©
Â ÃlÄÅÆ!ÇaÈDÉ
Ê,Å!ËeÇÄ
241ÌWÍ>Î!C701Î*6Ïl.5E=U01Á=?K< $;C7ÐÁÎ,0 Î*(!I? C]!$;(!CE I!$5eÑ)01C7ÍÁI?$; C7*=U!Ï# IUÏ10 CE=¦5EÒ!ÓÔP,$;Ì (*K7$
=¦5
=JK
Ì0 *Ì$Î5E(*6I?I?Ð3K7=UÓÎ!I?$ -,Ìr01ÓÎ*(5E657=?0 * IUI?Ðº$ÕÌ=U$;l5;-9 *GP,$;Ì (*K7$=¦5
0 Ö×57$;ÁÑ)01C7ÍK;A
Ø0.Ñ4$< $;C;-'Ï1$r5M5E=U*Ï:=U5570Ñ40 CEÍÑ4$I?IÀ-6 *GKM01Ó$57=?Ó$;K570@Ñ40 CEÍÙ.5 IUI[- Ì K7$$;ÓÚÓ0 CE$R06Ö
66C755EÒ*6ºK7Ì=U$;*Ìr$1A1ÛD$;K7=UÏ1!=?!ÏÙ69G57CW6=?!=?!Ï]]!$5eÑ)01C7Í(*K7=U!ÏÙP* ÌWÍ>Î!CE0 ÎCE$;Ül(!=?C7$K
Ó Í>=U!Ï
Ó >Ð@K7$$;Ó=U!Ï1IUÐ@6CEP!=U57CW6CEÐDÌWÒ!01=?Ì$;KKM(9ÌWÒ] K/57Ò!$)l(*ÓÙP,$C®6*G@5eÐ>Î,$;Kv06Ö!!0G$K-
I?'Ð1$CWK->I?$;6CE!=?!ÏCE657$K-5ECE =U*=U!Ï *G¾57$;KM5DK7$r5WK-* *GKM0ÖÝ01CM5EÒ%A*ÞRÒ!$KM$]ÌWÒ*0 =JÌr$;KaÌ;6P,$
ÌrCE=¦5E=?Ì;6I[-Ð $5/5EÒ!$CE$=JK/!0ÖÝ0l01IUÎ*C70>06ÖCE$;Ì=UÎ,$ÖÝ01CvG$Ìr=JG=U*Ïa57Ò!$;ÓßP9$Ì (*KM$57Ò!$;Ð@ C7$I? C7Ï1$I?Ð
Î!C701P!I?$Óà *GG!.5W:G!$Î,$*G$;l5;A Ø
0.Ñ)$;< $C-57Ò!$;C7$a C7$RÒ!$;(!C7=JKM57=JÌK69GK70 Ó$R(!*G!$CEIUÐ>=?!Ï
57Ò!$;0 CEÐ57Ò*65
Ì ¾Ò!$;IUÎÏ1(!=?G!$@Î!CW Ìr57=U57=?0 !$;CR570Ó6Í1$:P,$r5757$;C
ÌWÒ!0 =JÌr$KA
áhÙ5EÒ!$Râ*CWKe5K7$;Ìn5E=U01P9$;IU0.ÑãÑ)$R=?15EC70G(9Ìr$aKe5W6*G*6CWGÙP*1ÌWÍ>Î!C701Î*6Ïl.5E=U01]6*GG=JK7Ì(*K7K
>(!ÓÙP,$CD06ÖK7=UÓÎ!I?$]Ò!$;(!C7=JKM57=JÌK01C5EC7=JÌWÍKaÖÝ0 CD=UÓÎ!CE0.<>=U*Ï=¦5WKÎ,$C7ÖÝ0 CEÓ *Ìr$1A*äå$Ù!$æ>5
G=?KEÌr(9K7K=JKEKM(!$K]0 ÖaÌ0 >< $;C7Ï1$*Ì$ Aäå$57Ò!$;çG$K7ÌC7=?P9$#ÖÝ$Ñéè7ÌI?1K7K7=?Ì;6IJê¾K7$;Ì0 *GL[01CEG$;C
!0 LOI?=U!$6C01Î57=?Ó=Uë.57=?0 T5E$;ÌWÒ!!=JÜl(!$;Kº6*GìK7Ò!0.Ñí5EÒ*.55EÒ!$=?C¾ Î!Î!I?=?Ì;.5E=U01ç5E0z!$(*CE I
!$r5eÑ40 CEÍ¼57CW6=?!=?!Ï¼=JK< $;C7ÐzI?=?Ó=U57$Gc-RG$;K7Î!=U57$#Ó6>ÐãÌI? =UÓK5E0¼57Ò*$ÁÌr0 l5ECE C7Ðz=?ì57Ò*$
IU=U57$;CE657(!CE$ Aî=U96I?IUÐ1-Ñ)$Î!CE$;K7$l5ÁÖÝ$;ÑïK7$;Ì0 *GL[01CEG$;CÙÓ$r5EÒ!0G!K57Ò9.5ºG0¼ Ì;Ìr$;IU$;CE657$
IU$6CE!=U*Ï=?Ìr$C75E =UÌ1KM$KA
ð ñÙò%ó®Æ*Ä
Ë7ÄôõóÄ
È÷öxò/Äò%Æ*ó®ø7ËeùcóÅ!ËeÇÄ
ÞRÒ!$CE$6CE$KM$;< $CW6I Î!Î!CE01 ÌWÒ*$;K
570Á6(!570 Ó657=JÌÓ1ÌWÒ!=?!$IU$6CE!=U*Ï*-cP!(5ÓÙ(*ÌWÒú06Ö457Ò*$
KM(*Ì;Ìr$K7KMÖÝ(!I>6Î!Î!CE011ÌWÒ!$;K/Ì6ÙP9$4Ì.5E$Ï10 CE=Uë;$;G Kû6üEý þ.ÿ Wý Wþ Wý.ü 9ÿ lû ;þ nA'ÞRÒ*$

IU$6CE!=U*ÏÁÓ ÌWÒ!=?!$ -® KÙC7$;Î!CE$;K7$l57$Gú=Uçî=?Ï (!CE$1-Ì0 ÓÎ!(5E$;KÖÝ(!*Ìr57=?0

ÑaÒ!$CE$
=JK/5EÒ!$ !L[57Ò=U*Î!(5Î*65M57$;C7/-' *G C7$;Î!CE$;K7$l5EK/57Ò!$Ì0 I?IU$Ìn5E=U01Ù06Ö, G e(*KM5E P!I?$
Î*6CW6Ó$r5E$CWK=?ú57Ò!$3KMÐKM57$ÓA Ìr0lKe5]ÖÝ(**Ìn5E=U01 !"
# $
#%r-/Ó$;1KM(*C7$K
57Ò!$G=JKEÌrCE$Î* *ÌrÐ]P,$r5eÑ4$$;! -'5EÒ!$è7Ì0 CEC7$Ìn5Wê
01C®G!$;K7=UCE$;G0 (!57Î!(5ÖÝ01CÎ*.5757$;C7& - *G
57Ò!$:0 (5EÎ!(5aÎ!CE0G(*Ìr$GP>Ð57Ò!$@K7Ð>KM57$;ÓAlÞRÒ!$@'< $;CE Ï $Ì01KM5ÖÝ(!*Ìr57=?0 ' (*) +-,/.0 =?K)57Ò*$
'< $CW6Ï1$
0 Öv5EÒ!$$CEC701CE1K 0.< $CRK7$r506Ö=U*Î!(-5 2.0 (5EÎ!(5
Î96=?CEKRÌ IUI?$;G¾5EÒ!$@57CW6=?!=?!ÏKM$5
3 :+
#¾4+ 4
6575/5758:9
;&9<-=1Aáh]5EÒ!$4K7=?ÓÎ*IU$Ke5KM$5M5E=U!Ï9-57Ò!$4IU$6CE!=?!Ï
Î!CE0 P*IU$;Ó Ì0 *K7=JKe5WK/=?
â**G=?!Ï57Ò*$]<.6I?(!$06<Ö 57Ò*65Ó=?!=?Ó=Uë;$;:K (*)#+-,7. rA*áh#Î!CW Ìr57=JÌr$1->57Ò!$]Î,$C7ÖÝ0 CEÓ6*Ì$
06Ö5EÒ!$KMÐKM57$Ó 0 º57CW6=?!=?!ÏKM$5@=JK:06ÖI?=U5M57I?$=?15E$CE$;KM5;AcÞRÒ!$Ó0 CE$ÙCE$I?$<.6l5@Ó$; K7(!CE$
=?KD57Ò*$$;C7CE0 CDCE657$Ù0 Ö57Ò*$K7ÐKe5E$Ó =U 57Ò!$â*$;I?G%-,ÑaÒ*$CE$Ù=U5:Ñ40 (!IJGÁP,$(*KM$GÁ=? Î!CW Ìr57=JÌr$1A
ÞRÒ!=?K]Î9$;CMÖÝ01C7Ó69Ìr$=?K]$;KM57=?Ó657$G P>ÐÁÓ$ K7(!C7=?!Ï357Ò*$ ÌÌ(!CW ÌrÐ 0 ú#KM$5]06ÖaK7 ÓÎ*IU$K
G=?>K e0 =?l5)ÖÝCE0 Óõ5EÒ!$:57CW6=?!=?!ÏK7$r5->Ì;6I?IU$G5EÒ!$:57$;KM5aKM$5;A!ÞRÒ!$:Ó01KM5RÌ0 ÓÓ0 !I?Ð(*KM$GºÌ01KM5
ÖÝ(!*Ìn5E=U01=?KR5EÒ!$]Q#$6@ ?Ül(*6CE$;BG ACEC701DC C
E > GF H
#; F
(*) +-,7. IJ
6Kv+
E0, E1,....Ep
Error
COST FUNCTION
Desired
Output
Output
D0, D1,...Dp
Parameters M(Z,W)
W
LEARNING
MACHINE
Input
Z0, Z1,... Zp
L<M7N ¹PO>¹ bM\;1ik_Wj.sh|»{>\;gh_Wk_n\bej1i¦j1^@Z]\;fMolikj1_©

ÞRÒ!=?KÌWÒ*6Î5E$C=JKÖÝ0Ì(*KM$G0 KM57CW.57$;Ï =?$;KÖÝ01C=?ÓÎ*C70.<>=?!Ï:57Ò!$Î*C70Ìr$K7K06ÖcÓ=U!=?Ó=Uë;=U*Ï
57Ò!$ºÌ01KM5ÖÝ(!*Ìr57=?0 %AØ0.Ñ4$< $;C;-,5EÒ!$;K7$Ke5ECE657$;Ï =?$;K@ÓÙ(9Ke5ÙP,$(*K7$;Gú=?¼Ìr0 Qe(!*Ìn5E=U01úÑa=¦5EÒ
Ó$57Ò!0G!KÖÝ0 CÓ.æ=?Ó=?ë=?!Ï357Ò*$!$r5eÑ40 CESÍ R K@6P*=UI?=¦5eÐÁ570Áû ü7ý k/ÿ T r-/57Ò*65]=?K;-c570Î!CE$;G!=?Ìr5
57Ò!$Ìr0 CECE$;Ìn5R5W6CEÏ $r5WKaÖÝ01CÎ*.5757$;C7*K57Ò!$IU$6CE!=?!ÏKMÐKM57$;Ó Ò*1Ka!0 5DÎ!CE$<>=?0 (*K7IUÐ3KM$;$ÖÝ01C

Ó01C7$G$5E =UUI nA

Þ/0 (!*G$;CEKM5E *G¼Ï $;!$CW6I?=?ë;.5E=U01%-/I?$r5(*KÌr01*K7=?G$;CÒ*0.Ñ P* ÌWÍ>Î!CE0 Î* Ï1657=?0 úÑ)01C7ÍK;A
ä $#KM5E6C75Ña=¦5EÒTúK7$r506Ö@K7 ÓÎ!IU$K$;1ÌWÒç06Ö:ÑaÒ!=JÌWÒã=JK6ã=U!Î*(-5 2.0 (5EÎ!(5Î* =UC0 Ö
57Ò*$
ÖÝ(!*Ìn5E=U01º5E0P,$@IU$6CE!$;G%A ?>=?*Ì$D5EÒ!$@Ó$; K7(!CE$Ó$l54Î!C70Ì$;KEK=JK406Ö×57$;¾*0 =JKMÐ1-15EÒ!$CE$:Ó'Ð
P9$ú$CECE0 CWK=?57Ò*$úKE6ÓÎ!I?$;K;A4ä $¼Ì =?Ó6Ï =?!$ 57Ò*65=UÖÑ4$úÌr0 I?I?$;Ìn5E$;GxÓ(!IU57=?Î!IU$
06Ö4KE6ÓÎ!I?$;K:5EÒ!$ú$ ÌWÒúKM$5@Ñ40 (*I?G IU0>01Í 3IU=U5M5EIU$G/= V$CE$l5]P9$Ì (*KM$0 Ö57Ò*$!0 =JKM$ *G

P9$Ì6(9KM$R06Ö,57Ò*$GW= V$CE$l5Î,0 =?l5EKKE6ÓÎ!I?$;GcXA A) ÌWÒ06Ö,57Ò!$KM$G!65E@K7$r5EK®Ñ40 (*I?G6IJK70DCE$;K7(!IU5

=U!$5eÑ)01C7ÍKÑa=¦5EÒÓ=?!=?Ó:57Ò*656CE$RK7I?=UÏ1Ò15EIUÐGW= V$CE$l5ÖÝCE0 Ó$; ÌWÒ065EÒ!$C *GÙÖÝC701ÓÚ57Ò*$
57CE(!$ÖÝ(**Ìn5E=U01%A.áh]5EÒ!=?K®ÌWÒ* Î57$;C;-Ñ4$4Ì0 *Ì$l57CW.5E$0 =UÓÎ!CE0.<>=U!Ï
57Ò!$4Î!CE0Ìr$;KEKv06Ö!â*9G=U*Ï
57Ò!$RÓ=U*=UÓ(!ÓßÖÝ0 C5EÒ!$)Î96C757=JÌr(!IJ6C®KM$506Ö*$æ ÓÎ!IU$Kv57Ò*65Ñ4$4 C7$4Ï =?< $;%A.8:$!$;CE IU=?ë;657=?0
57$;ÌWÒ*!=?Ül(!$K5EC7Ð35E03Ì0 CEC7$Ìn5ÖÝ01C57Ò*$$;C7CE0 CWKa=?15EC70G(9Ìr$;G =Ul5E057Ò*$!$5eÑ)01C7Í KDCE$;K7(!IU5
06Ö®0 (!CaÌWÒ!01=?Ì$:0 Ö®G*.5E1KM$5;A!24065EÒ3 C7$@=?ÓÎ901CM5W6l5;A
?>$<1$CW6Ia5EÒ!$01C7$57=JÌ6ID4$ V0 C75EK¾Ò*'< $Á *6I?Ð>ë$GT57Ò!$åÎ!CE0>Ì$;KEK06Ö]I?$; C7*=U!ÏçPlÐìÓ=?!=¦L
Ó=?ë=?!Ï5EÒ!$$CECE0 C0 ¼35ECE =U!=?!ÏÁK7$r5 ÀÎ!CE0>Ì$;KEKKM01Ó$r57=?Ó$;KÌ6I?I?$;G AÓÎ!=?C7=JÌ INa=JKMÍ
Q#=U*=UÓ=?ë;.5E=U01 - OA
?>0 Ó$
0 Ö%57Ò*01K7$57Ò*$0 CE$r5E=?Ì;6I6* IUÐK7$;K)6CE$P* K7$;G0 ¾G!$;Ìr01ÓÎ90lKM=?!Ï5EÒ!$DÏ1$!$;CE IU=?ë;6L
57=?0 $CECE0 C=?l570@5eÑ4057$;C7ÓDK C P!=J K)6*G<.6CE=J6*Ì$ »K7$$$1A Ï9A E *nAlÞRÒ!$P!=J K=?K)Ó$; K7(!CE$
06Ö9Ò*0.ÑzÓÙ(*ÌWÒÙ57Ò!$R!$5eÑ)01C7Í@01(57Î!(!5;-6'< $;CE Ï $G@0.< $C®6I?I>Î90lK7K7=?P!IU$RG!65E@KM$5EK®G/= V,$;CEKvÖÝCE0 Ó
57Ò!$
G!$;K7=UCE$;GÙÖÝ(!*Ìr57=?0 %AlÞRÒ!$<.6CE=? *Ìr$R=JK@Ó$;1KM(!CE$R06ÖÒ!0.ÑTÓÙ(*ÌWÒ57Ò*$!$r5eÑ40 CEÍ0 (!57Î!(5
<' C7=?$;K)P,$r5eÑ4$$3G!.5W K7$r5WK$A A C7I?Ð=U¾57CW6=?!=?!Ï*-157Ò!$@P!=J K)=JK)IJ6CEÏ $DP9$Ì (*KM$D57Ò*$D!$5eÑ)01C7Í
0 (5EÎ!(5D=JK
Ö»6CÖÝCE0 Óï5EÒ!$G$KM=?CE$;G3ÖÝ(!*Ìr57=?0 %AÞRÒ!$<' C7=J69Ìr$]=JK<1$CEÐ3K7Ó6I?I/P,$;Ì (*K7$]57Ò*$
G!.5WÒ* K
Ò* G3I?=¦5757I?$Ù=? *(!$;*Ìr$]Ð1$r5A*"/657$]=?57CW6=?!=?!Ï*-5EÒ!$]P!=J K=?KDKMÓ6I?I%P,$;Ì;6(*K7$57Ò*$
!$r5eÑ40 CEÍÒ* KDIU$6CE!$;GÁ57Ò!$(!*G!$CEIUÐ>=?!ÏºÖÝ(**Ìn5E=U01%A%Ø0.Ñ4$<1$C-*=UÖ57CW6=?!$G570>03IU01!Ï*-,57Ò*$
!$r5eÑ40 CEÍÑa=?I?I I?K70]Ò*'<1$I?$;6CE!$G57Ò!$:!01=?K7$DK7Î9$Ìr=Uâ9Ìa5E0Ù5EÒ*.5RG!.5W K7$r5AlÞRÒ!=JK4=?K)CE$rÖÝ$CECE$;G
570# K:0.< $;CM5ECE =U*=U!Ï9A*áh¼K7(*ÌWÒ Ì1KM$1-,57Ò!$<.6CE=? *Ìr$Ña=?IUIP,$I? C7Ï1$P,$;Ì;6(*K7$Ù5EÒ!$!01=?K7$
<' C7=?$;KP,$r5eÑ4$$;G!65E1KM$5EK;AáO5Ì;6ÙP,$aKMÒ*0.Ña]57Ò9.557Ò*$4Ó=?!=?ÓÙ(!Óß5E065W6I$CECE0 CÑa=UI?I0ÌÌr(*C
ÑaÒ!$357Ò*$]KM(!Ó 06ÖP!=?1Ka6*G3<.6CE=J6*Ì$: C7$@Ó=U*=UÓ6I[A
ÞRÒ!$CE$3 C7$#å>(!ÓÙP,$C0 Ö
5E$;ÌWÒ!!=JÜl(!$;K Ý$ A Ï*A$6CEIUÐzKM5701Î!Î!=?!Ï*-CE$Ï1(!IJ6CE=Uë.57=?0 ÖÝ01C
Ó6æ=UÓ=?ë=?!Ï57Ò!$Ï1$!$;CE IU=?ë;657=?0 ¾ P!=?IU=U5eÐ06Ö!$r5eÑ40 CEÍÑaÒ!$;3(9KM=?!ÏP* ÌWÍ>Î!CE0 Î/A
ÞRÒ!$ú=?G$ç0 ÖÙ5EÒ!=?K#ÌWÒ96Î5E$C-)5EÒ!$CE$rÖÝ01C7$1-R=?K35E0TÎ*C7$KM$;15Ó=U*=UÓ=?ë;.5E=U01 KM57CW.5E$Ï1=U$K
ÝÏ =?< $;ÁºÌ01KM5ÖÝ(!*Ìr57=?0 D6*G35EÒ!$]5EC7=JÌWÍK
1K7K70Ìr=J.57$GÑa=¦5EÒÁ=?*ÌrCE$;1KM=?!Ï57Ò*$K7Î9$;$;GÁ *G
Ü1(96I?=¦5eÐz0 Ö
5EÒ!$Ó=?!=?Ó=Uë.57=?0 /AáO5=?KÒ!0.Ñ4$<1$CÌrI?$;6C5EÒ*.55EÒ!$#ÌWÒ!0 =JÌr$306ÖD57Ò!$#Ó0G$I
ÝÓ0G$I%K7$I?$;Ìr57=?0 r-15EÒ!$6CWÌWÒ!=U57$;Ìr57(!CE$D *Gº57Ò!$Ìr0lKe54ÖÝ(!*Ìr57=?0 3=?KRÌC7(*Ì=? I,ÖÝ0 CR0 P5W6=?!=?!Ï
!$r5eÑ40 CEÍ]5EÒ*.5)Ï $*$CW6I?=Uë;$;KÑ4$I?IÀA ?>0]Í1$$Î=?Ó=U9G57Ò*65)=UÖc57Ò!$
ÑaC701!ÏÓ0>G!$IÌrIJ KEK=?K
(*KM$GÙ *G!0:Î!CE0 Î,$CÓ0G$;IKM$;IU$Ìn57=?0 Ù=?K®G01!$ -;57Ò!$;$;< $;Ù
K7(!Î,$CEPÙÓ=U*=UÓ=?ë;.5E=U01ÙÑa=?IUI
ÌrI?$;6CEI?Ð!065RÒ!$I?Î< $;C7ÐÓÙ(9ÌWÒ%AáhºÖ»1Ìn5->57Ò!$@$ræ=JKe5E$*Ì$@06Ö/0.<1$C757CW6=?!=U*ÏÙÒ*1K)I?$;G3K7$< $;CE I
6(5EÒ!0 CWKR570¾KM(!Ï1Ï $Ke5a5EÒ*.5
=?*1ÌÌr(*CE657$Ó=U*=UÓ=?ë;.5E=U01 6I?Ï 01C7=U57Ò*ÓKaÌ;6#P,$]P,$r5M5E$CD57Ò*
Ï 0>0Gº01!$;K;A

4Å>óÄDÈó®Æ*ÈúóÊ DÆ!Ç
ó®ôóÅ!ËeÇ)Ä
IU57Ò!01(!Ï Òú5EÒ!$5EC7=JÌWÍKÙ69G¼6* IUÐK7$;K=?ú57Ò!=JKÎ*6Î,$C6CE$Î!C7=?Ó6CE=UI?Ð Î*C7$KM$;15E$;Gú=?¼57Ò*$
Ìr0 l5E$ræ>5Ù06ÖèEÌrIJ KEKM=JÌ I?ê3ÓÙ(*I¦5E=¦LOI?'Ð1$CÖÝ$;$;G>L[ÖÝ0 CEÑR6CWG *$(!CW6I*$r5eÑ40 CEÍ>K;-%Ó6>Ðå06ÖR57Ò*$Ó
6IJKM06Î*Î!IUÐ570Ó01KM50657Ò*$CaÏ CW G!=U$;157L[P9 K7$;GI?$; C7!=?!ÏÓ$r5EÒ!0G!KA
ÞRÒ!$)K7=UÓÎ!I?$;KM5/ÖÝ01C7Ó 0 Ö!ÓÙ(!IU57=?I?'Ð1$C%I?$; C7*=U!Ï
Ó1ÌWÒ!=?!$5ECE =U!$GÑa=U57Ò]Ï1CE1G=U$;l5MLOP* K7$;G
IU$6CE!=U*ÏD=JKK7=UÓÎ!I?ÐÙ@Ke5W ÌWÍ]0 Ö9Ó0G(!I?$;K;-6$;1ÌWÒ0 Ö9ÑaÒ!=JÌWÒ=UÓÎ!I?$Ó$l5WKDÖÝ(!*Ìn5E=U01 .
. .
. n-lÑaÒ!$CE $ . =?K)]<1$;Ìn5E0 CCE$Î*C7$KM$;15E=U*Ï@57Ò!$D0 (5EÎ!(5)0 Ö57Ò!$DÓ0G(*IU$1- .
=?K)57Ò*$:<1$;Ìr570 C4+ 06Ö/57(!* P!I?$:Î96CW6Ó$r5E$CWK=?5EÒ!$@Ó0G(*IU$ »K7(!P*K7$r5R06Ö r-6*G . + =?K
57Ò!$:Ó0>G!(!IU$ R K)=?!Î!(5R< $Ìn5701C À K)Ñ)$;IUIc K57Ò!$:Î!CE$<>=?0 (*KÓ0G(*IU$ R K40 (!57Î!(5R< $Ìn5E0 C-nA1ÞRÒ*$
=U!Î*(5 :5E0Ù5EÒ!$:â*CEKM5RÓ0G(*IU$@=JK5EÒ!$@=U*Î!(5aÎ*.5757$;C7@ 1A>áOÖ/57Ò*$:Î96C757=J6IcG$CE=?<'657=?< $D06Ö
ÙÑa=¦5EÒºCE$;K7Î9$Ìn54570 . =?K4Í>!0.Ña%-157Ò*$¾57Ò!$:Î*6C757=J6IG$;C7=?<..57=?< $K0 Ö ÙÑa=U57Ò¾C7$KMÎ,$;Ìr5
570 .¾ *G . + Ì ¾P,$]Ìr01ÓÎ*(57$G¾(9KM=?!Ï57Ò!$P9 ÌWÍ>Ñ4 CEGºC7$Ìr(!CECE$*Ì$
.
.
. + .
G
. + .
. + .
ÑaÒ!$CE$ .
. + a=?K57Ò!$ l Ì0 P!=J60 Ö Ña=U57Ò#CE$;K7Î9$Ìn55E0 $<.6I?(*657$;G#6557Ò*$
Î901=Ul!5 .
. + n-6*G
.
. + =?K
57Ò*$l Ìr01P!=J606Ö Ña=U57Ò CE$;K7Î,$;Ìn5
570 çA
ÞRÒ!$ 11Ìr01P!=? º0 Ö®<1$;Ìn5E0 C4ÖÝ(!*Ìr57=?0 #=JKaÓ.57CE=Uæ¾Ìr0115W6=?!=?!Ï57Ò!$Î* CM5E=? I%G$CE=?<'657=?< $K
06Ö]6I?I5EÒ!$Á0 (!57Î!(5WKºÑa=U57ÒxCE$;K7Î,$;Ìn5º570ç IUI
57Ò!$Á=?!Î!(!5EK;A)äxÒ!$;x57Ò*$ 6P,0.< $#$Ü1(9.57=?0 9K
6CE$3 Î!Î!I?=U$Gz5E0 5EÒ!$#Ó0G(!I?$;K=?ãCE$<1$CWKM$¾0 CWG$C-ÖÝC701Ó I?'Ð1$C 5E0úI?'Ð1$BC -6I?IR57Ò*$
Î*6C757=J6I,G$CE=U<.657=?< $;K06Öc5EÒ!$DÌ01KM5ÖÝ(!*Ìr57=?0 ¾Ña=¦5EÒC7$KMÎ,$;Ìr55E06I?I!5EÒ!$:Î*6CW6Ó$r5E$CWKÌ P,$
Ìr0 ÓÎ!(!57$;G%A*ÞRÒ!$ÑR'Ð06ÖÌ0 ÓÎ!(5E=U*ÏÏ CW G=?$l5EK4=JKaÍ>!0.Ña K4P* ÌWÍlLOÎ!CE0 Î* Ï1.5E=U01%A
Þ/CW G=U57=?0 96IlÓÙ(!IU57=UL[IJ'Ð $;C/!$;(!CW6I>!$r5eÑ40 CEÍK/ C7$4DK7Î9$Ìr=J6IÌ1KM$)06Ö!5EÒ!$R6P,0.< $)K7ÐKe5E$Ó
ÑaÒ!$CE$:57Ò!$Ó0G(!I?$;Ka C7$6IU57$;C79.57$GIJ'Ð $;CEK406ÖÓ.57CE=UæºÓÙ(!IU57=?Î!I?=?Ì;.5E=U01*K ×5EÒ!$Ñ4$=?Ï Òl5E K
6*G3Ìr01ÓÎ,0 *$l5MLOÑa=?K7$KM=?Ï Ó01=?GºÖÝ(!*Ìr57=?0 *K Ý57Ò!$(*!=¦5W#K 4C
. . . + E
. .
ÑaÒ!$CE$ .¾=JKÓ.57CE=UæºÑaÒ!01K7$@>(!ÓÙP,$C0 Ö®Ì0 I?(!Ó*Ka=JKR57Ò*$]G=UÓ$;*KM=?0 0 Ö . + -* *G
l(*ÓÙP,$CÙ0 ÖaC70.ÑK@=JK5EÒ!$¾G=?Ó$*K7=?0 ¼06Ö .,A ï=JKÙ<1$;Ìn5E0 CÖÝ(**Ìn5E=U01ú57Ò*656Î*Î!IU=?$;KÙ
KM=?Ï Ó0 =JG ÖÝ(!*Ìr57=?0 ú570#$ ÌWÒúÌr01ÓÎ,0 *$l5]06Öa=U5EK=?!Î!(5A . =?K]57Ò!$<1$;Ìn5E0 C0 ÖRÑ4$=?Ï Òl5E$;G
KM(!ÓK;-!0 C hý %ÿ n-570IJ'Ð $CA
Î!Î!I?Ð>=U*Ï57Ò!$DÌWÒ*6=?C7(*IU$a5E057Ò*$$;Ül(*657=?0 6P,0.< $1-.57Ò*$
ÌrIJ KEKM=JÌ I!P*1ÌWÍlÎ*C701Î*6Ïl.57=?0

$;Ül(*.5E=U01*Ka6CE$:0 P5W6=?!$;G C
, ., G,
. .
G
.,! . + ., #"
., $ , 5 &
.$ + J , % .
ÞRÒ!$]6P,0.< $:$;Ül(*657=?0 *KaÌ;66IJKM0P9$ÑaCE=U5M57$;=UÓ.5EC7=UæÖÝ0 CE'Ó C
' # . )(X
. .
. G *
. +.
G
. + ,. + . 5 -
ÞRÒ!$KM=?ÓÎ!IU$Ke5aI?$; C7!=?!'Ï ÝÓ=?!=UÓ=?ë;657=?0 4Î!CE0Ìr$G(!CE$:=?KM(*ÌWÒKM$5M5E=U!Ï=JK457Ò!$Ï1CE6L
G=U$;l5
G$;KEÌr$;15 IUÏ10 CE=¦5EÒ!ÓÑaÒ!$;C7$ =JKa=U57$;CE657=?< $I?Ð PG e(*Ke5E$;G K4ÖÝ01IUI?0.ÑDK C
/.% /. F F10 5 %
áh 5EÒ!$KM=?ÓÎ!IU$Ke5Ì1KM$1- 0 =?K@3K7Ì;6IJ6C@Ìr01*Ke5W6l5;AQ#01C7$KM01Î!Ò!=JKe5E=?Ì;.5E$;GÁÎ*C70Ìr$G(!CE$;KD(*K7$
<' C7=J6P*IU$ 0 AáhT065EÒ!$CÓ$r5EÒ!0G!K 0 5W6Í $K]5EÒ!$3ÖÝ0 CEÓ 06Ö@ G=J6Ï10 * I)Ó657CE=¦æc-®0 C=JK
$;KM57=?Ó657$¾06ÖR57Ò!$¾=U><1$CWKM$Ø
$;KEKM=J6¼Ó.5EC7=Uæú06Öa57Ò*$ºÌr0lKe5ÖÝ(!*Ìn5E=U01 »K7$;Ì0 *G¼G!$CE=U<..5E=U<1$
Ó657CE=¦æ K7(*ÌWÒz1K]=?¼57Ò!$ $ÑR5E0 ç *G D(*1KM=UL
$ÑR5E0 úÓ$r57Ò*0>G*KG$K7ÌC7=?P,$;GúIJ.57$;CÙ=?
57Ò!$ÌWÒ* Î57$;C;SA Î!C701Î9$;CÌWÒ!0 =JÌr$06Ö 0 =JK@=?ÓÎ,0 C75E l5@ *GÁÑa=?IUIP,$G=JK7Ì(*K7K7$;G .5@IU$;!Ï65EÒ
I?657$CA
a
ò Æ!óÊ,Å!ËMÊóø Æ9ËMÊ
241ÌWÍ>Î!C701Î*6Ïl.5E=U01Ì63P,$< $CEÐK7IU0.ÑÎ96C757=JÌr(!IJ6CEIUÐÖÝ01CaÓÙ(!IU57=?IJ'Ð $CE$;Gº!$r5eÑ40 CEÍK4ÑaÒ!$CE$
57Ò!$#Ìr0lKe5KM(*CMÖ»1Ìr$3=?K5eÐ>Î!=JÌ6I?I?Ðå*0 LhÜl(* GCW.5E=?Ì -v*0 LhÌr01l<1$ræc-v *GzÒ*=UÏ1ÒTG=?Ó$*K7=?0 * I
Ña=¦5EÒ Ó6>ÐI?0>Ì;6I®Ó=U*=UÓ36*G 2.0 C 9.5@CE$Ï =?0 9KAÞRÒ!$CE$=?K:!0¾ÖÝ0 CEÓÙ(!IJ5E0¾Ï1(*6CW6l5E$$
57Ò*6:5 /5EÒ!$a!$r5eÑ40 CEÍÑa=?IUI*Ì0 >< $;C7Ï1$5E0@:Ï10l0GKM01IU(!57=?0 %"- E ®Ìr01>< $CEÏ $;*Ìr$)=?KK7Ña=UÖ×5;-601C
Ìr01l<1$CEÏ $;*Ìr$a$;< $0Ì;Ìr(!CWK6546I?I[AlØ
0.Ñ)$;< $C-6=?57Ò*=?K4KM$Ìn5E=U01Ñ)$DG=?KEÌr(9K7K4>(!ÓÙP,$C
06Ö5EC7=JÌWÍK5EÒ*.5Ì ÁÏ CE$;657I?Ð¾=?ÓÎ!C70.<1$]5EÒ!$ÌWÒ96*Ì$;KD06Öâ**G!=U!ÏÏ10>0>G KM01IU(!57=?0 ÁÑaÒ!=?I?$
6IJKM0
G!$;ÌrCE$;1KM=?!Ïa5EÒ!$)Ì0 >< $;C7Ï1$*Ì$®57=?Ó$)0 Ö×57$ÙPlÐ@01CEG$;CEK%06Ö*Ó6Ï1!=U57(*G$1AQÁ0 CE$G$r5W6=?IU$G
57Ò!$;0 CE$r57=JÌ I e(*KM57=Uâ9Ì657=?0 *KRÑa=?IUI/P9$Ï1=U<1$3=UIJ.57$;CKM$Ìn5E=U01*KA
!"$#&%(')*,+!-/.0%12')3"034
45º$;1ÌWÒx=¦5E$CW.57=?0 /-$;Ül(*657=?0 CE$;Ül(!=?C7$KzÌ0 ÓÎ!I?$r57$#Î9 KEK57Ò*C701(!Ï ÒT57Ò*$Á$l57=?CE$
G!.5W K7$r5=?#0 CWG$Ca5E0ºÌr01ÓÎ!(57$]57Ò!$¾6ý 5 ü7ý;û
0 Ca5EC7(*$]Ï CW G=?$l5A*ÞRÒ!=JK=JKaC7$ÖÝ$CEC7$G¾570º1K
P*.5WÌWÒI?$; C7*=U!ÏK7=U9Ìr$6$l5E=UCE$èMP*65EÌWÒ*ê:0 ÖG!65E:ÓÙ(9Ke5P,$Ìr01*K7=?G$;C7$GÙP,$rÖÝ01C7$aÑ4$=?Ï Òl5WK

6CE$ (!ÎG!.5E$;GcA
I¦5E$( CE*.5E( =U<1$I?Ð -R0 *$ Ì (*K7$úKe5E0>ÌWÒ9 KM57=JÌ Ý01!I?=U!$ ¾IU$6CE!=U*ÏçÑaÒ!$;C7$å
Wÿ >û a$ræ! ÓÎ*IU$ 3
; ==JKÌWÒ!01K7$ Ý$1A Ï9A!CW6*G01ÓIU"Ð )ÖÝCE0 Ó 5EÒ!$57CW6=?!=?!ÏKM$5
.5$ ÌWÒ
=¦5E$( CW.57=?0 .nXA
[ÿ ý 06Ö,57Ò!$57CE(!$aÏ CW G=?$l5=JK®57Ò!$;Ìr01ÓÎ*(57$GP9 K7$;G0 57Ò*$$CEC701C

0 Öv5EÒ*.5a$ræ! ÓÎ*IU$1-*6*Gº57Ò*$357Ò!$Ñ4$=?Ï Òl5WKa6CE$D(!ÎG!657$;G C

(
. 7 < /%. F10 5 %X
2)$Ì (*KM$57Ò!=JK/$Ke5E=UÓ657$0 Ö57Ò!$)Ï CW G=?$l5/=JK%*0 =JKMÐ1-5EÒ!$Ñ4$=?Ï Òl5EK/Ó'ÐD!0 5vÓ0.< $Î!C7$Ìr=JKM$;IUÐ
G0.Ña57Ò*$)Ï1CE1G=U$;l5v.5$; ÌWÒÙ=¦5E$CW.57=?0 /A DK/Ñ4$)K7Ò*6I?I>KM$;$ -;57Ò!=JK:èM!01=?K7$;ê65v$ ÌWÒ]=U57$;CE657=?0
Ì6 P9$ G<. 15W6Ï1$0 (9KSA ?l570ÌWÒ*1Ke5E=?ÌÙIU$6CE!=U*Ïº=JK
Ï1$!$;CE IUI?Ð357Ò!$Î!CE$rÖÝ$CECE$;GÓ$r5EÒ!0GÁÖÝ01C
P* K7=?Ì:P*1ÌWÍ>Î!C701Î*6Ïl.5E=U01ÖÝ0 CR5EÒ!$@ÖÝ0 I?IU0.Ña=?!Ï57Ò!CE$$CE$;1KM01*DK C
89 #!:3;!4<%1=&>?!"A@B%12')3C"3C4
A ?l5E0>ÌWÒ9 KM57=JÌI?$;6CE!=?!Ï=?K4(*K7(*6I?I?Ð : D @Ö»1Ke5E$C457Ò963P*.5WÌWÒºI?$;6CE!=?!Ï*A
E A ?l5E0>ÌWÒ9 KM57=JÌDI?$; C7*=U!Ï6IJK700 Ö×57$;3CE$;K7(!IU5EKR=?¾P,$r5757$;C
KM01IU(!57=?0 *K;A

!A ?l5E0>ÌWÒ9 KM57=JÌDI?$; C7*=U!ÏÌ ¾P,$(*K7$;G¾ÖÝ0 CR5ECE1ÌWÍ>=U!ÏÌWÒ* !Ï $KA

?l570ÌWÒ*1Ke5E=?ÌIU$6CE!=U*Ï
=JK/Ó01KM5®06Ö×57$; : D aÖ» KM57$;C/5EÒ*6P*.5WÌWÒÙI?$; C7!=?!ÏÎ96C757=JÌr(!IJ6CEIUÐ
0 IJ6CEÏ $aCE$;G(**G!6l5)G*.5E1KM$5EK;AlÞRÒ*$
CE$; K70 ÖÝ01C57Ò*=?K)=?K4K7=UÓÎ!I?$5E0K7Ò!0.ÑA>&)01*KM=JG$;C57Ò*$

KM=?ÓÎ!IU$3Ì1KM$¾ÑaÒ!$CE$¾5ECE =U*=U!ÏåKM$50 Ö
KM=?ë$ =JKÙ=?* G!< $C757$;l57I?ÐåÌ0 ÓÎ90lKM$G¼06Ö
=?G$;l57=JÌ6IvÌr0 Î*=U$Ka06ÖK7$r5
Ña=U57Ò K7 ÓÎ!IU$KA < $;CE Ï =?!Ï57Ò!$]Ï1CE1G=?$l50.< $;C6I?<I
Î*.5757$CE*KÙÏ =?< $;K]57Ò!$¾$ræ! Ìr5KE6Ó$CE$;K7(!I¦5 KÌr0 ÓÎ!(!57=?!Ï#57Ò*$ºÏ CW G!=U$;15P* K7$;Gú01' e(*Ke5
57Ò!$3â*CWKe@5 AÞRÒ>(*K;-P*.5WÌWÒçÏ1CE1G=U$;l5G$K7Ì$l5=?KÑR KM57$ÖÝ(!IaP,$;Ì (*K7$¾=U5C7$Ìr01ÓÎ*(57$K
57Ò!$KE6Ó$Ül(*6l5E=¦5eÐ 57=?Ó$KP,$rÖÝ0 CE$0 *$Î*6CW6Ó$r5E$C@(!ÎG!.5E$ ABD 5EÒ!$065EÒ!$CÒ96*Gc-
Ke5E0>ÌWÒ9 KM57=JÌÁÏ CW G!=U$;153Ña=UI?IKM$;$åzÖÝ(!I?I$Î,0>ÌWÒ K =¦5E$CW.57=?0 9K5EÒ!C701(!Ï Ò LOI?0 !Ï
57CW6=?!=U*ÏK7$r5A%áhúÎ!CW Ìn5E=?Ì$ -c$æ ÓÎ!IU$K@CE C7$;IUÐÁ Î!Î,$;6C@Ó0 CE$57Ò* ú0 *Ì$=?¼#G!.5W K7$r5-
P!(5:57Ò!$;C7$Ù C7$Ù(*KM(96I?IUÐ#ÌrI?(*KM57$;CEK
06ÖÎ*65M57$;C79K5EÒ*.5@6CE$]< $;C7ÐKM=?Ó=UIJ6CA9î*0 CD$ræ!6ÓÎ!I?$Ù=?
Î!Ò!0 *$Ó$ÌrIJ KEKM=Uâ9Ì657=?0 %- IUIc0 Ö/57Ò*$:Î9.5M5E$CE*K4ÖÝ0 CR5EÒ!$@Î!Ò!01!$Ó$ 2:2ÙÑa=?IU<I »Ò!0 Î,$rÖÝ(!I?I?$Ð
Ìr0 l5W6=?]ÓÙ(*ÌWÒ06Ö!5EÒ!$RK7 Ó$4=?ÖÝ0 CEÓ.57=?0 /A;áO5=JK/5EÒ!=JKvCE$;G!(!*G! *ÌrÐ:57Ò9.5Ì6Ó6Í $)P*.5WÌWÒ
IU$6CE!=U*ÏÓ(*ÌWÒKMI?0.Ñ)$;C457Ò* ¾01L[I?=?!$ A
?l570ÌWÒ*1Ke5E=?Ì
IU$6CE!=U*Ï I?K70Ù0 Ö×57$¾C7$KM(*I¦5WK)=?3P9$5M57$;CaKM01IU(5E=U01*K4P9$Ì (*KM$:06Ö/57Ò!$@!01=?K7$
=U5EÒ!$:(!Î,G*.57$K1A 01!I?=U!$6C)!$r5eÑ40 CEÍK(*K7(*6I?I?ÐÒ*'<1$ÓÙ(*I¦5E=UÎ!I?$:IU0Ì I*Ó=?!=UÓÙ06Ö/G/= V,$;CML
=U!ÏG$Î5EÒ*K;AlÞRÒ!$DÏ 0l6I!0 Öc57CW6=?!=U*Ï=?K570]I?0Ì657$01!$06Öc5EÒ!$;K7$Ó=?!=UÓ*Al2R.5WÌWÒIU$6CE!=?!Ï
Ña=UI?I%G=JK7Ì0.< $C57Ò!$@Ó=?!=UÓ(!Ó0 Ö/ÑaÒ*.5E$<1$C4P* K7=U¾57Ò*$DÑ4$=?Ï Òl5EKR C7$D=U!=U57=J6I?I?ÐÎ!IJ Ìr$GcA>áh
Ke5E0>ÌWÒ9 KM57=JÌIU$6CE!=U*Ï*-c5EÒ!$!01=?K7$Î!CE$;K7$l5]=Uú5EÒ!$(!ÎG!657$;KÌ åCE$;K7(!IU5Ù=?ú57Ò!$Ñ4$=?Ï Òl5WK
e(!ÓÎ!=U*Ïå=?l570 57Ò!$P*1KM=?ç0 Ö: !065EÒ!$C-vÎ,01KEK7=UP!I?ÐçG$;$Î,$C-®IU0Ì IRÓ=?!=?ÓÙ(!ÓAÞRÒ!=JKÒ*1K
P9$;$#G$Ó01*Ke5ECE657$Gº=?#Ìr$C75E =UK7=UÓÎ!I?=¦â9$;GÌ1KM$K "!- [A
?l570ÌWÒ*1Ke5E=?ÌDIU$6CE!=?!Ï=JKa6IJK70(*K7$rÖÝ(*I%ÑaÒ!$¾57Ò*$DÖÝ(**Ìn5E=U013P,$=?!ÏÓ0G$I?$;G¾=?KaÌWÒ96!Ï L
=U!Ïã0.< $;C57=?Ó$ -RçÜl(!=U57$ Ì0 ÓÓ0 KEÌr$;*6CE=U0ç=U=?*G(9Ke5EC7=J6I:6Î!Î!I?=JÌ.5E=U01*KÑaÒ*$CE$Á57Ò*$
G!.5WG=JKe5EC7=?P!(5E=U01ÁÌWÒ*6!Ï1$;KRÏ1CE1G(*6I?I?Ð0.< $;Ca57=?Ó$ Ý$1A Ï9A9G(!$]570Ñ4$; C
6*G¾5E$;6CD06Ö®57Ò*$
Ó1ÌWÒ!=?!$; K nAcáOÖ)57Ò!$I?$; C7!=?!Ï¾Ó1ÌWÒ!=?!$G0>$;K@!0 5G!$r57$Ìn5]69GÁÖÝ01IUI?0.Ñß57Ò*$ÌWÒ*6!Ï1$=U5=?K
=UÓÎ,01KEKM=?P!I?$
5E0I?$; C7º57Ò!$G!65EÎ!CE0 Î,$CEIUÐ69GIJ6CEÏ $:Ï $*$CW6I?=Uë.57=?0 $;C7CE0 CWKÑa=?I?IcC7$KM(!IU5;A
äx=¦5EÒzP*.5WÌWÒúIU$6CE!=U*Ï*-%ÌWÒ* !Ï $KÏ 0(!*G!$r57$Ìn5E$;Gz *GåÑ)$01P5E =U¼CW.5EÒ!$CP*1GúC7$KM(*I¦5WK
KM=?*Ìr$¾Ñ)$6CE$I?=UÍ1$I?Ðå570ú'< $CW6Ï1$0.< $;CÙKM$;< $;CE ICE(!IU$K-ÑaÒ!$;C7$ K0 LOIU=?!$¾IU$6CE!=U*Ï å=UÖ
0 Î,$CW.57$G#Î!CE0 Î,$CEIUÐ ÀKM$;$ÙP,$I?0.ÑÚ=UåKM$Ìn5E=U01 A!Q( Ña=?IUIv57CW ÌWÍ35EÒ!$ÌWÒ96!Ï1$;K
*GÁÐ>=?$IJG
Ï 0>0G¾ Î!Î!CE0'æ>=?Ó.5E=U01ºCE$;K7(!I¦5WKA
Û
$KMÎ!=U57$
57Ò!$: G<. 15W6Ï1$;K®06Ö/KM570ÌWÒ*1Ke5E=?ÌRI?$; C7*=U!Ï9-65EÒ!$CE$
6CE$
KM57=?IUI,CE$; K70 9K®ÑaÒlÐ0 *$
Ó=?Ï Òl5
Ì0 *K7=?G!$CR(*K7=U!ÏP*65EÌWÒI?$;6CE!=?!Ï C
8 9 #!!3;:4&%1=<>+!-/@B%12')3"034
1A&)01*G=U57=?0 *KR0 Ö®Ì0 >< $;C7Ï1$*Ì$D C7$:Ñ)$;IUI/(!*G$;CEKM570>0GcA
E ARQ 6>Ð:1ÌÌ$I?$CW.57=?0 @5E$;ÌWÒ!*=?Ül(!$K Ý$1A Ï9AÌ0 P e(*Ï1.5E$Ï1CE1G=U$;l 5 01!IUÐ:0 Î!L
$;CE657$@=?3P9.5EÌWÒ3I?$;6CE!=?!Ï*A
*ARÞRÒ*$0 CE$r5E=?Ì;6I *6I?ÐKM=JK0 Öa57Ò!$Ñ4$=?Ï Òl5G!Ðl96Ó=?Ì;KÙ *G¼Ìr01l<1$CEÏ $;*Ìr$
CW.5E$;Ka C7$@KM=?ÓÎ!I?$CA
ÞRÒ!$;K7$º G!<' l5E6Ï1$;KKM57$;Ó÷ÖÝCE0 Ó÷57Ò*$ºK7 Ó$!0 =JK7$57Ò*65ÙÓ6Í1$ºKe5E0ÌWÒ* KM57=JÌIU$6CE!=?!Ï
G<.6l5W6Ï $;0 (*K;A.ÞRÒ!=JK®!0 =JKM$1-.ÑaÒ!=JÌWÒ=JKK70@ÌC7=U57=JÌ I>ÖÝ0 C®â*9G=U*ÏP9$5M57$;CI?0>Ì;6IÓ=?!=UÓ I?K70
Î!C7$;< $;15WK@ÖÝ(!I?I4Ì0 >< $;C7Ï1$*Ì$Ù5E0#57Ò*$ºÓ=U*=UÓ(!ÓAváh*KM57$ Gú0 ÖaÌ0 >< $;C7Ï1=U*Ïº5E0#57Ò!$¾$ræ! Ìr5
Ó=?!=?ÓÙ(!Ó-5EÒ!$Ìr01l<1$CEÏ $;*Ìr$
KM5E IUIJK40 (5G(*$D5E057Ò!$@Ñ4$=?Ï Òl5 9(*Ìn5E(*.5E=U01*KA!ÞRÒ*$@K7=?ë$:06Ö
57Ò!$ *(*Ìn5E(*.5E=U01*KÙG!$Î,$*G¼01ú57Ò!$¾G$Ï1C7$;$06Ö!01=?K7$06ÖR57Ò*$¾KM570ÌWÒ* KM57=JÌ(!ÎG!.5E$;K;AÞRÒ*$
<' C7=J69Ìr$º0 Ö
5EÒ!$ 9(*Ìn5E(*.5E=U01*K6CE0 (!9Gú57Ò!$I?0Ì6I4Ó=U*=UÓ(!Ó =JKÎ!C701Î901CM5E=U01*6I570å57Ò*$
IU$6CE!=U*Ï3CW.5E$ 0 E **- E (- & O0A ?>0#=?å01CEG!$C@570#CE$;G!(*Ìr$57Ò*$ *(*Ìr57(*657=?0 *KÑ4$Ì å$;=¦5EÒ!$C
G$;ÌC7$ K7G$ À6!*$;6UI v57Ò*$IU$6CE!=?!ÏCE657$R0 CÒ*'< $a61G!6Î5E=U<1$aP*.5WÌWÒKM=?ë$1A6áh57Ò!$;0 CEÐ *-
- &!- " =U54=JKRKMÒ!0.Ña57Ò*65)5EÒ!$D01Î57=?Ó6I6!*$;6I?=?!ÏKEÌWÒ!$;G!(!IU$:06Öc5EÒ!$:IU$6CE!=U*ÏÙCW.57$D=?K
06Ö57Ò!$@ÖÝ01C7Ó
0 .
% E
ÑaÒ!$CE$ .®=?K57Ò!$D>(!ÓÙP,$C)06ÖcÎ*.5757$;C7*KÎ!CE$;K7$l57$G6*G =JK]Ì0 *KM5E l5;A áhÎ*CE1Ìn57=JÌr$1-65EÒ!=?K
Ó'ÐºP9$@5E0l0Ö»1Ke5
!0 57Ò!$;CÓ$r5EÒ!0G570C7$;Ó0.< $a!01=?K7$=JK5E0Ù(*K7$ºè7Ó=?!=UL[P9.5EÌWÒ*$;KEê!-.5EÒ*.54=?K;-lKM5E CM5)Ña=¦5EÒ
#KMÓ6I?IP9.5EÌWÒ¼K7=Uë;$º69G =?*ÌC7$ K7$57Ò!$ºK7=?ë$º1K@57CW6=?!=?!Ï#Î!CE0>Ì$$G!KAvQ6I?IU$;CÙG=JK7Ì(*KEKM$K
0 !$Ó$r5EÒ!0G ÖÝ01C]G0 =?!Ï¾57Ò!=JK E " 6*G¼BDC7C " G!=?KEÌr(*KEK7$;K:57Ò*=?K:ÖÝ01CIU=?!$; CÎ!CE0 P!I?$ÓK;A
Ø0.Ñ4$< $;C;-lG$;Ì=?G!=U!ÏÙ57Ò!$:CW.57$:.5RÑaÒ!=JÌWÒ570=U9ÌrCE$; K7$a5EÒ!$DP9.5EÌWÒ¾KM=?ë$:6*GºÑaÒ!=?ÌWÒº=U!Î*(5EK
570=U*ÌIU(9G$@=U¾57Ò!$K7Ó6I?I,P9.5EÌWÒ*$;K4=?Ka1KRG=¦ÕÌ(!I¦51K4G!$r57$;C7Ó=?!=?!Ï57Ò!$:Î!CE0 Î,$CRIU$6CE!=?!Ï
CE657$ A A V$;Ìr57=?< $I?Ð357Ò!$KM=?ë$06Ö5EÒ!$ÙI?$; C7!=?!ÏCW.5E$Ù=? KM570ÌWÒ* KM57=JÌI?$; C7!=?!ÏºÌ0 CEC7$KMÎ,0 9G!K
57057Ò*$:CE$;K7Î,$;Ìn5E=U<1$KM=?ë$0 Ö/57Ò*$Ó=?!=%P9.5EÌWÒ/A
065E$º6IJK7057Ò*65]57Ò!$¾Î!CE0 P!I?$Ó÷06ÖaC7$;Ó0.<l=?!Ï5EÒ!$!01=?K7$=?ú57Ò!$3G!.5W#Ó'Ð P,$IU$K7K
ÌrCE=¦5E=?Ì;6Ic5EÒ*60 *$@57Ò!=?!ÍKaP,$;Ì (*K7$06Ö®Ï $*$CW6I?=Uë.57=?0 /A9BD< $C757CW6=?!=?!ÏÓ'Ðº0>Ì;Ìr(!C
IU01!Ï
P9$ÖÝ0 CE$D5EÒ!$!01=?K7$@C7$;Ï =?Ó$@=JKa$<1$3C7$ ÌWÒ!$GcA
!0 57Ò!$;CD G!<' l5E6Ï1$06ÖP*65EÌWÒ5ECE =U!=?!Ï=JKa5EÒ*.5:0 !$=?KD6P!I?$5E0º(*K7$ÙK7$;Ìr01*G0 CWG$;C
Ó$57Ò!0G!K5E0åK7Î,$$;Gç57Ò*$3I?$; C7*=U!ÏåÎ!CE0Ìr$;KEK;A ?>$Ìr01*Gz01CEG$;CÓ$57Ò!0G!KK7Î9$;$;GãIU$6CE!=?!Ï
PlÐ $;KM57=?Ó657=?!Ï!065 e(9Ke55EÒ!$Ï CW G=?$l5@P!(5Ù I?K70º5EÒ!$Ìr(*C7<..5E(!CE$0 Ö5EÒ!$Ìr0lKe5]K7(!CMÖ»1Ìr$1A
8:=U<1$ú57Ò*$ºÌr(!CE<..5E(!C7$1-%0 *$ºÌ å$Ke5E=UÓ657$5EÒ!$º6Î*Î!C70'æ=?Ó.57$I?0Ì.5E=U01ú06ÖR57Ò!$3 Ìr57(* I
Ó=?!=?ÓÙ(!ÓA
Û
$KMÎ!=U57$57Ò!$
1G<.6l5E Ï $K06ÖP*.5WÌWÒ(!ÎG!.5E$;K;-1KM570ÌWÒ* KM57=JÌRI?$;6CE!=?!Ï=JKKM57=?IUI906Ö×57$;57Ò*$
Î!C7$ÖÝ$CEC7$GÓ$r5EÒ!0GºÎ* CM5E=?Ì(!IJ6CEIUÐÑaÒ!$;¾G$6I?=U!ÏÑa=U57Òº<1$CEÐI? C7Ï1$DG!65EKM$5EK4P9$Ì (*KM$:=U5
=?KK7=?ÓÎ*IUÐÓ(*ÌWÒ3Ö» KM57$;C;A

* "3C4 C%
.0%1
$r5eÑ40 CEÍK]I?$; C7ú5EÒ!$ºÖ»1Ke5E$;KM5ÙÖÝCE0 Ó 57Ò*$¾Ó01KM5(*!$ræÎ,$;Ìn5E$;GãK7 ÓÎ*IU$1AÞRÒ!$;C7$ÖÝ0 CE$ -v=¦5=?K
G<>=JK7 P!IU$570 ÌWÒ*0l0lKM$3ÁKE6ÓÎ!I?$¾.5$;1ÌWÒ¼=¦5E$CW.5E=U01¼57Ò*65=JK]5EÒ!$3Ó0lKe5(!Ö» Ó=?I?=? CÙ5E0
57Ò!$úKMÐKM57$;Ó3A
0657$1-457Ò!=JK#6Î!Î*IU=?$;K¾0 !I?Ðì570ìKM570ÌWÒ* KM57=JÌÁI?$; C7*=U!ÏTKM=?*Ì$ 5EÒ!$ 01CEG!$C306Ö
=U!Î*(5Î!CE$;K7$l5E657=?0 ç=JK=?C7CE$I?$<.6l5ÖÝ0 CP*65EÌWÒ,+.A)B
Ö:Ìr01(!CWKM$1-v5EÒ!$CE$=?K!0¼K7=UÓÎ!I?$Ñ4'Ð
570åÍl*0.Ñ ÑaÒ!=?ÌWÒç=U!Î*(5EK C7$¾=UÖÝ01C7Ó657=?0 zCE=?ÌWÒ/-vÒ!0.Ñ4$<1$C-v < $CEÐ¼KM=?ÓÎ!I?$º5EC7=JÌWÍå57Ò*65
ÌrCE(*G$I?Ð =?ÓÎ!I?$Ó$l5EK]57Ò!=JK=JG$;=JK5E0ÁKM=?ÓÎ!I?Ð ÌWÒ!0>01K7$K7(*ÌÌ$;KEKM=?< $$ræ! ÓÎ*IU$K:57Ò*656CE$
ÖÝC701Ó þ.ÿ rü 4ÌrIJ KEKM$KKM=?*Ì$57CW6=?!=?!Ï#$ræ!6ÓÎ!I?$;K]P9$;IU01!Ï =?!Ï5705EÒ!$ºKE6Ó$ÌrIJ KEKÑa=?IUI
Ó0lKe5aI?=UÍ1$I?Ð¾Ì0 l5E =U3KM=?Ó=UIJ6Ca=?ÖÝ0 CEÓ.5E=U01%A

!0 57Ò!$;CÒ!$;(!C7=JKM57=JÌaÖÝ0 C e(*GÏ1=U*ÏÙÒ!0.ÑìÓÙ(9ÌWÒ!$Ñx=?ÖÝ01C7Ó.5E=U015ECE =U!=?!Ï]$æ!6ÓÎ!I?$

Ìr0 l5W6=?*K/=JKv570D$ræ!6Ó=?!$5EÒ!$4$CEC701C/P,$r5eÑ4$$]57Ò!$R!$5eÑ)01C7Í:0 (5EÎ!(56*G]57Ò!$)5E C7Ï1$r5<' IU(*$
ÑaÒ!$57Ò*=?K=?!Î!(!5=?K®Î*C7$KM$;15E$;GcA ìI? C7Ï1$)$;C7CE0 C®=?*G=JÌ.5E$;K®5EÒ*.55EÒ!=JK=U*Î!(5Ò*1K!065P,$$;
IU$6CE!$;G#P>Ð357Ò*$*$r5eÑ40 CEÍ3 *GÁK703Ì0 l5E =U*KDºI?065:06Ö*$ÑÚ=?ÖÝ0 CEÓ.5E=U01%A,ÞRÒ*$CE$rÖÝ0 CE$ -,=U5
Ó Í $KvK7$*K7$)570:Î!C7$KM$;l5v5EÒ!=?K=?!Î!(5Ó0 CE$ÖÝCE$;Ül(!$;l57I?Ð A B
Ö,Ì0 (!CWKM$1-;P>Ð#è7I? C7Ï1$;êRÑ4$)Ó$;
C7$;I?657=?< $5E0
6I?I10 Ö57Ò!$)065EÒ!$C/57CW6=?!=U*Ï$ræ!6ÓÎ!I?$;K;A
Kc5EÒ!$4!$r5eÑ40 CEÍ5ECE =U*K;-r5EÒ!$;K7$CE$IJ.5E=U<1$
$CEC701CEK
Ña=UI?IÌWÒ*6*Ï $6*G KM0KMÒ*0 (!IJGÁ5EÒ!$ÖÝC7$Ül(!$*ÌÐ#06ÖÎ*C7$KM$;15W.5E=U01ÁÖÝ0 C¾Î*6C757=JÌr(*I? C
=U!Î*(5Î*.5757$CE%A Ó$57Ò!0Gç57Ò*65Ó0G=Uâ*$;K5EÒ!$¾Î*C701P*6P!=?I?=¦5eÐú06Ö:6Î!Î,$; CE *Ìr$¾06Ö
$ ÌWÒ
Î*.5757$CE3=?KÌ;6I?IU$G¾ !ý n/ÿ Trÿ >û D rA

C&%
.%1," "
*
3C>&'
2"&3 <3;%13;
1A?Òl( $Á57Ò!$ 57CW6=?!=U*ÏzKM$5¾KM0z57Ò*65¾KM(9ÌÌr$K7K7=?< $57CW6=?!=?!Ïz$æ ÓÎ!IU$K
*$< $;C ÝCW6CE$I?"Ð P,$I?0 !Ï5E057Ò!$]KE6Ó$ÌrIJ KEKA
E A C7$KM$;l5=?!Î!(5$ræ! ÓÎ*IU$KÙ5EÒ*.5Î!CE0G(*Ìr$ I? C7Ï1$º$CECE0 CÙÓ01C7$ºÖÝC7$L
Ül(!$;l57I?Ð57Ò* $ræ!6ÓÎ!I?$;K45EÒ*.5Î!CE0G(*Ì$@K7Ó6I?I%$CEC701C;A
Xu®ol_dbM1_Ebvikj:olikfMo^;bM\ ik_Wj.seg\rbe_gh1ZZ_nDikj@{l\sefMoZ]\WD{_\r¿!_WfEse_n:{.
bed1j>1d¿Ù_Ebhbed;b
i°seol_7be_ai¦g\:ghik^;jliª>fn\j.sbM\jl^;_ad;°%^;bM\;1ik_Wj.s\kl_WgW©
Ø0.Ñ4$< $;C;-®01!$ÁÓÙ(9Ke5ºP,$ Ì;6CE$rÖÝ(!IÑaÒ*$xÎ,$C757(!CEP!=?!Ï¼57Ò*$Á!0 CEÓ6IaÖÝCE$;Ül(!$;*Ìr=?$;K06Ö
=U!Î*(5$ræ!6ÓÎ!I?$;K:P,$;Ì (*K7$5EÒ!=JKÌWÒ*6!Ï1$;K
57Ò!$CE$IJ.5E=U<1$Ù=?ÓÎ,0 C75E *Ìr$57Ò9.5@57Ò!$!$5eÑ)01C7Í
Î!I?1Ìr$K/01ÙG/= V,$;C7$;15$ræ!6ÓÎ!I?$;K;A'ÞRÒ!=?KvÓ'Ð@0 C/Ó'Ð@!0 5vP,$4G$KM=?CW6P!I?$ Aî!0 C$ræ! ÓÎ*IU$1- >ÿ
D *ÿ ý ¦ÿ Eþ #þ ý hý D Oý6ÿ *ÿ >û kÿ ü ,DWý þ6ÿ ý Àü
P,$;Ì;6(*K7$01(57I?=?$CWK

Ì6åÎ!CE0G(*Ìr$IJ6CEÏ $$CECE0 CWK

Ð1$r5ÙK7Ò!0 (!IJG !065]P,$Î!CE$;K7$l57$GÁÖÝCE$;Ül(!$;15EIUÐ1AvBDå57Ò!$0 57Ò!$;C

Ò*6*G%-15EÒ!=JK5E$;ÌWÒ!!=JÜl(!$@Ì6ºP9$:Î*6C757=JÌr(*I? C7I?ÐP,$*$râ9Ì=? I*ÖÝ01C)P,0>01KM57=?!Ï]5EÒ!$DÎ,$C7ÖÝ0 CEÓ6*Ì$

ÖÝ0 Ca=?ÖÝC7$Ül(!$l57I?Ðº0Ì;Ìr(!CEC7=?!Ï=U*Î!(5EK;-!$1A Ï9A 2'ë 2Ù=?Î!Ò!0 *$Ó$@C7$Ìr0 Ï1!=U57=?0
A&'
!.0" "3C4 % 3 *C

&)0 >< $;C7Ï1$*Ì$)=JK(*K7(* IUI?Ð]Ö»1Ke5E$C=UÖ57Ò!$

'<1$CW6Ï1$)0 Ö,$ ÌWÒ=U*Î!(5<.6CE=J6P!I?$a0.< $;C®57Ò!$a5ECE =U!L
=U!ÏK7$r5®=?KÌIU0lKM$)570@ë;$CE0*A'Þ/0K7$$)57Ò!=JK-6Ì0 *K7=JG$C57Ò*$4$æ>57CE$Ó$aÌ K7$4ÑaÒ!$CE$4 IUIl5EÒ!$R=U!Î*(5EK
6CE$)Î,01K7=¦5E=U<1$ A'äå$=?Ï Òl5EKv570DÎ*6C757=JÌr(*I? Cv!0G$R=?Ù5EÒ!$4â*CWKe5®Ñ)$;=UÏ1Òl5IJ'Ð $;C C7$)(!Î,G*.57$GÙP>Ð
6º Ó01(!l5Î!CE0 Î,0 C757=?0 * I570 ÑaÒ*$CE$ @=?K57Ò*$ »KEÌ I? C $CEC701C.5)57Ò*65)!0G$:6*G =?K
57Ò!$:=U*Î!(5R< $;Ìr5701C »K7$$:$;Ül(*657=?0 *K #" *G ;nA>äxÒ!$36I?I90 Öc57Ò!$@Ìr01ÓÎ901!$l5EK)06Ö/

=U!Î*(54<1$;Ìr570 C46CE$
Î,01K7=¦5E=U<1$ ->6I?I90 Öc57Ò!$:(!ÎG!.5E$;K406Ö%Ñ4$=?Ï Òl5WK5EÒ*.5)ÖÝ$$;Gº=Ul5E0]*0>G!$DÑa=?IUI
P9$57Ò!$KE6Ó$K7=?Ï »=ÀA $ AcK7=UÏ10 Q;nA
K:¾C7$KM(!IU5;-957Ò*$;K7$Ñ4$=?Ï Òl5EK:Ì 01!IUÐ# IUI®G$;ÌC7$ K7$
0 C
IUI%=?*ÌC7$ K7$ Eû ü)ÖÝ01C
Ï =?< $;=U!Î*(5DÎ*65M5E$CE%A*ÞRÒ>(*K;-*=UÖÑ4$=?Ï Òl5<1$;Ìn5E0 CÓ(*KM5

ÌWÒ*6!Ï1$ºG=?C7$Ìn5E=U01z=¦5Ì z0 !I?ÐúG0 K70ÁP>Ðúë=?Ï ë; Ï Ï1=U!Ï#ÑaÒ*=?ÌWÒz=JK=U!$ÕÌr=?$l5 *Gú57Ò>(*K

< $CEÐK7IU0.ÑA
áhº5EÒ!$]6P,0.< $@$ræ! ÓÎ*IU$1->57Ò!$=?!Î!(5WKaÑ4$CE$: IUI%Î,01K7=U57=?< $ A!Ø
0.Ñ)$;< $;C;->=?3Ï1$!$;CE IÀ- lÐ
KMÒ!=UÖ×506Ö)57Ò!$'< $;CE Ï $]=?!Î!(5]'ÑR'Ð3ÖÝC701Óë$CE0ºÑa=?I?IP!=?1KD57Ò!$(!ÎG!.5E$;K@=? ¾Î*6C757=JÌr(*I? C
G=UCE$;Ìr57=?0 Á *G357Ò>(*KDKMI?0.Ñ G!0.Ña#IU$6CE!=U*Ï*A*ÞRÒ!$;C7$ÖÝ0 CE$ -!=U5D=JKÏ10>0>G35E0ºK7Ò!=¦Ö×5D57Ò!$Ù=U!Î*(5EK
KM05EÒ*.5D57Ò!$Ù'<1$CW6Ï1$:0.<1$CR5EÒ!$57CW6=?!=?!ÏºK7$r5
=JK
ÌIU0lKM$@5E0ë$;C709AÁÞRÒ!=JKÒ!$;(!C7=JKM57=JÌ]KMÒ*0 (!IJG
P9$º Î!Î!I?=U$G¼.5 IUI)I?'Ð1$CWK@ÑaÒ!=JÌWÒ¼Ó$6*K]57Ò*65ÙÑ4$Ñ4 l557Ò!$º'<1$CW6Ï1$0 Ö45EÒ!$ !
06Ö4¾!0G$570P,$ÌIU0lKM$Ù570ë$;C70¾P9$Ì (*KM$57Ò*$;K7$01(57Î*(5EK C7$Ù57Ò!$=?!Î!(5WK:570357Ò!$!$æ>5

I?'Ð1$C - OA/ÞRÒ!=JKÎ!CE0 P!I?$Ó÷Ì6úP,$ G!G!C7$K7K7$;G P>Ð Ìr0>01CEG=?*657=?!ÏÒ!0.ÑÚ5EÒ!$=U*Î!(5EK6CE$

57CW6*KMÖÝ0 CEÓ$;GúÑa=U57Ò¼5EÒ!$¾ÌWÒ!01=?Ì$06Ö
K7=?Ï Ó0 =JG!6I4 Ìr57=?<'657=?0 úÖÝ(!9Ìn57=?0 /A®Ø
$CE$Ñ4$ºG=JK7Ì(*K7K
57Ò!$=?!Î!(5a5ECE *KMÖÝ0 CEÓ657=?0 %AÞRÒ!$]G!=?KEÌr(*KEK7=U01¾0 Ö/57Ò*$]KM=?Ï Ó0 =JGºÖÝ0 I?IU0.ÑK;A
&)0 >< $;C7Ï1$*Ì$=JKÖ»1Ke5E$C]!0 5Ù0 *IUÐ =¦ÖR57Ò*$=U*Î!(5EK6CE$KMÒ*=¦Ö×5E$;Gz1K]G$;KEÌrCE=?P9$Gå P90.<1$
P!(5a6IJKM0]=UÖ%5EÒ!$Ð6CE$DKEÌ IU$GKM0Ù57Ò*654 IUI,Ò*'< $D6P,0 (5457Ò!$:K7 Ó$DÌr0.<. C7=J6*Ì$ - , ->ÑaÒ!$CE$
, I J 9 , F 5

%
6Kv+
Ø$CE$ - I =?K57Ò!$D>(!ÓÙP,$C)(06Öc57CW6=?!=?!Ï$ræ! ÓÎ*IU$K- ( , =JK57Ò*$DÌr0.<. C7=J6*Ì$a06Ö57Ò*$ ( =?!Î!(5

<' C7=J6P*IU$
*G , =JK57Ò!$ Ì0 ÓÎ901!$l5406Öc57Ò*$ 57CW6=?!=?!ÏÙ$æ!6ÓÎ!I?$ $A ?Ì IU=?!ÏÙK7Î9$;$;G!K

IU$6CE!=U*ÏP9$Ì6(9KM$D=¦54Ò!$I?Î*K5E0ÙP* I? *Ìr$a01(55EÒ!$

CW.5E$
.5)ÑaÒ!=?ÌWÒ57Ò!$DÑ)$;=UÏ1Ò15WKÌr01!!$Ìn57$G

570357Ò!$=?!Î!(5]*0>G!$;K:IU$6CE%AcÞRÒ!$<.6I?(!$06Ö5EÒ!$Ìr0.<.6CE=J6*Ì$K7Ò!0 (!IJG P9$Ó.5WÌWÒ!$;G Ña=¦5EÒ

57Ò*650 Öa57Ò!$KM=?Ï Ó01=?Gú(*K7$;G%A®î*0 CÙ57Ò!$KM=?Ï Ó01=?GúÏ1=U<1$zP,$I?0.Ñ- Ìr0.<.6CE=J6*Ì$06Ö º=JK
Ï 0>0G¾ÌWÒ!01=?Ì$ A
ÞRÒ!$$ræ!Ìr$;Î57=?0 35E0ºK7Ì;6I?=U*Ï IUIÌr0.<.6CE=J6*Ì$;K)5705EÒ!$ÙKE6Ó$<.6I?(!$]0ÌÌ(!CEKRÑaÒ*$#=U5
=?K
Íl*0.Ña 5EÒ*.5ÙK70 Ó$=U*Î!(5EKÙ6CE$0 Ö4I?$;KEKK7=UÏ1!=¦â,Ì69Ìr$57Ò* 0 57Ò!$;CEK;Acáh¼KM(9ÌWÒå#Ì; K7$ -c=U5
Ì6P,$]P,$!$â9Ìr=J6Ic5E0ºKEÌ6I?$:57Ò!$ÙIU$K7KK7=?Ï !=Uâ9Ì l5=U!Î*(5EKDG0.Ña3K7057Ò9.55EÒ!$Ð6CE$èMI?$;KEK
<l=JK7=UP!I?$;ê5E05EÒ!$I?$;6CE!=?!ÏÎ!CE0>Ì$;KEKA
')!3>&'
"034 % 3 *C
1ARÞRÒ*$D'< $;CE Ï $406Ö%$ ÌWÒ=?!Î!(54<' C7=J6P*IU$0.<1$C5EÒ!$5ECE =U*=U!ÏKM$5)KMÒ*0 (!IJGP,$DÌrI?01K7$
5E0ë$CE0*A
E A ?!Ì6I?$@=U*Î!(5<.6CE=? P!I?$;KaK705EÒ*.5a5EÒ!$=?CÌr0.<. C7=J6*Ì$;K46CE$6P,0 (5a5EÒ!$]K7 Ó$ A
*A4áh*Î!(5<.6CE=? P!I?$;KaK7Ò!0 (!IJG¾P9$(!9Ìr0 CECE$IJ.57$G=UÖÎ,01KEK7=UP!I?$ A
ÞRÒ!$6P,0.< $5eÑ)0357CE=JÌWÍ>K:0 ÖRK7Ò!=UÖ×57=?!ÏÁ6*GåKEÌ6I?=?!Ïº5EÒ!$=?!Î!(5WK]6CE$Ü1(*=¦5E$KM=?ÓÎ!IU$5E0
=UÓÎ!I?$Ó$l5"A !0 57Ò!$;CR57CE=?ÌWÍ5EÒ*.5a=JKaÜ1(*=¦5E$:6$ V,$Ìn5E=U<1$:P*(5aÓ01C7$@G=UÕÌr(!IU5a570=UÓÎ!I?$Ó$;15
=?K
570ºG!$;Ìr01C7CE$IJ.5E$@57Ò!$=U*Î!(5EK;A%&)0 *K7=?G!$C5EÒ!$K7=?ÓÎ*IU$!$r5eÑ40 CEÍº=? î=UÏ1(!CE$ E A9áOÖ=U!Î*(5EK
6CE$Ù(!*Ì0 CEC7$;I?657$G357Ò!$; =U5:=JK:Î90lK7K7=?P!IU$570K70 I?< $ÖÝ01CD5EÒ!$<' IU(*$0 Ö + 5EÒ*.5Ó=U*=UÓ=?ë$;K
57Ò!$$;C7CE0 C@Ña=U57Ò!01(5Ù6>Ð Ì0 *Ì$CEÁÖÝ0 C F -/69G <>=JÌr$< $;CEKE!Aáhå065EÒ!$CÑ40 CWG!K;-57Ò!$5eÑ40
<' C7=J6P*IU$K6CE$a=U9G$Î,$*G!$l5Ý57Ò!$:KMÐKM57$Ó 06Öc$Ü1(9.57=?0 9K=JKG=J6Ï10 * I8rA6äx=¦5EÒºÌr01C7CE$IJ.5E$;G
=U!Î*(5EK;-101!$Ó(*Ke5RKM01IU<1$RÖÝ0 C)P90 57ÒºK7=UÓ(!IU5E6*$0 (9KMI?ÐÑaÒ*=?ÌWÒ=JK)]ÓÙ(*ÌWÒÒ* CEG!$CÎ!CE0 P*IU$;Ó3A
CE=U*Ì=UÎ96IRÌr0 ÓÎ,0 !$;l5 *6I?ÐKM=JK À6IJKM0 Í>!0.Ñaç K5EÒ!$3H C7Ò>(!*$Lh"%0>$<1$$ræÎ* *K7=U01
Ì63P,$(*KM$G¾570C7$;Ó0.< $ kÿ Wý.üaÌ0 CEC7$;I?657=?0 *K)=U=?!Î!(5WK OA
áh!Î!(5WK57Ò9.53 C7$#I?=?!$; C7I?ÐTG!$Î,$*G$;l5 ×5EÒ!$ $æ>57CE$Ó$ÁÌ1KM$Á0 Ö]Ìr0 CECE$IJ.57=?0 Ó'Ð

6IJKM0@Î!CE0G(*Ìr$G!$Ï $;!$CW Ì=U$KÑaÒ!=?ÌWÒÓ'ÐÙK7I?0.ÑçI?$;6CE!=?!Ï*A1&)01*K7=?G$;C57Ò*$Ì K7$aÑaÒ!$;C7$R0 *$

=U!Î*(5=JK6I?Ñ4'ÐKv5eÑa=JÌr$R57Ò*$065EÒ!$C=?!Î!(5 F E + nA1ÞRÒ!$a!$r5eÑ40 CEÍ]01(57Î!(!5=?KÌr0 9Ke5W6l5
6I?0 !ÏIU=?!$K F F % E % + -ÑaÒ!$;C7$=JKaÌ0 *KM5E l5;AÞRÒ>(*K->5EÒ!$@Ï CW G=?$l5R=?KRë;$CE0

6I?0 !Ï@5EÒ!$;K7$DG=?CE$;Ìn5E=U01*:K ÀKM$;$Dî=?Ï (!CE$ E rA1Q#0.<>=?!ÏÙ IU01!Ï@57Ò!$KM$DIU=?!$KÒ*1K6P9KM01IU(5E$I?Ð*0

4$ V$;Ìn501ÁIU$6CE!=?!Ï*Aäå$ C7$Ù57CEÐl=?!Ï¾570KM01IU<1$Ù=? E LOÛ ÑaÒ*65:=JK:4$ V$;Ìn5E=U<1$I?Ð#0 !I?ÐÁ LOÛ
Î!C701P!I?$ÓAúáeG$; IUI?ÐÑ)$Ñ4 l5
570¾C7$;Ó0.< $]01!$0 Ö57Ò!$=?!Î!(5WK@ÑaÒ!=?ÌWÒ Ña=UI?IG$;ÌC7$ K7$]57Ò*$
KM=?ë$@06Ö57Ò*$!$r5eÑ40 CEÍA
îv=?Ï (*C7$ ¾KMÒ*0.ÑK5EÒ!$$;l57=?C7$Î!C70Ì$;KEK06Ö5ECE *KMÖÝ0 CEÓ=?!Ï=?!Î!(!5EK;AÞRÒ*$KM57$;Î*KD C7B$
KMÒ!=UÖ×5
=?!Î!(5WKK7057Ò!$Ó$; =?Kaë;$CE0*- E RG$Ìr0 CECE$IJ.57$:=?!Î!(5WK-,6*G R$;Ül(* IU=?ë$Ìr0.<. C7=UL
6*Ì$;K;A
y
ω2
Lines of
ω1 ω2 constant E
ω1
z1 z2
L<M7N ¹*¹ y9ikjl_W\be _Wq_Wjl1_Wj.sikjlq11segW©

Mean
Cancellation
KL-
Expansion
Covariance
Equalization
L<M7N ¹!¹ u*bM\;jlgO°?d;beZ]\rsei¦d;jd;°%ikj1ql1segW©

% "04
<" 9
0 *IU=?!$; Cº Ìr57=?<..57=?0 ìÖÝ(**Ìn5E=U01*Kº C7$#ÑaÒ*65ºÏ =?< $#*$(!CW6ID!$r5eÑ40 CEÍK57Ò!$;=UC¾!0 !I?=?!$; C
Ì6Î96P!=?IU=U57=?$;K;A1BD!$R06Ö,57Ò*$aÓ0lKe5Ì0 ÓÓ0 ÖÝ0 CEÓK®0 Ö,1Ìn57=?<..5E=U01ÙÖÝ(!9Ìn57=?0 =JK®57Ò*$KM=?Ï Ó0 =JG
ÑaÒ!=?ÌWÒÙ=?KaÓ0 !0 5701!=?Ì;6I?IUÐ:=?*ÌrCE$;1KM=?!ÏRÖÝ(!*Ìr57=?0 Ù57Ò*65 K7Ð>ÓÎ570 57$;Kv.5®KM01Ó$â*!=U57$)<' IU(*$
K =JK6Î!Î*C70l ÌWÒ!$GcAÞRÒ!$#Ó01KM5Ì0 ÓÓ0 T$ræ!6ÓÎ!I?$;K C7$35EÒ!$ÁKe5W6*G*6CWGçI?0 Ï1=?KM57=JÌ
ÖÝ(!*Ìn5E=U01 " 7 :69G Ò>Ð>Î9$;C7P,0 I?=JÌ]5W6!Ï1$l5 GÚ5E !Ò @K7Ò!0.Ña =?
îv=?Ï (*C7$ A ?>=UÏ1Ó0 =JG!K®57Ò9.5) C7$K7Ð>ÓÓ$57CE=?Ìa P901(557Ò*$0 CE=UÏ1=U@ »$ A Ï*A1K7$$î=?Ï (!CE$ P 6CE$
Î!C7$ÖÝ$CEC7$G]ÖÝ01C®57Ò!$DK7 Ó$RCE$;1KM01Ù5EÒ*.5=?!Î!(5WKK7Ò!0 (!IJGP9$
!0 CEÓ6I?=Uë;$;Gc-.* Ó$I?Ð -.P,$;Ì (*K7$
57Ò!$;Ðç6CE$ºÓ0 CE$ºI?=?Í $I?Ðú570åÎ!CE0G(*Ìr$30 (!57Î!(5W@K ÝÑaÒ!=JÌWÒì6CE$ ÿ 5E0 5EÒ!$!$ræ>5I?'Ð1$-C
57Ò*6546CE$a0 ¾'< $CW6Ï1$4ÌIU0lKM$570]ë;$CE0*A1ÞRÒ*=?K=?K)=U¾Ìr0 l5ECE1Ke5- K7'Ð1-.570Ù57Ò!$DIU01Ï =JKe5E=?Ì4ÖÝ(**Ìn5E=U01

ÑaÒ!01K7$@0 (5EÎ!(5EK
6CE$: IUÑR'ÐK)Î,01K7=U57=?< $6*GK70ÓÙ(*KM5aÒ*'< $Ó$;6¾57Ò9.5=JKaÎ90lKM=U57=?< $1A
"04
&" 9
1A?ÐlÓÓ$r5EC7=JÌºK7=?Ï Ó0 =JG!K]K7(*ÌWÒz KÙÒ>ÐlÎ,$CEP,0 I?=?Ì5W6!Ï1$l5Ù0 Ö×57$ãÌr0 ><1$CEÏ $Ö» KM57$;C
5EÒ*635EÒ!$]Ke5W6*G*6CWGI?0 Ï =JKM57=JÌ
ÖÝ(**Ìn5E=U01%A
E A CE$;Ìr01ÓÓ$;*G$GzKM=?Ï Ó01=?G - )=J6K C X5!( "- 5W6!Ò
FV <A ?>=?*Ì$57Ò*$
5W6!ÒÁÖÝ(!*Ìn5E=U01Á=JKDK70 Ó$r5E=UÓ$K
Ìr01ÓÎ!(5E657=?0 * IUI?Ð3$ræÎ9$;*K7=U<1$ -6Á6Î*Î!C70'æ=?Ó.L
5E=U0106Öv=U5P>ÐºCW.57=?006Ö®Î901IUÐ>!01Ó=J6IJKRÌ 3P,$(*K7$;G¾=U9Ke5E$; G%A
*A ?0 Ó$r5E=UÓ$;K=U5=JKÒ!$I?ÎÖÝ(!I>5E0:1G!GÙ:K7Ó IUIlI?=U!$6C57$;C7Ó-'$ A Ï*A x5E6*0Ò 7
K70 K4570'<10 =JG 965
KMÎ,065WKA
1.5
1
1
0.8
0.5
0.6
-3 -2 -1 1 2 3
0.4
-0.5
0.2 -1
-1.5
-6 -4 -2 2 4 6
(a) (b)
L<M7N ¹,¹ \4d;sbe_WfEdZZ_Wjl1_n!¯ seo1_agOsM\;jll\bMkd;îkgOseikfD°J1jlfEseikd;j9} x~ ~ 7© {

q_Ebe{dkikfRsM\;j1^_Wj.sn}
ì~ 6~r¡¾sM\;j1o
©
ÞRÒ!$
Ìr01*KM5E6l5WK=?57Ò!$DC7$Ìr01ÓÓ$;*G$;GºKM=?Ï Ó0 =JGÏ =?< $;6P,0.< $aÒ*'<1$P,$$¾ÌWÒ!01K7$K70
57Ò*65;- Wþÿ Àü7ý .ü Wþ¾ÿ »K7$$Î!CE$<>=?0 (*KG!=?KEÌr(*KEK7=U01 n-*57Ò!$]<. C7=J6*Ì$
06Ö5EÒ!$0 (!57Î!(5WK@Ña=UI?I6IJK703P,$ÌrI?01K7$Ù5E0 P,$;Ì;6(*K7$57Ò!$$6V,$Ìn5E=U<1$Ïl6=? 0 Ö57Ò*$KM=?Ï Ó0 =JG

=?K
C701(!Ï Ò!I?Ð]0.<1$CR=U5EK(9KM$ÖÝ(!IvCW6*Ï $ Aáh#Î96C757=JÌr(!IJ6C->57Ò!=JK:KM=?Ï Ó0 =JG3Ò* Ka57Ò!$]Î*C701Î9$;CM5E=U$K
» 1 - ÝP a57Ò!$KM$Ìr0 9G#G$CE=U<.657=?< $=JK
Ó.æ=?ÓÙ(!Ó .5 1-9 *G »Ì R57Ò*$
4$ V$;Ìn5E=U<1$Ï1 =U¾=?KÌIU0lKM$:5EB0 1A
BD!$06Ö:57Ò!$#Î,065E$l57=J6IaÎ!CE0 P*IU$;ÓKÑa=U57Òx(9KM=?!Ï¼KMÐ>ÓÓ$r5EC7=JÌKM=?Ï Ó0 =JG!K=JK57Ò9.557Ò*$
$CEC701C4K7(!C7Ö» Ìr$@Ì ºP,,$ 5 ü,.5a!$; C457Ò!$@0 CE=?Ï =?%Aî!0 C45EÒ!=?KRCE$;1KM01º=U5a=?KRÏ10l0G570'< 01=?G
=U!=U57=J6I?=?ë=?!Ï¾Ña=U57Òå< $;C7Ð#K7Ó6I?IÑ4$=?Ï Òl5WKAc24$;Ì;6(*K7$Ù0 Ö57Ò!$KE.5E(!CE657=?0 Á0 Ö57Ò*$K7=?Ï Ó0 =JG!K;-

57Ò!$$CEC701CDK7(!C7Ö» Ìr$=JKD I?K70 965DÖ» C:ÖÝC701Ó 5EÒ!$0 CE=UÏ1=U/A DG!G=?!Ï3¾KMÓ IUI®I?=U!$6CD57$;C7Ó 5E0
57Ò!$]K7=UÏ1Ó0 =JG¾Ì;6KM01Ó$57=?Ó$;KRÒ!$;IUÎ#'< 01=?G57Ò!$ ,.5CE$Ï =?0 9KA
&"034 2')4<%
!.*C%1
há ÌrIJ KEK7=¦â9Ì;.5E=U01]Î!CE0 P!I?$ÓK;-;5W6CEÏ $5v<.6I?(!$;K® C7$5eÐlÎ*=?Ì;6I?IUÐP!=?* C7Ð Ý$1A Ï9A 3 L - 7 Q=PnA'&)01ÓL
Ó01ºÑa=JK7G!0 Ó Ó=UÏ1Òl5RK7$$;Óõ570KM(*Ï Ï $Ke5)57Ò*65)5EÒ!$:5E C7Ï1$r5)<. IU(!$K4P9$K7$r5a.5457Ò!$@<.6I?(!$:06Ö
57Ò!$]K7=UÏ1Ó0 =JG R Ka1KMÐ>ÓÎ5E0657$KA!Ø
0.Ñ)$;< $;C;-157Ò!=JKaÒ*1KaKM$;< $;CE IG!CE'ÑaP*1ÌWÍKA
îv=?CWKe5-;=?*KM5E6P*=UI?=¦5E=U$K®Ì6ÙC7$KM(!IU5;A.ÞRÒ!$)57CW6=?!=?!Ï
Î*C70Ìr$K7K/Ña=UI?Il57CEÐ@570:GC7=?< $57Ò!$40 (!57Î!(5
KaÌrI?01K7$@ KRÎ,01KEKM=?P!I?$D5E057Ò!$:5W6CEÏ $r5a<.6I?(!$K-ÑaÒ!=JÌWÒ#Ì ¾01!IUÐºP9$ ÌWÒ*=U$;< $;G3 K7Ð>ÓÎ570 57=UL
Ì6I?I?Ð A DK)ÙC7$KM(*I¦5- 5EÒ!$
Ñ4$=?Ï Òl5EK Ý01(57Î!(!5R *G$<1$Ò!=JG!G$; C7$DGC7=?< $;570I? C7Ï1$C *G
I? C7Ï1$C<' IU(*$;KÑaÒ!$CE$)57Ò!$K7=UÏ1Ó0 =JGÙG$;C7=?<..57=?< $)=?KÌIU0lKM$)570@ë;$CE0*A'ÞRÒ!$R< $CEÐIJ6CEÏ $Ñ4$=?Ï Òl5WK
=U*ÌC7$ K7$5EÒ!$DÏ1CE1G=?$l5EK;- Ò!0.Ñ4$<1$C-65EÒ!$;K7$DÏ1CE1G=?$l5EK)6CE$57Ò*$ºÓ(!IU57=?Î!IU=?$;G¾P>Ð6º$æÎ90 L
!$l57=J6I?I?ÐK7Ó6I?I9K7=UÏ1Ó01=?GG!$CE=U<..5E=U<1$ Ý$æ!Ìr$Î!5ÑaÒ!$¾@5eÑa=?KM57=?!Ï5E$CEÓF=JK G*G$;G5E0]57Ò*$
KM=?Ï Ó0 =JG 4Î!CE0G(*Ì=U!ÏÑ4$=?Ï Òl5(!ÎG!.5E$]ÌrI?01K7$@570ë;$CE0*"A
K
C7$KM(!IU5;-!57Ò!$Ñ4$=?Ï Òl5EKÓ'Ð
P9$Ìr0 Ó$]KM57(*ÌWÍA
?>$;Ì0 *Gc-,ÑaÒ!$;#57Ò!$0 (!57Î!(5WKDKE.5E(!CW.57$1-*5EÒ!$Ù*$r5eÑ40 CEÍ¾Ï1=U<1$;K*0º=?*G=JÌ.5E=U01Á06Ö4Ìr0 !L
â9G$9Ìr$]I?$<1$I[A*äxÒ!$;Á6#=?!Î!(5
Î9.5M5E$CEÖ»6I?I?K
!$; C
G$Ìr=JKM=?0 P,0 (!9G!6CEÐ5EÒ!$]0 (!57Î!(5
ÌrIJ KEK=?K(**Ìr$;CM5W6=?%AáeG$; IUI?Ðz5EÒ!=JKKMÒ*0 (!IJGTP9$#CE$ *$Ìn5E$;GT=UT5EÒ!$#!$r5eÑ40 CEÍzP>Ðã ã01(5ML
Î!(5@<' IU(*$]57Ò9.5D=JKD=UÁP,$r5eÑ4$$;#57Ò*$]5eÑ40Î90lK7K7=?P!IU$Ù5E C7Ï1$r5
<.6I?(!$K-,=ÀA $ A,!0 5D!$6C
$;=¦5EÒ!$C
K7ÐlÓÎ5E065E$ A'Ø0.Ñ4$< $;C;-I? C7Ï1$Ñ)$;=UÏ1Òl5EK/57$9G570
ÖÝ0 CWÌr$46I?I101(57Î!(!5EKv570
57Ò!$)5E =UIJK/0 Ö57Ò!$RK7=UÏ L
Ó01=?GCE$Ïl6CWGI?$;KEK®06Ö,57Ò!$D(!*Ìr$;CM5W6=?l5eÐ A ÞRÒ>(*K;-65EÒ!$!$5eÑ)01C7ÍÓ'ÐÎ!CE$;G=JÌn5)@ÑaCE0 *Ï]ÌrIJ KEK
Ña=¦5EÒ!0 (5:Ï =?<>=U!Ï¾6>Ð¾=?*G=JÌ657=?0 Á0 Ö=¦5WKI?0.ÑÚÌr01â9G$;*Ìr$]=?#5EÒ!$ÙCE$;K7(!IU5;A"/6CEÏ $Ñ4$=?Ï Òl5WK
57Ò*65DK7657(!CW.5E$:57Ò!$]*0>G!$;KaÓ6Í1$@=¦5
=?ÓÎ90lK7K7=?P!IU$@5E0ºG/= V,$;C7$;l57=J.57$P,$r5eÑ4$$;35eÐlÎ*=?Ì;6I/ *G
!0 l5eÐ>Î!=JÌ6Ic$æ!6ÓÎ!I?$;K;A
KM01IU(5E=U01ç5E0ú57Ò!$KM$#Î*C701P!IU$;ÓK=?K570¼KM$557Ò!$Á5E6CEÏ $5<' IU(*$;K5E0åP,$ÁÑa=U57Ò!=?ì57Ò*$
CE !Ï $0 Öc57Ò!$:KM=?Ï Ó01=?Gc-1CE657Ò!$;C5EÒ*6º655EÒ!$:1KMÐ>ÓÎ5E0657=JÌa<.6I?(!$KA!&46CE$ÓÙ(9Ke54P9$D5E Í $/-
Ò!0.Ñ)$;< $;C;->5E0=U9KM(!CE$5EÒ*.55EÒ!$]!0G$Ù=?K
!065
CE$;KM57CE=JÌn57$G357001!I?Ð57Ò*$ÙI?=U!$6CÎ96C75
06Ö®57Ò*$
KM=?Ï Ó0 =JGcQA ?>$5M57=?!Ï:57Ò*$5W6CEÏ $r5®<.6I?(!$;Kv5E0
5EÒ!$RÎ901=Ul506Ö!5EÒ!$RÓ.æ=UÓ(!ÓÚK7$;Ìr01*GÙG!$CE=U<..5E=U<1$
0 ú57Ò*$3K7=UÏ1Ó0 =JG =JKÙ57Ò!$¾P9$Ke5Ñ4'Ð 570#5W6Í1$º G<. 15W6Ï1$06Öa57Ò*$º!01!IU=?!$6CE=¦5eÐåÑa=¦5EÒ!0 (!5
K7657(!CW.5E=U!Ï 57Ò*$ÁKM=?Ï Ó0 =JGcAÞRÒ!=JK=JK6!0 57Ò!$;CC7$ K70 ç57Ò!$ÁK7=UÏ1Ó0 =JGç=?xîv=?Ï (*C7$ PT=JK
Ï 0>0G#ÌWÒ!0 =JÌr$1A*áO5
Ò*1KÓ.æ=?ÓÙ(!ÓK7$;Ì0 *GG$;C7=?<..57=?< $.5 ]ÑaÒ*=?ÌWÒÁÌ0 CEC7$KMÎ,0 *G¾5E057Ò*$
P!=U96CEÐ5E C7Ï1$r5a<.6I?(!$;K45eÐ>Î!=JÌ Ic=U#ÌrIJ KEK7=¦â9Ì;.5E=U01ºÎ!CE0 P!I?$ÓK;A
2')4&%(
&)Ò!0>0lKM$R5W6CEÏ $r5<. IU(!$K.557Ò!$Î,0 =?l506Ö,57Ò*$Ó.æ=UÓ(!ÓõKM$Ìr0 9GG!$CE=U<..5E=U<1$a0 57Ò*$
K7=UÏ1Ó0 =JG¾K70 K4570'<10 =JGºKE.57(*CE657=?!ÏÙ5EÒ!$0 (!57Î!(5D(!!=U5EK;A
t s[ikgOseikjl^Ôse_EbeZ ikgõ\ghZ]\;kìkikjl_W\bõse_EbeZ \;l1_W sedÔseo1_jld61_íd seql sn}ú_© ^1©

åsM\;j1o ©
3" "0!." "034 C%%("4&;

ÞRÒ!$Ke5W6C757=?!Ïº<.6I?(!$KD0 Ö5EÒ!$Ñ4$=?Ï Òl5WK:Ì;6 Ò*'< $¾K7=UÏ1!=Uâ9Ì 15@4$ V$;Ìr50 Á5EÒ!$57CW6=?!=?!Ï

!Î C70Ì$;KEKA®äå$=?Ï Òl5EKK7Ò!0 (!IJGzP,$ÁÌWÒ!0lKM$;zCE *G01ÓI?Ð¼P!(5=?TK7(*ÌWÒT ÑR'Ðå57Ò*6557Ò!$#K7=UÏ L
Ó01=?Gº=?K4Î!CE=?Ó C7=?I?Ð1Ìn57=?<..5E$;G=?º=U5EK4I?=U*$;6C4CE$Ï =?0 /A1áOÖ/Ñ4$=?Ï Òl5WK) C7$:6I?I9<1$CEÐIJ6CEÏ $57Ò!$;
57Ò!$K7=UÏ1Ó01=?G Ña=UI?IKE.57(*CE657$C7$KM(!IU57=?!Ï3=UúK7Ó IUIÏ1CE1G=?$l5EK
57Ò*65Ó Í $IU$6CE!=?!Ï3K7I?0.ÑA
áOÖ
Ñ)$;=UÏ1Òl5EK6CE$º< $;C7ÐúK7Ó IUI)57Ò*$TÏ CW G=?$l5EKÙÑa=UI?Ia6IJKM0 P9$< $;C7ÐúK7Ó IUI[Aáh15E$CEÓ$;G=J.5E$
Ñ)$;=UÏ1Ò15WK457Ò*65
CW6!Ï1$D0.<1$CR57Ò*$]KM=?Ï Ó0 =JG R KRIU=?!$6CCE$Ï1=U01ºÒ*'<1$D5EÒ!$Ù1G<.6l5E Ï $D57Ò*65
57Ò!$Ï1CE1G=?$l5EK C7$IJ6CEÏ $$!01(!Ï Òå5EÒ*.5]I?$; C7!=?!Ï#Ì úÎ!C70Ì$$;Gú *G E @57Ò!$!$5eÑ)01C7Í
Ña=UI?I!I?$;6CE57Ò!$I?=?!$; CÎ*6C7506Ö,57Ò!$Ó Î!Î!=?!Ï@P9$ÖÝ0 CE$R57Ò!$aÓ0 CE$G=UÕÌr(!IU5!0 *IU=?!$; CÎ*6C75;A

ÌWÒ!=?$<>=?!Ï]5EÒ!=?K4CE$;Ül(!=?C7$K)Ì0>0 CWG=U9.57=?0 ºP9$5eÑ)$;$5EÒ!$D57CW6=?!=U*ÏK7$r5a!0 CEÓ6I?=Uë.5E=U01%-
57Ò!$
ÌWÒ*0 =JÌr$0 ÖcK7=?Ï Ó0 =JGc- *G57Ò!$DÌWÒ!0 =JÌr$0 ÖcÑ)$;=UÏ1Ò15=?!=U57=J6I?=Uë.5E=U01%A äå$
KM5E6C75P>ÐÙCE$;Ül(!=?C7L
=U!Ï5EÒ*.5a5EÒ!$]G=JKe5EC7=?P!(5E=U0106Ö/5EÒ!$0 (!57Î!(5WKa06Ö®$;1ÌWÒ¾*0>G!$Ò*'< $@Ke5W6*G*6CWG¾G$;<>=?657=?0
D06ÖR6Î!Î!CE0'æ=UÓ657$I?Ð AcÞRÒ!=JK@=?K@ ÌWÒ*=U$;< $;G .5:57Ò!$=?!Î!(5IJ'Ð $C:P>Ð#!0 CEÓ6I?=Uë;=U*Ï57Ò*$
57CW6=?!=U*Ï KM$5 KG$;KEÌrCE=?P9$G¼$; C7I?=U$;C;AvÞ/0Á01P5E =Uz Ke5W6*G! CEG¼G!$<>=?657=?0 zÌIU0lKM$5E0 º65
57Ò!$@0 (!57Î!(5a0 Ö%57Ò!$:â*CWKM54Ò!=JG!G$;¾IJ'Ð $;C)Ñ4$ e(*Ke5a!$;$;G570(*KM$:5EÒ!$6P,0.< $

CE$;Ì0 ÓÓ$*G!$;G
KM=?Ï Ó0 =JG5701Ï $57Ò!$;CÑa=U57Ò5EÒ!$
CE$;Ül(!=?C7$;Ó$l557Ò9.55EÒ!$
=?!Î!(!5)5E057Ò!$:KM=?Ï Ó01=?G I?K70]Ò*'<1$
Ke5W6*G! CEGG$;<>=?657=?0 A
KEKM(!Ó=?!Ï5EÒ!$Ù=?!Î!(5WK- , -*5E0º(!!=U5: C7$(**Ìr01C7CE$IJ.5E$;G
Ña=¦5EÒ3<. C7=J6*Ì$ ->57Ò*$]Ke5W6*G! CEG¾G$<>=J.5E=U01¾0 Öv5EÒ!$(!!=U5EKaÑ4$=?Ï Òl5E$;G3KM(!Ó Ña=UI?IcP,$

+ EF
F

J ,! 5 %
ÞRÒl(9K-'5E0:=?*K7(!CE$5EÒ*.5®57Ò*$ C7$R6Î!Î*C70'æ=?Ó657$;IUÐ 457Ò!$RÑ4$=?Ï Òl5EK®K7Ò!0 (*I?GP9$RCW6*G!0 ÓIUÐ
GCE'Ña¾ÖÝCE0 ÓíG=JKe5EC7=?P!(5E=U01Ña=¦5EÒ3Ó$63ë$CE06*G3Ke5W6*G*6CWG¾G$;<>=?657=?0 3Ï =?< $3P>Ð

+ 7F
%"
ÑaÒ!$CE$ Ô=?K45EÒ!$>(!ÓÙP,$Ca0 Ö=?!Î!(!5EKR5E057Ò!$(!*=¦5A
3" "!.0" "3C4 %1"04<;
DK7K7(!Ó=U*Ï5EÒ*.5 C

1A)5EÒ!$@57CW6=?!=?!ÏKM$5aÒ* KRP,$$;3*0 CEÓ IU=?ë$Gc-!69G

E A)5EÒ!$]K7=UÏ1Ó01=?GºÖÝCE0 Óíî=?Ï (!CE$ P3Ò* KRP,$$;3(9KM$G
5EÒ!$Ñ4$=?Ï Òl5EKRK7Ò!0 (!IJG¾P9$CW6*G!0 ÓIUÐG!CE'ÑaºÖÝC701ÓíG=?KM57CE=?P!(57=?0 Ý$1A Ï9A!(!!=UÖÝ0 CE&Ó
Ña=U57ÒÓ$; ¾ë;$CE0 *G3Ke5W6*G! CEG3G$;<l=J.5E=U01
+ EF
&
ÑaÒ!$;C7$ =JKR57Ò*$@Ö»6LO=U ×5EÒ!$]>(!ÓP9$;Ca06ÖÌr0 *!$;Ìr57=?0 *K)ÖÝ$$G=?!Ï#ÿ D57Ò!$*0>G!$ nA

&"034 @ %12')3C"3C4 ')2%(

ÞRÒ!$CE$Ù=JKD65DI?$;1Ke5:0 !$Ñ)$;IUIUL[Î*C7=?*Ìr=?Î!I?$;G#Ó$57Ò!0GÀG$;KEÌrCE=?P9$G#=UåKM$Ìn5E=U01 -!A E 4ÖÝ01CD$Ke5E=¦L
Ó657=?!Ï57Ò!$@=JG$; I,I?$; C7*=U!ÏCE657$ 0 A!Q 6>Ð0657Ò*$CaK7ÌWÒ*$Ó$;KGÝÓ0lKe5R06Ö%5EÒ!$ÓíCE657Ò!$;C)$;ÓL
Î!=UCE=JÌ6UI vÒ*'< $4P,$$Î!CE0 Î,01K7$;GÙ=U57Ò*$4I?=U57$CW.5E(!CE$5E0@ (5701Ó.57=JÌ IUI?Ð] GPe(*Ke55EÒ!$RIU$6CE!=?!Ï
CE657$ AcQ#0lKe5@06Ö57Ò!0lKM$K7ÌWÒ*$Ó$;K:G$;ÌC7$ K7$]5EÒ!$IU$6CE!=U*ÏºCW.57$ÑaÒ!$;Á57Ò*$Ñ4$=?Ï Òl5:< $;Ìr5701C
èM01KEÌr=?I?I?657$;KEê!-c *G =?*ÌC7$ K7$=U5]ÑaÒ!$; 5EÒ!$Ñ4$=?Ï Òl5< $;Ìr5701CDÖÝ01IUI?0.ÑK3C7$;I?657=?< $;IUÐ KM57$ GÐ
G=UCE$;Ìr57=?0 %A'ÞRÒ!$4Ó6=?ÙÎ!CE0 P!I?$Ó Ña=U57Ò57Ò!$KM$)Ó$r57Ò*0>G*Kv=JKv57Ò*65v5EÒ!$Ð] C7$)!0656Î*Î!C701Î!CE=?657$
ÖÝ0 CKe5E0ÌWÒ* KM57=JÌÙÏ1CE1G=?$l5D01C:01LOIU=?!$IU$6CE!=U*Ï¾P,$;Ì;6(*K7$Ù5EÒ!$Ñ)$;=UÏ1Òl5:<1$;Ìn5E0 C *(*Ìr57(*657$;K
6I?I57Ò!$@5E=UÓ$ A
2)$;Ð 01*G#ÌWÒ!0>01K7=U*Ï¾ºK7=?!Ï I?$Ï1IU01P*6IvIU$6CE!=?!ÏºCW.5E$ -,=¦5@=?K@ÌIU$6CD57Ò*65:Î!=JÌWÍ>=U*Ï¾3G=¦Ö×L
ÖÝ$CE$l5IU$6CE!=?!Ï¼CE657$ 0 ,ÖÝ0 C$ ÌWÒìÑ)$;=UÏ1Òl5ºÌ6ì=?ÓÎ!C70.<1$357Ò!$ Ì0 >< $;C7Ï1$*Ì$ <A Ñ4$I?IUL
Î!C7=?*Ì=UÎ!I?$;GÑR'Ð:0 Ö,G01=U*Ï
5EÒ!=?K;-.P*1KM$GÙ01Ìr01ÓÎ!(57=?!ÏK7$;Ìr01*GÙG!$CE=U<..5E=U<1$;K;-'=?K®G$K7ÌC7=?P9$G
=U K7$;Ìr57=?0 -*/A 1A9ÞRÒ!$Ó6=?#Î!Ò!=?IU0lKM01Î!Ò>Ð¾=JK5E0ºÓ6Í1$ÙK7(!C7$]57Ò*65:6I?I%5EÒ!$Ñ)$;=UÏ1Ò15WK=?#57Ò*$
!$r5eÑ40 CEÍÌr01l<1$CEÏ $DC701(!Ï Ò!I?Ðº6545EÒ!$]KE6Ó$KMÎ,$$GcA
Û
$;Î9$;*G=?!Ï@(!Î901Ù5EÒ!$Ìr(*C7<..5E(!CE$)0 Ö!57Ò!$a$;C7CE0 C®K7(!CMÖ»1Ìr$1-'K70 Ó$4Ñ)$;=UÏ1Òl5EKÓ'ÐC7$Ü1(*=UCE$
aKMÓ6I?I6I?$; C7!=?!ÏRCW.57$=?0 CWG$;C570'< 01=?G:G=?< $;C7Ï1$*Ì$ -nÑaÒ!=?IU$0657Ò*$CWKÓ'ÐDC7$Ül(!=UCE$RI? C7Ï1$
IU$6CE!=U*Ï
CW.57$4=?01CEG$;C/5E0Ìr0 ><1$CEÏ $65®DC7$ K70 * P!I?$)K7Î9$;$;GcA.24$;Ì;6(*K7$)0 Ö!57Ò*=?K;-.IU$6CE!=?!Ï
CE657$;K=U57Ò!$:IU0.Ñ4$CI?'Ð1$CWKKMÒ*0 (!IJGÏ $;!$CW6I?I?ÐÙP,$
IJ6CEÏ $C57Ò* =Uº57Ò!$DÒ!=?Ï Ò!$;CIJ'Ð $CWK ÀKM$;$
îv=?Ï (*C7$ E nA9ÞRÒ!=?KDÌr01C7CE$;Ìr5EK4ÖÝ0 C57Ò!$Ö»1Ìn5a5EÒ*.5
=?#Ó01KM5
!$;(!CE Ic!$r5:6CWÌWÒ!=¦5E$;Ìr57(!CE$;K;-57Ò*$
KM$Ìr0 9GG$CE=U<.657=?< $
0 Ö57Ò!$@Ìr0lKe5ÖÝ(**Ìn5E=U01ºÑa=U57ÒCE$;K7Î9$Ìn5)570ÙÑ4$=?Ï Òl5WK=?57Ò!$:I?0.Ñ)$;CI?'Ð1$CWK
=?K:Ï $;!$CW6I?I?Ð3K7Ó6I?IU$;C
5EÒ*6 57Ò*65:0 Ö57Ò!$Ò!=?Ï Ò!$;CDIJ'Ð $;CEK;A9ÞRÒ*$CW.5E=U01*6I?$]ÖÝ01C
5EÒ!$ P90.<1$
Ò!$(!CE=JKe5E=?Ì;KvÑa=?I?IP9$aG=JK7Ì(*KEKM$G]=?Ó0 CE$)G!$r5E =UI=?I?657$C®K7$;Ìn5E=U01*K®6I?0 !Ï:Ña=U57ÒKM(!Ï1Ï $Ke5E=U01*K
ÖÝ0 CÒ!0.Ñ 5E0ÌWÒ!0>01K7$@57Ò!$Ù1Ìn5E(*6Iv<' IU(*$06Ö®57Ò!$ÙIU$6CE!=U*ÏCE657$@ÖÝ0 C
57Ò!$GW= V$CE$l5
Ñ4$=?Ï Òl5WK
»K7$$]K7$;Ìn5E=U01 -*/A nA
áOÖ
KMÒ* C7$GúÑ)$;=UÏ1Òl5EKÙ C7$(9KM$GzKM(9ÌWÒç KÙ=U¼5E=UÓ$LOG$;I?'Ðå!$;(!CE I!$5eÑ)01C7Í&K ÀÞaÛ
E v01CDÌ0 >< 01IU(5E=U01*6I/!$r5eÑ40 CEÍK E O-!5EÒ!$ÙI?$; C7!=?!ÏCW.5E$ÙK7Ò!0 (!IJG#P,$ÙÎ!CE0 Î,0 C757=?0 96Ic5E0
57Ò!$KEÜl(*6CE$CE0>06506Ö)57Ò!$>(!ÓP9$;C06ÖaÌr01!!$;Ìr57=?0 *KK7Ò* C7=?!Ï¾57Ò*65@Ñ4$=?Ï Òl5-cP9$Ì6(9KM$Ñ4$
Íl*0.Ñ57Ò9.5a57Ò*$Ï CW G=?$l5EKR C7$@KM(*Ó06Ö®Ó0 CE$rLO0 C7L[I?$;KEK=?*G$;Î9$;*G$;15a5E$CEÓKA

*!.0" %AC%A@ %12')3C"3C4 B%1% 9
1
Ï U
= 1
< @
$ ;
$ W
Ì ¾
Ò )
Ñ ;
$ =UÏ1Òl5R=U5EK0.Ña¾I?$; C7!=?!ÏCW.57$

?
I ;
$ 7
C *
U
= !

Ï E
C 6
7
5
$ K4K7Ò!01(!I?GºP9$@Î!CE0 Î,0 C757=?0 96I957057Ò!$KEÜ1(96CE$
CE0l0 540 Ö%57Ò*$
>(!ÓP9$;Ca06Ö®=U*Î!(5EKa57057Ò!$(*!=¦5
Ñ4$=?Ï Òl5WK@=U¼I?0.Ñ)$;CI?'Ð1$CWKKMÒ*0 (!IJG 5eÐlÎ*=?Ì;6I?IUÐ P9$IJ6CEÏ $;C:57Ò* ¼=Uå57Ò*$
Ò*=UÏ1Ò!$CaIJ'Ð $;CEK
B
57Ò!$;CR57CE=?ÌWÍK)ÖÝ0 Ca=?ÓÎ!C70.<>=?!Ï57Ò!$]Ì0 >< $;C7Ï1$*Ì$
=?*ÌrI?(*G$ C

%(3;*
Q#01Ó$l57(!Ó
. 7 < 0 ( + 7 /%. 6
Ì6=?*ÌrCE$;1KM$RKMÎ,$$GÙÑaÒ*$57Ò!$Ì01KM5K7(!C7Ö» Ì$)=JK®Ò!=?Ï Ò!I?Ð]!01*KMÎ*Ò!$CE=?Ì;6I>P,$;Ì (*K7$4=U5G!6ÓÎ*K

57Ò!$#K7=Uë;$¾0 Ö57Ò!$#KM57$;Î*K6I?0 !ÏåG=UCE$;Ìr57=?0 *K0 Ö
Ò!=?Ï ÒãÌ(!CE<'657(!CE$¾57Ò>(*KÐ>=U$;I?G=?!Ïú IJ6CEÏ $;C
4$ V$;Ìn5E=U<1$ÙI?$; C7!=?!ÏCW.5E$Ù6I?0 *Ï57Ò!$G=?C7$Ìn5E=U01*K0 ÖIU0.ÑÚÌ(!C7<.657(!CE$ çG!$!0 57$;K
57Ò*$
Ke5EC7$;!Ï65EÒ0 Ö95EÒ!$aÓ0 Ó$l57(*ÓÚ57$;C7&Ó rA6áO5Ò* KP9$;$ÌrIJ6=?Ó$;GÙ57Ò*65Ó01Ó$l57(!Ó Ï $;!$CW6I?I?Ð
Ò!$I?Î*KÓ01C7$=?ÁP*65EÌWÒ#Ó0G$57Ò96#=?ÁKe5E0>ÌWÒ9 KM57=JÌ@Ó0G$1-9P*(5
!0ºK7ÐKe5E$Ó.5E=?ÌÙKe5E(*GÐ306Ö
57Ò!=JK6CE$@Í>!0.Ña5E057Ò!$] (57Ò!01CEK;A
8 9 C" #<% .%(!'-3"034 ')2%1 QÁ >Ð 6(5EÒ!0 CWK;-c=U*ÌIU(9G=U*Ï ?>0 ÓÎ,0 I?=U*K7Í>ÐÁ$r5Ù IÀA ( O-
ÛD C7Í1$ Q#0>0>G!Ð - [-<?>(!5M5701 * [-Q#(*CE65E $r56I[A E * aÒ*'< $3Î!CE0 Î,01K7$;G¼CE(!I?$;KÖÝ01C
6(5E0 Ó.5E=?Ì;6I?IUÐ G! Î57=?!Ï5EÒ!$
I?$; C7*=U!ÏCW.5E$;K »K7$$D I?K70 & *nA>ÞRÒ!$KM$CE(!I?$;K)Ìr0 l5EC701I!57Ò*$
KMÎ,$$G¾0 ÖÌ0 >< $;C7Ï1$*Ì$
P>Ð=?*ÌrCE$;1KM=?!Ï0 CG$ÌrCE$; K7=?!ÏÙ5EÒ!$@IU$6CE!=?!ÏCE657$@P* K7$;Gº0 357Ò*$
$CEC701C;A
ä $ KEKM(!Ó$5EÒ!$]ÖÝ01IUI?0.Ña=?!ÏÖ» Ìr5EK
ÖÝ0 C:IU$6CE!=?!ÏCW.57$ G! Î5E657=?0 Á6I?Ï 01C7=U57Ò*BÓ C
57Ò!$K7Ó6I?IU$Ke5%$;=UÏ1$><.6I?(!$®06Ö>57Ò*$Ø$K7K7=? »K7$<$ AÜ,8A E Q( %,=JK%K7(ÕÌr=?$l57I?Ð@KMÓ6I?I?$C57Ò96@57Ò*$
KM$Ìr0 9G#KMÓ6I?I?$;KM5
$=?Ï $;l<. IU(!$6*G E a57Ò!$;C7$ÖÝ0 CE$Ù.Ö×5E$CDI? C7Ï1$]>(!ÓÙP,$CD06Ö=U57$CW.5E=U01*K;-
57Ò!$ Î*6CW6Ó$r5E$C<1$;Ìn5E0 C /%. ºÑa=UI?ID Î!Î!CE01 ÌWÒã57Ò*$ Ó=U*=UÓ(!Ó ÖÝC701Ó 5EÒ!$ G=?C7$Ìn5E=U01x06Ö
57Ò!$3Ó=U!=?ÓÙ(*Ó $=?Ï $><1$;Ìn5E0 C]0 Öa57Ò!$Ø$K7K7=J6 »K7$B$ AÜ,8A E X( n-®î=UÏ1(!C7$ X" rA
*G$C57Ò*$;K7$
Ìr0 9G=¦5E=U01*K57Ò!$:$<10 I?(57=?0 0 Ö%57Ò*$D$Ke5E=UÓ.5E$;GÎ96CW6Ó$r5E$C)Ì;6¾P9$D57Ò!01(!Ï Òl5406Öv1K)Ù0 !$L
G=UÓ$;*KM=?0 96IÎ!C70Ì$;KEK
69G57Ò!$Ó=U!=?ÓÙ(*Ó$=?Ï $><1$;Ìn5E0 C # Ì ÁP9$6Î*Î!C70'æ=?Ó.57$G ×ÖÝ0 C
IJ6CEÏ $:>(!ÓÙP,$C
06Öv=U57$;CE657=?0 *DK C!K7$$î=UÏ1(!C7$ " 4PlÐ
#

P
ÑaÒ!$CE$ :G$;!065E$;KR5EÒ!$ F:!01C7ÓA!Ø

$*Ì$Ñ)$Ì 31G0 Î!5
Î*C7X0 e$;Ìn5E=U01
# +

570¾57Ò!$6Î*Î!C70'æ=?Ó.57$GÓ=U!=?ÓÙ(*Ó A=?Ï $;l<1$;Ìr570 C # 1K:¾0 *$G=?Ó$*K7=U01*6I®Ó$;1KM(*C7$06Ö
57Ò!$
G!=?KM5E *Ìr$R5E057Ò!$
Ó=?!=?ÓÙ(!ÓAßÞRÒ!=JKG=JKM5E69Ìr$Ì P9$(9KM$G570]Ìr01l57CE0 I>57Ò*$IU$6CE!=?!Ï
CE657$ ×ÖÝ01CG$r5W6=?I?KK7$$ E * U
/C. 7 < /. 7 F10 ( (
% X(
' /. 7 D F Q ' /%. 7 (

% *
0 /. 7 D 0 /%. 7 0 %. ' /. 7 F10 /%. ;
% -
ÑaÒ!$CE$ ÙÌr0 l5EC701I?K57Ò!$@I?$; ÍK7=?ë$:06Ö/5EÒ!$@'< $CW6Ï1$ -
å C7$:Ìr0 9Ke5W6l5EK46*G ' =JK)(9KM$G¾1K
6(æ=?IU=J6CEÐ<.6CE=? P!IU$:5E0Ì;6IJÌr(!IJ.5E$:57Ò!$I?$; ÍlÐ¾'< $CW6Ï1$
0 Ö/57Ò*$Ï CW G=?$l5 A

065E$º5EÒ*.55EÒ!=JKKM$50 Ö
CE(!IU$K=?K$ K7Ðú570¼Ìr01ÓÎ*(57$#69GçKM57CW6=?Ï Òl5MÖÝ01C7ÑR6CWGå570ú=?ÓL
Î!IU$;Ó$l5;Acäå$KM=?ÓÎ!IUÐ Ò*'< $570Í $;$Î 57CW ÌWÍ#06Ö46ú G!G=U57=?0 96I®< $Ìn5701C@=U AÜ,8A * -C,57Ò*$
'< $CW6Ï1$;G:Ï CW G!=U$;15 ' A.ÞRÒ!$)!0 CEÓ 06Ö5EÒ!=?K<1$;Ìn5E0 C/57Ò!$;Ìr01l57CE0 IJKc57Ò*$4K7=Uë;$0 Ö57Ò!$4IU$6CE!=?!Ï
CE657$ »K7$$ AÜ,8A - %rA ÞRÒ!$
IUÏ10 CE=¦5EÒ!ÓÚÖÝ01IUI?0.ÑK5EÒ!$
K7=UÓÎ!I?$=?15E(!=U57=?0 C1Ö»6C4'Ñ4'ÐÖÝCE0 Ó57Ò*$
Ó=?!=?ÓÙ(!Ó »I? C7Ï1$ÙG=JKe5W6*Ì$
=U5DÎ!CE0Ìr$$G!KD=U P!=UÏ3Ke5E$Î*K:69G ÌrI?01K7$5E057Ò*$Ó=?!=UÓ(!Ó
=¦5
!!$; I?K45EÒ!$I?$;6CE!=?!ÏCE657$ ×ÖÝ01CR57Ò!$;0 CE$r57=JÌ I%G$r5W6=?I?K
KM$;$ E * UrA
9 "!. +!"0"!C*C36"0<3C # "04
&" 9# 3C"0
IU57Ò!01(!Ï Ò¼Ó01KM5K7ÐKe5E$ÓK(*K7$!0G$;KÙP* K7$;Gå01zG065ÙÎ*C70G(*Ìr5EK] *G¼K7=UÏ1Ó01=?G*K-%Ó lÐ
0657Ò*$CR5eÐ>Î9$KR06Ö(!!=U5EK Ý01CaI?'Ð1$CWK#Ì ¾P,$(*K7$;GcA" Ìr01ÓÓ013 I¦5E$CE*.5E=U<1$D=JK457Ò*$:CW G!=? I
P* K7=?KÖÝ(!*Ìr57=?0 ÀN2Rî !$5eÑ)01C7Í'»K7$$ (- E &!- "!- E UáhºN2Rîå!$r5eÑ40 CEÍK- 57Ò!$:G065RÎ!CE0>GL
(*Ìn50 Ö95EÒ!$aÑ)$;=UÏ1Òl5 *G=U*Î!(5< $Ìn5E0 C®=?KC7$;Î!I?1Ìr$GÙÑa=U57ÒGA(*ÌIU=JG$6G=JKe5W6*Ì$4P,$r5eÑ4$$;
L<M7N ¹*¹ dj6'_Ebe^;_WjlfW_d°/seo1_>dna©>pR beikjl^@seol_Rªlj>\,gOsM\;^;_Dd°%k_n\bej1i¦j1^seol_
\n'_EbM\;^;_>dnTikg
\qlq bedr½ ikZ]\se_Ek]d;jl_a ikZ_Wjlghikdjl\;sedn\rbM1g®seol_)ZikjlikZ:1ZR\;jlÙisikg\D^;d.d6\;q1q1bedn½ ikZ]\|
seikd;jd;°seo1_aZikjlikZ:1Z_Wik^;_Wj6\¦1_1ibe_WfEseikd;jd;°cseo1_ _Wghghi¦\j9©
57Ò!$D=U!Î*(54 *GÑ)$;=UÏ1Òl5)6*G5EÒ!$DK7=?Ï Ó0 =JG=?KC7$;Î!IJ Ìr$GP>Ð $ræÎ901!$l5E=? IÀAlÞRÒ!$0 (!57Î!(5
Ìn5E=U<>=U5eÐ=JKÌr01ÓÎ*(57$Gc-!$ A Ï*A>ÖÝ01Ca0 !$@01(57Î!(!5;-*1K
J

, $ræÎ
F E ,F F , F
, Kv+
ÑaÒ!$CE$ , , =JK5EÒ!$
Ó$6 »KM5E *G! CEGG$;<l=J.5E=U01 ®0 Öc57Ò!$ [L[57Òº8@ (*K7K7=J6%AlÞRÒ!$;K7$(!!=U5EK
Ì6 C7$;Î!I?1Ìr$0 CDÌ0>$ræ=?KM5DÑa=U57Ò 57Ò!$KM5E69G!6CWG#(!!=U5EK@ *G57Ò*$ÐÁ6CE$](*K7(* IUI?Ð357CW6=?!$;G#P>Ð

Ìr0 ÓP!=?*.5E=U0130 ÖÏ CW G=?$l5

G$K7Ì$l5 ×ÖÝ01C
0 (!57Î!(5:(!!=U5E K a69G(!*K7(!Î9$;C7<>=JKM$G#ÌrI?(*KM57$CE=?!Ï
ÖÝ0 CG$57$CEÓ=U*=U!Ï5EÒ!$Ó$; *Ka6*G¾Ña=JG>57Ò*K06Ö57Ò!$]N2Rî¼(*!=¦5WKA
!I?=UÍ1$K7=?Ï Ó0 =JG!6I(!!=U5EK@ÑaÒ*=?ÌWÒåÌ6åÌr0.<1$C5EÒ!$$l57=?CE$K7Î* Ì$ -¾K7=?!Ï I?$N
24îì(*!=¦5
Ìr0.< $;CEK:01!IUÐå#KMÓ IUI)IU0Ì IC7$;Ï =?0 ú06Ö457Ò*$=U*Î!(5K7Î* Ì$ A/ÞRÒ*=?K]Ì;6úP,$º6z1G<.6l5E Ï $
P9$Ì6(9KM$I?$;6CE!=?!Ï#Ì P,$Ö» KM57$;C;A%N2Rî (!!=U5EKÓ'Ð I?K70ºÖÝ01C7Ó÷P9$5M57$;CÙK7$r506ÖRP* K7=JK
ÖÝ(!*Ìn5E=U01*K:5703Ó0G$I57Ò*$=?!Î!(!5K7Î*1Ìr$57Ò* K7=UÏ1Ó01=?G (!!=U5EK;-%6IU57Ò!01(!Ï ÒÁ57Ò!=JK@=?K:Ò!=?Ï Ò*IUÐ
Î!C701P!I?$ÓõG$Î,$*G!$l5;A*BD57Ò*$D!$;Ï1657=?< $K7=?G$1- 5EÒ!$
I?0Ì IU=U5eÐÎ*C701Î9$;CM5eÐ06Ö/N2Rî®K)Ó'ÐP,$
ÁG=JK71G<.6l5E Ï $Î* CM5E=?Ì(!I? C7I?Ð =?zÒ!=?Ï ÒzG!=UÓ$9KM=?0 * I4K7Î*1Ìr$;K]P9$Ì6(9KM$Ó'Ðå(!!=U5EK6CE$
!$$G$;Gç570úÌr0.<1$C57Ò!$#K7Î* Ì$;K;A®N
24î®K6CE$3Ó01C7$36Î!Î*C701Î!C7=J.5E$º=? »IU0.Ñ G=UÓ$;*KM=?0 96UI
(!Î!Î,$CIJ'Ð $;CEK46*GK7=UÏ1Ó0 =JG!K4=U ÝÒ*=UÏ1ÒG!=UÓ$9KM=?0 * 8I )I?0.Ñ)$;CRI?'Ð1$CWKA
Ç) Ä )ò%Æ!ôò/ÄDÊò Ç #öxÆ!óÈ
ËMò/Ä)Å xò >Êò/Ä)Å

8 @B"0 .0% %1:'
áhÙ5EÒ!=?K®K7$;Ìr57=?0 ÙÑ4$4$ræ!6Ó=?!$4K70 Ó$406Ö957Ò!$)57Ò!$;0 CEÐP9$;Ò!=?*G]5EÒ!$457CE=?ÌWÍKÎ!CE$;K7$l57$G$; C7I?=?$CA
ä $P,$Ï1=U=?301!$]G=?Ó$*K7=U01¾ÑaÒ*$CE$D5EÒ!$](!ÎG!657$$;Ül(*657=?0 ¾ÖÝ0 CaÏ1CE1G=U$;l5aG!$;KEÌr$l5Ì
P9$ÑaCE=¦5757$;1K
. 7 < /%. F 0 & 5 E

ä ]$ Ñ40 (*I?GI?=UÍ1$@570Í>!0.Ñ Ò!0.Ñ 57Ò*$]<.6I?(!$]06Ö 0 PV$;Ìr5EK
Ì0 >< $;C7Ï1$*Ì$: *G357Ò*$]IU$6CE!=?!Ï
KMÎ,$$GcA/î=UÏ1(!CE$ &3=?IUI?(*KM57CW.57$K:57Ò!$I?$; C7*=U!Ï3P,$Ò*'<>=?0 C:ÖÝ0 C]K7$<1$CW6IG=/V,$;C7$;15ÙK7=?ë$;K:0 Ö 0
ÑaÒ!$º57Ò!$DÑ)$;=UÏ1Ò15 Ke5W6C75EK)0 (54=Uº57Ò!$D<>=?Ì=U!=U5eÐ06ÖvÙIU0Ì;6I*Ó=?!=?ÓÙ(!ÓA>áhº01!$DG=?Ó$L
KM=?0 %-v=¦5=?KÙ$; K7ÐÁ5E0 G$â*!$5EÒ!$º01Î57=?Ó6II?$; C7!=?!Ï#CW.5E$ - 0 (W-v1K]P,$=?!Ï#57Ò*$IU$6CE!=?!Ï
CE657$¾57Ò*65Ña=UI?IaÓ0.< $¾57Ò!$Ñ4$=?Ï Òl55E0å57Ò!$Ó=U*=UÓ(!Ó- ,7.c-=?ãÎ!CE$;Ì=?K7$I?Ð¼0 *$KM57$;Î
»K7$$@îv=?Ï (*C7$ & »8= eP nA!áOÖ 0 =?KaK7Ó6I?IU$;C5EÒ*6 0 (57Ò!$;º5EÒ!$Ke5E$Î*K7=?ë$:Ña=UI?IcP9$K7Ó6I?IU$;C4 *G
Ìr0 ><1$CEÏ $9Ìr$aÑa=?IUI,5E Í $Ó(!IU57=?Î!IU$D57=?Ó$;KM57$;Î*KA> áOÖ 0 =JK)P9$5eÑ)$;$ 0 ( 6*G E 0 ( 57Ò!$;57Ò*$
Ñ)$;=UÏ1Ò15RÑa=?IUI01KEÌr=?I?I?657$D C701(!*G ,/. P!(5aÑa=?IUI$;< $l5E(*6I?IUÐÌ0 >< $;C7Ï1$ »î=?Ï (!CE$ & ÝU= eÌ nAáOÖ
0 =JKÓ0 CE$@57Ò96#5eÑa=JÌr$@5EÒ!$K7=Uë;$]06Ö 0 ( Àî=UÏ1(!C7$& ÝU= eG 457Ò!$;#57Ò*$ÙKe5E$Î*K7=?ë$]=JK
K70I? C7Ï1$
57Ò*65a57Ò!$Ñ4$=?Ï Òl5a$*G*KR(!Î3Ö»6C757Ò!$;CRÖÝC701 Ó ,7. 57Ò* 3P,$rÖÝ01C7$1A!Û
=?< $;C7Ï1$*Ì$@C7$KM(!IU5EK;A
E(ω) E(ω)
E(ω)
η < ηopt η = ηopt

η = ηopt
ω ω
ωmin b) ωmin
a)
ω
ωc ωmin
E(ω) E(ω)
η > 2 ηopt dE/dω
η > ηopt
ω
ωc ωmin
dE(ωc)
dω
ω ω ∆ω
ωmin ωmin
i

c) d)
iki
L<M7N ¹*¹ M
b
\ ¦
i E
_ 6
j )
s W
_ h
g W
f W
_ .
j
s J
°
d R
b
i !
¿ E
_ e
b W
_ .
j
s k
n
_
\ e
b 1
j i¦j1^@bM\se_WgW©
äxÒ*.5=JK57Ò!$#01Î57=?Ó6Ia<.6I?(!$06ÖD57Ò!$#I?$; C7!=?!ÏåCE657$ 0 (Á"%$r5(9Kâ*CEKM5Ìr01*KM=JG$;C
57Ò!$ÙÌ; K7$@=U rLhG=?Ó$*K7=U01%A DK7K7(!Ó=U*Ï57Ò*65: Ì;6P,$Ù6Î!Î*C70'æ=?Ó657$GP>Ð¾Ül(*1GCE657=JÌ
ÖÝ(!*Ìn5E=U01%- 0 ( Ì;6#P,$G$;C7=?< $GPlÐ3â*CWKM5D$ræÎ* *G=?!Ï =? Þ'Ð>IU01C
K7$CE=U$K
6P,0 (!5
57Ò*$
Ìr(!CEC7$;l5RÑ4$=?Ï Òl5- DC
< & 7 F &
- 7 E F F 6F & F - 7 565D54
E

ÑaÒ!$CE$]Ñ4$](*K7$]57Ò*$K7Ò!0 C757Ò* *G K A,áOÖ =JK
Ül(*1GCE657=JÌ@57Ò*$K7$;Ìr01*G
0 CWG$C]G$;C7=?<..5E=U<1$=JK]Ì0 *KM5E 15] *G 57Ò!$Ò!=?Ï Ò*$C]01CEG$;C:57$CEÓK<.6!=JK7Ò%A/ÛDW= V$CE$l57=J.5E=U*Ï
P90 57Ò#KM=JG$KRÑa=¦5EÒ3CE$;K7Î,$;Ìn5a5E&0 5EÒ!$Ï =?< $K
& &
- 7 F
- 6F & - 5 EXE

F
?>$r5757=?!BÏ ,7.#6*G#*0657=?!Ï5EÒ*.5 & ,7. -9Ñ)$6CE$]IU$Ö×5:6Ö×57$CDC7$6C7L
CE !Ï =?!ÏÑa=¦5EÒ +

F D
,7.& F
F
- 5
-
E

&)0 ÓÎ*6CE=?!Ïå57Ò!=JKÑa=U57Òì57Ò*$Á(!ÎG!.5E$Á$;Ül(*657=?0 E n-Ñ4$â**GT5EÒ*.5¾Ñ)$ÁÌ;6TC7$ ÌWÒì
Ó=?!=?ÓÙ(!Ó =U01!$Ke5E$Î=¦Ö
0 (<

F & + 5 E

F
®$CEÒ*6Î*K® $; K7=?$CÑR'Ð]57001P5E =U5EÒ!=?K)K7 Ó$aC7$KM(!IU5=JK=?IUI?(*KM57CW.57$G=Uî=?Ï (!CE$ & »=UU= nA
ÞRÒ!$¼P90 5M5E0 Ó Ï1CE Î!Ò Î*IU0 5EK357Ò*$¼Ï CW G=?$l5#06Ö 1K#ãÖÝ(!*Ìn5E=U01 06&Ö A ?>=?*Ìr$ =?K
Ü1(9 GCW.5E=?Ì -v5EÒ!$#Ï CW G!=U$;15=JKKM=?ÓÎ!IUÐã KM57CW6=?Ï Òl5IU=?!$#Ña=U57ÒT<' IU(*$3ë;$CE0å6557Ò!$#Ó=?!=¦L
ÓÙ(!Óõ6*G .55EÒ!$
Ì(!C7CE$l5Ñ4$=?Ï Òl5 A DF 6F =JKK7=UÓÎ!I?Ð]5EÒ!$
K7IU01Î9$R06Ö5EÒ!=?K
IU=?!$]69Gº=JKÌr01ÓÎ!(57$G3(*KM=?!Ï57Ò*$]Ke5W6*G! CEG¾KMI?0 Î,$@ÖÝ0 CEÓÙ(*I?
F F & F ,/. F 5 E "

?>0 I?<>=U!ÏÖÝ01:C ,7.º5EÒ!$Ï1=U<1$;K4$;Ül(*657=?0 E nA
äxÒ!=UI?$#5EÒ!$ÁI?$;6CE!=?!Ï¼CW.57$5EÒ*.5¾Ï =?< $;KÖ» KM57$;KM5¾Ì0 >< $;C7Ï1$*Ì$¾=JK 0 ( -57Ò*$ÁI? C7Ï1$;KM5
IU$6CE!=U*ÏTCW.5E$å57Ò*65 Ì6 P,$¼(*K7$;G Ña=¦5EÒ!0 (!5 Ì (*KM=?!ÏìG=?< $CEÏ $;*Ìr$ú=JK » I?K70xKM$;$¼îv=?Ï6L
(!C7$'& ÝU= eG
0 + E 0 ( 5 E &
áO1Ö =?K@!0 5$ræ! Ìr57I?ÐÁÜ1(9 GCW.5E=?ÌÙ57Ò!$; 5EÒ!$Ò!=?Ï Ò!$;C@0 CWG$CD57$;C7ÓK@=? $Ü1(9.57=?0 E :6CE$
!065Î!CE$;Ì=?K7$I?Ð¼ë$;C70ú6*G E Ù=?K01!I?Ðz6ì6Î!Î!CE0'æ=UÓ657=?0 %AáhTK7(*ÌWÒì Ì; K7$ -®=U5Ó'Ð
5E6Í1$]ÓÙ(*I¦5E=UÎ!I?$Ù=U57$;CE657=?0 *K570¾IU0Ì657$5EÒ!$Ó=?!=?ÓÙ(!Ó $;< $#ÑaÒ*$Á(*K7=?!Ï 0 ( -9Ò!0.Ñ4$<1$C-
Ìr0 ><1$CEÏ $9Ìr$DÌ;6Ke5E=UI?I%P,$]Ül(!=¦5E$@Ö» KM5;A
áh ÓÙ(*I¦5E=UÎ!I?$G=UÓ$;*KM=?0 9K-cG$57$CEÓ=U*=U!Ï 0 (a=?K@¾P!=¦5@Ó0 CE$G=UÕÌr(!IU5P9$Ì (*KM$57Ò*$
C7=?Ï Òl5
K7=?G$0 Ö E 4=?KÓ657CE=¦æ +DÑaÒ!$;C7$ =JK
Ì;6I?IU$Gº5EÒ!$]Ø$K7K7=J6ÑaÒ!01K7$]Ìr01ÓÎ90 L
!$l5EK
6CE$DÏ1=U<1$3PlÐ
,! ,DF E X(
Ña=¦5EÒ
¼-* *G $Ü1(96I5705EÒ!$@570 5E6I/l(*ÓÙP,$Ca06Ö®Ñ4$=?Ï Òl5EK;A
=JK
Ó$;1KM(*C7$406Ö957Ò!$aÌr(*C7<..5E(!CE$)0 Ö A.áh5eÑ)0@G=?Ó$*K7=U01*K;-'57Ò!$RI?=U!$K®06ÖÌr0 9Ke5W6l5

ÖÝ01C®:Ül(* G!CE657=JÌÌr0lKe56CE$40.<' I>=UKMÒ* Î9$a1KK7Ò!0.Ña]=?îv=?Ï (*C7$ (>A.ÞRÒ!$R$=?Ï $;>< $;Ìr5701CEK/06Ö

Î901=Ul5)=?5EÒ!$DG=?CE$;Ìn5E=U01*K0 Ö57Ò!$DÓQ e0 C *GÓ=?!0 C4.æ$;K;A ÞRÒ!$D$=?Ï $><.6I?(!$KÓ$; K7(!CE$
57Ò!$]KM57$;$Î!!$K7KR0 Ö 6I?0 *Ï5EÒ!$]Ìr01C7CE$;K7Î,0 *G=?!Ï$=?Ï $9G=UCE$;Ìr57=?0 %A

.%& áhz57Ò!$¾IU$ KM5ÙÓ$;6ãK7Ül(* C7 $ À"/Q ? ]6I?Ï 01C7=U57Ò*Ó3-vÑ)$ºÒ*'< $º KM=?!Ï I?$ºIJ'Ð $;C
IU=?!$; Ca!$r5eÑ40 CEÍÑa=U57Ò$CEC701C4ÖÝ(!*Ìn5E=U01
& E I J 9 F J , , F E *
6Kv+ ,
ω2 ν2
Eigenvectors
of H
P
E
ωmin,2
\ {
ωmin,1 ω1 ν1

L<M7N ¹!¹ y9ikjl_Wgd°cfWdj1gOsM\;j.s©
ÑaÒ!$CE!$ Ií=?K:5EÒ!$>(!ÓÙP,$C@0 Ö57CW6=?!=?!Ï< $Ìn5701CEK;AÞRÒ!$Ø$;KEK7=? =? 5EÒ!=JKÌ K7$57(!CE*K@0 (!5
57Ò!$P,$@57Ò!$]KE6Ó$ K45EÒ!$]Ìr0.<. C7=J6*Ì$
Ó.5EC7=Uæº0 Öv5EÒ!$=U*Î!(5EK;-
I J + 5 E -

ÞRÒl(9K-!$ ÌWÒ$=?Ï $;><' IU(*$:0 Ö =JK6IJK70Ó$ K7(!C7$0 Öv5EÒ!$ÙÌ0.<' C7=J69Ìr$:0 CK7Î!C7$ G¾06Ö®57Ò*$
=U!Î*(5EK IU01!Ï57Ò!$]Ì0 CEC7$KMÎ,0 9G=U*ÏÙ$=?Ï $;*G=?C7$Ìn5E=U0131KaKMÒ!0.Ña3=?3î=?Ï (!CE$'*!A
x2
x1
ldb@seol_y Á\;k^dbeiseolZ}cseol__Wik^_Wj6'_EfEsed;beg]\j>#_Wik^_Wj6;\;kl_Egd;° Z_n\;gh be_Ùseo1_

hgL<q M7beN _n¹\*¹ d;°seo1_ai¦j1ql segi¦jikjlql sghq>\fW_©

K7=U!ÏKEÌ6IJ6CRI?$; C7!=?!ÏCW.57$@=JKRÎ!CE0 P!I?$Ó.5E=?Ì:=?ÓÙ(!IU57=?Î!I?$]G=UÓ$;*KM=?0 9KA!äå$ÑR6l5
0 E5 0ÙP,$DIJ6CEÏ $K70]5EÒ*.5RÌr01l<1$CEÏ $;*Ìr$a=JKÖ»1Ke5R6I?0 !Ï@5EÒ!$@KMÒ* IUI?0.ÑxG=?C7$Ìn57=?0 9K06Ö0 »K7Ó IUI
$=?Ï $><.6I?(!$KD0 Ö r-cÒ!0.Ñ)$;< $;C;-,=¦Ö 0 =JKD570>0I? C7Ï1$]57Ò*$Ñ)$;=UÏ1Ò15WK
Ña=?I?IG=?< $CEÏ $6I?0 !Ï¾57Ò*$
Ke5E$$ÎìG=?C7$Ìn5E=U01*K'ÝIJ6CEÏ $3$=?Ï $><.6I?(!$KÙ0 Ö rAÞ/0¼K7$$¾57Ò!=JKÓ0 CE$3K7Î9$Ìr=Uâ9Ì IUI?Ð -I?$r5(*K
6Ï1 =U¾$ræÎ* *'G -!P!(5a5EÒ!=JKR57=?Ó$]6P,0 (5Ó=U!=?ÓÙ(*Ó
& & ,7. 7 E F ,7. +
F ,7. -5 #
Û
=/V,$;C7$;l57=J.57=?!Ï# 4 *Gº(9KM=?!Ï57Ò*$C7$KM(!IU5a=U35EÒ!$(!ÎG!.5E$$;Ül(*.5E=U01 E Ï1=U<1$;K
/. 7 < /%. F10 /%. #"
/%. F10
%. F ,/. -5
# E
?>(!P5ECE1Ìn57=?!&Ï ,7.¾ÖÝC701ÓP,0657Ò#K7=?G!$;KRÏ =?< $K
. 7 F ,/. < F 0 ,7. %6 %. F ,/. -5
#
áOÖ/57Ò*$:Î*C7$Ö» Ìn5E0 GC F 0 ,7. %)=JKaÙÓ.5EC7=Uæ57CW69KeÖÝ01C7Ó.5E=U0157Ò9.5a6I?Ñ4'ÐK4KMÒ!CE=?!ÍK
Á< $Ìn5E0 C »=ÀA $ A®=U5EK$=?Ï $;><' IU(*$;KÙ IUIRÒ*'<1$Ó6Ï1!=¦5E(*G$¾IU$K7K57Ò96 5EÒ!$ç57Ò!$3(!ÎG!.5E$

$;Ül(*.5E=U01¾Ña=?I?I/Ìr01l<1$CEÏ $1A
Ø0.Ñ G0>$;KÙ57Ò!=JKÒ!$I?ÎzÑa=U57ÒãÌWÒ*0l0lKM=?!Ï#5EÒ!$ºI?$; C7*=U!Ï CE657$;K ºáeG$; IUI?ÐúÑ)$ÑR6l5G=¦Ö×L
ÖÝ$CE$l5ºI?$;6CE!=?!ÏúCE657$K6I?0 !Ïú5EÒ!$ G/= V$CE$l5º$=?Ï $;*G=?C7$Ìn5E=U01*KAÞRÒ*=?Kº=?KK7=?ÓÎ*IU$Á=UÖ57Ò*$
$=?Ï $9G=UCE$;Ìr57=?0 *K:6CE$ÙI?=?!$;G (!Î Ña=U57Ò 57Ò!$Ì0l01CEG!=U*657$.æ$;KD06Ö5EÒ!$Ñ)$;=UÏ1Ò15WKA,áhúKM(*ÌWÒ
Ì K7$ ->5EÒ!$Ñ4$=?Ï Òl5EKR6CE$@(!*Ì0 (!Î!I?$;G369G¾Ñ4$Ì 31K7K7=UÏ1º$ ÌWÒ3Ñ)$;=UÏ1Ò15a=U5EKR0.Ña3IU$6CE!=?!Ï
CE657$
P9 K7$;G0157Ò*$:Ì0 CEC7$KMÎ,0 *G!=U!ÏÙ$=?Ï $><.6I?(!$1AlØ
0.Ñ)$;< $C- =UÖ%5EÒ!$DÑ4$=?Ï Òl5WK) C7$:Ìr0 (*Î!IU$G
57Ò!$;Ñ)$aÓ(*Ke5â*CEKM5CE065E657$ K7(*ÌWÒ57Ò*65 =?KG=? Ï 01*6I[-.=ÀA $ A 57Ò!$DÌr0>0 CWG=?*.5E$R6æ$;KI?=U*$
(!ÎÑa=U57Ò5EÒ!$
$;=UÏ1$*G!=UCE$;Ìr57=?0 *K »K7$$Dî=?Ï (!CE$ (.P nA>ÞRÒ!=JK=JK57Ò!$DÎ!(!CEÎ90lKM$D06Ö/G=J6Ï10 * IU=?ë=?!Ï
57Ò!$]Ø
$;KEKM=J6G=JK7Ì(*K7K7$;G¾$; C7I?=?$CA
"%$r5 P,$@57Ò!$CE065W.57=?0 ¾Ó.57CE=Uæ¾KM(9ÌWÒº5EÒ*.5
+
#
ÑaÒ!$CE$ =?KG!=? Ï 0 96Ic6*G + 9A!ÞRÒ!$]Ìr0lKe5RÖÝ(!*Ìr57=?0 357Ò*$ÁÌ ¾P,$ÑaCE=¦5757$#1K

& & ,7. 7 E F ,7. + +

+ F ,7. # 5 "

QÁ6Í>=?!ÏããÌWÒ*6!Ï1$Á06ÖÌr0>0 CWG=?*.5E$;K5E0 F ,7. ¾KM=?ÓÎ!IU=Uâ*$K5EÒ!$å P90.<1$

$;Ül(*.5E=U01º5E0

& & 7 E + # &

6*Gº57Ò!$@5ECE *KMÖÝ0 CEÓ$Gº(*Î,G!657$$Ü1(9.57=?0 3P,$;Ìr01Ó$;K
. 7 < F 0 %. -5
/ # X(
065E$57Ò9.5 F 0 =?KDG=J6Ï 01*6IcÑa=U57Ò G=? Ï 01*6I/Ì0 ÓÎ,0 !$;15WK F 0 , AÞRÒ!=?K
$;Ül(*657=?0
Ña=UI?I%Ìr01l<1$CEÏ $=UÖ F 0 , ->=ÀA $ A 0 F ÖÝ0 Ca6I?I WA>áOÖÌr01*KM57CW6=?!$;G5E0Ò*'< $: nÿ lû

K7Ì;6IJ6CRIU$6CE!=?!ÏCW.5E$:ÖÝ0 C6I?I%Ñ4$=?Ï Òl5EK)5EÒ!$Ñ4$ÓÙ(*KM5aC7$Ü1(*=UCE$

0 E+
# *

=Uì0 CWG$;C5E0z'< 01=?GãG=U<1$CEÏ $;*Ìr$1-ÑaÒ*$CE$ + =JK57Ò!$#IJ6CEÏ $Ke5$;=UÏ1$><.6I?(!$¾0 Ö zAî!01C
Ö» KM57$;KM5
Ìr01>< $CEÏ $;*Ìr$DÑ)$@Ò*'<1$

0 ( # -
+ 5

áOÖ /, .3=JKIU0 5
KMÓ IUI?$CR5EÒ*6 + 57Ò!$;Ì0 >< $;C7Ï1$*Ì$DÑa=?I?I%P9$<1$CEÐºK7IU0.Ñ 6I?0 !Ï57Ò*$
,7.ÙG=?C7$Ìn5E=U01%A;áhÙÖ» Ìr5;-.Ìr01l<1$CEÏ $;*Ìr$5E=UÓ$4=?KÎ!CE0 Î,0 C757=?0 96I65E05EÒ!$aÌr0 9G=¦5E=U01]>(!ÓÙP,$C

+ ,/.ÁK705EÒ*.5:=¦5:=?K:G$;K7=?CE P!IU$]570Ò*'<1$Ù KDKMÓ IUI6Á$;=UÏ1$><.6I?(!$ÙK7Î!C7$ G#1K

Î90l K7K7=UP* IU$1A

Ø0.Ñ4$< $;C;-cK7=U9Ìr$Ñ4$Ò*'< $CE065E657$G 5E0#P9$º IU=?Ï *$;GåÑa=¦5EÒú57Ò!$¾Ìr0>0 CWG=?*.5E$6æ$;K;-

X( aÌr01*K7=?KM5EK1Ìn5E(*6I?IUÐ306Ö à=U*G!$Î,$*G$;l5 rLhG=?Ó$*K7=U01*6I/$;Ül(*.5E=U01*K;A*ÞRÒ!$CE$rÖÝ01C7$1-!Ñ4$
Ì6ãÌWÒ!0>01K7$ºÁI?$; C7!=?!ÏÁCW.5E$ÖÝ01C$ ÌWÒ¼Ñ4$=?Ï Òl5=?*G$;Î9$;*G$l506Öa5EÒ!$¾0 57Ò!$;CEK;Aä $3KM$;$
57Ò*65a57Ò!$01Î57=?Ó6IcCW.57$:ÖÝ01CR57Ò!$ ( Ñ4$=?Ï Òl5 , =JK 0 ( , + A

0. %1
@B"03%12' A%( & ' îv=?Ï (*C7$ G=JKMÎ!IJ'ÐKåK7$r50 Ö $æ!6ÓÎ!I?$;KGCW'ÑazÖÝCE0 Ó 5eÑ40
@8 6(*KEKM=J6G=?KM57CE=?P!(57$GÙÌI?1K7K7$;KvÌr$l5E$CE$;G]65 ÝL A - L A * *G A - A * nA'ÞRÒ!$)$=?Ï $><.6I?(!$K

06Ö57Ò*$)Ìr0.<. C7=J6*Ì$Ó.57CE=Uæ@ C7$ A * 6*G A &*Aräå$57CW6=?ÙK7=?!Ï I?$IJ'Ð $C/IU=?!$; C/!$5eÑ)01C7Í

Ña=¦5EÒ E =?!Î!(5WK- 0 (!57Î!(5- E Ñ4$=?Ï Òl5WK-c69GP!=J K»K7$$î=?Ï (!CE$B#- ;
(9KM=?!Ï357Ò!$"vQ?
6I?Ï 0 CE=U57Ò!Ó =?ìP*.5WÌWÒãÓ0G$1A)î=UÏ1(!CE$ #G=?K7Î!IJ'ÐK57Ò!$#Ñ4$=?Ï Òl557CWP e$Ìn5701C7Ðz *GT$CEC701C
G(!CE=U!ÏI?$; C7!=?!Ï3ÑaÒ!$ú(*K7=?!Ï#¾I?$; C7*=U!Ï3CW.57$K:06Ö 0 X5 "¾ *G E A "A 0 57$57Ò9.557Ò*$
IU$6CE!=U*ÏCW.5E$ ÀKM$;$ AÜ,A * 0 + E + E $ 5 * E 5 *Ña=?IUI/Ì;6(*K7$G=?< $CEÏ $;*Ìr$K
KR=JKR$<>=?G!$l5aÖÝ0 C 0 E 5 "!A

1.4
1.2
0.8
y 0.6
0.4
ω2
0.2
ω0 ω1
−0.2
−0.4
χ0 χ1
−0.6
−0.8
L<M7N ¹*¹ 6ikZqlk_Rkikjl_n\rb4j1_Es[d;be©

−1
−1.2
−1.4
−1.4−1.2 −1 −0.8−0.6−0.4−0.2 0 0.2 0.4 0.6 0.8 1 1.2 1.4
u®d]fW¦\ghgh_Wga bM\Wj°UbedZÚ^'\lghghi¦\;j¾1ikgOshbei|
l{L 1M/N seik¹ d;Ojl9g¹ fW_Wj.se_Ebe_W\s |À © £ } |À6© ¤ )\j> 6© £1} © ¤7©
îv=?Ï (*C7'$ E K7Ò!0.ÑK:5EÒ!$ºKE6Ó$$ræ!6ÓÎ!I?$(*K7=U*ÏÁKe5E0>ÌWÒ9 KM57=JÌ=?*KM57$ Gå06ÖaP*65EÌWÒúÓ0>G!$
IU$6CE!=U*Ï*A6Ø$;C7$1- @I?$;6CE!=?!Ï@CE657$R06Ö 0 5 E =JK(*K7$;GcAlBD*$Ì6K7$$R5EÒ*.55EÒ!$a57CWPe$Ìn5E0 CEÐ
=?KÓÙ(9ÌWÒç!01=?K7=U$;CÙ5EÒ*6ã=UãP*.5WÌWÒçÓ0G$KM=?*Ìr$30 *IUÐz ç$;KM57=?Ó.5E$¾0 Ö57Ò!$3Ï CW G!=U$;15=?K
(*KM$Gã65$; ÌWÒT=U57$CW.5E=U01%AÞRÒ!$#Ìr0lKe5=JKÎ!I?065M5E$;Gì K ÖÝ(!*Ìr57=?0 ì06Ö:$Î,0ÌWÒ%A<ì$Î,0ÌWÒ
Ò!$CE$@=?KK7=?ÓÎ*IUÐºG!$râ*!$G GK =?!Î!(!5
Î!CE$;K7$l5E657=?0 *K4ÑaÒ!=JÌWÒ%->ÖÝ0 CKM570ÌWÒ*1Ke5E=?Ì:I?$; C7!=?!Ï9-
Weight space Weight space
2 2
1.8 1.8
1.6 1.6
1.4 1.4
1.2 1.2
1 1
0.8 0.8
0.6 0.6
0.4 0.4
0.2 0.2
0 0
−1 −0.8−0.6−0.4−0.2 0 0.2 0.4 0.6 0.8 1 −1 −0.8−0.6−0.4−0.2 0 0.2 0.4 0.6 0.8 1
Log MSE (dB) Log MSE (dB)
0 0
−5 −5
−10 −10
−15 −15
−20 −20
0 1 2 3 4 5 6 7 8 9 10 0 1 2 3 4 5 6 7 8 9 10
epochs epochs
\
{
L<M7N ¹POO>¹ _Wikô.s:shbM\ O_EfEsed;bh \j>#_Ebhbed;b@fW1be'_1 beikjl^k_n\bej1i¦j1^º°?d;b \
í~ ¡º\;jl {

z¢ ¡6©

Ìr0 CECE$;K7Î901*G!Kc5E0 Ñ)$;=UÏ1Ò15(!ÎG!.5E$;K;A.áhÙP*65EÌWÒ%-.6$Î,0ÌWÒÌr01C7CE$;K7Î,0 *G!K%570:0 !$4Ñ4$=?Ï Òl5
(!Î,G*.57$1A
Weight space Weight space

2 2
1.8
1.8 1.6
1.4
1.6
1.2
1
1.4
0.8
1.2 0.6
0.4
1 0.2
0
0.8
−0.2
0.6 −0.4
−0.6
0.4 −0.8
−1
0.2
−1.2
0 −1.4
−1 −0.8−0.6−0.4−0.2 0 0.2 0.4 0.6 0.8 1 −2 −1.6 −1.2 −0.8 −0.4 0 0.4 0.8 1.2 1.6 2 2.4
Log MSE (dB) Log MSE (dB)

0 0
−5 −5
−10
batch −10
−15 −15
−20 −20
0 1 2 3 4 5 6 7 8 9 10 0 1 2 3 4 5 6 7 8 9 10
epochs epochs
_Wikô.sÚshbM\ O_WfEsedbh \;jlé_Ebhbed;b _Wikô.s3shbM\ O_Wf7sed;beik_WgÁ\;jlx_Ebhbed;beg

EfL<1M7beN '¹P_ÙO *1¹ beikjl^gOsed.fMo>\gOsei¦fk_n\bej1i¦j1^°Jd;b
°Jse<L d ki faM7bN k¹~E_n|e\O ~Ebe*¹|ej1~i¦j1jl^1_E© sÀ®dbeshbM\;ikjl_nÁlghikj1^3gOsed.fMo>\;gO|

¢6©

*C.0".0 &%(' A%( :' î=UÏ1(!C7$ K7Ò!0.ÑK)57Ò*$]6CWÌWÒ!=¦5E$;Ìr57(!CE$:ÖÝ0 C< $;C7ÐK7=?ÓÎ*IU$Ó(!I¦L

57=?I?'Ð1$C®!$r5eÑ40 CEÍA.áO5Ò* K a=?!Î!(!5;-"aÒ!=JG!G$;%- *GB401(57Î*(5!0G$1A6ÞRÒ!$CE$6CE$ E Ñ4$=?Ï Òl5WK

6*G E P!=J K7$;K;A*ÞRÒ!$ Ìn5E=U<.657=?0 3ÖÝ(!*Ìr57=?0 #=JK 1 5 $( c5E !Ò % E nA9ÞRÒ*$57CW6=?!=?!Ï
KM$5:Ìr01l5E6=?*K $æ ÓÎ!IU$KaÖÝCE0 Óï$;1ÌWÒ#06Ö E ÌI?1K7K7$;K;A924065EÒÁÌrIJ KEKM$K
C7$Ù8@ (*K7K7=J6ÁG=JKeL
57CE=UP!(!57$;GºÑa=¦5EÒ3KM5E *G! CEGG!$<>=?657=?0 A A&)IJ KEK DÒ*1K)ÙÓ$;6¾06Ö% L D *GºÌI?1K7K E Ò9 K4
Ó$6¾06Ö 7 1A>Þ6CEÏ $5)<.6I?(!$K4 C7$
#L DÖÝ0 CRÌrIJ KEK : *G 7
ÖÝ0 CaÌrIJ KEK E Aî=UÏ1(!C7!$ KMÒ*0.ÑK
57Ò!$]KM570ÌWÒ*1Ke5E=?ÌD57CWP e$Ìn5E0 CEÐÖÝ0 CR57Ò*$$ræ!6ÓÎ!I?$ A
y
ω3
ω1
ω2
ω0
L<M7N ¹PO,¹ u®ol_aZikjlχikZ]\*ZDlseik¦\n'_Ebjl_EsÀ®dbe!©

3 * ')!3> &'
2"0<3C !3 9 ?'-'):' *C'->! % ')!3C>:'
!"0<3
% #""0% 9
ä $#Ì ç(*K7$¾57Ò!$CE$;K7(!I¦5WK06Ö5EÒ!$Î!C7$;<>=U01(*KK7$;Ìr57=?0 ç570Be (*KM57=UÖÝÐçKM$;< $;CE I)0 Ö57Ò!$35EC7=JÌWÍK
G=?KEÌr(9K7K7$;G¾$; C7I?=U$;C;A
* ')! =%
%1!3 >')
% "3 * #!2')" .%1
ÞRÒ!$DCE$;1KM01ÖÝ0 CR5EÒ!$6P,0.< $
57CE=?ÌWÍ=JK457Ò*65Ù!01!ë$;C70Ó$;63=?º5EÒ!$@=U!Î*(5a<' C7=J6P*IU$K
rÌ CE$;.5E$;K$5 ü Uý.ü[û
$=?Ï $;l<. IU(!$1A*ÞRÒ!=JKÓ$; *KR5EÒ!$ÙÌr01*G=U57=?0 #>(!ÓP9$;CÑa=UI?I/P,$]IJ6CEÏ $1-
=ÀA $ A.5EÒ!$
Ì01KM5K7(!C7Ö» Ì$aÑa=UI?I!P,$Ke5E$$Î=?KM01Ó$RG!=UCE$;Ìr57=?0 *K *GKMÒ96I?IU0.Ñã=U065EÒ!$CWKK70@57Ò*65

Ìr0 ><1$CEÏ $9Ìr$ÙÑa=?I?IP9$<1$CEÐÁKMI?0.ÑAcÞRÒ!$KM01IU(5E=U01 =JK:570#K7=UÓÎ!I?ÐÁÎ!CE$Î*C70Ìr$K7KD5EÒ!$=U!Î*(5EK

PlÐ¾KM(!P!57CW Ìn5E=U*Ï5EÒ!$=?CÓ$; *K;A
î!0 CK7=U*Ï I?$:I?=?!$; Ca!$(!CE0 /->57Ò!$$;=UÏ1$>< $Ìn5701CEK40 Ö/57Ò*$]Ø$;KEK7=? »Ña=¦5EÒÓ$6*KaK7(!PL
57CW Ìn5E$;G Î901=Ul5 IU01!Ï57Ò!$¾Î!CE=U*Ì=UÎ96I6æ>$K06ÖR5EÒ!$¾ÌIU01(*Gú06ÖR57CW6=?!=?!Ï#< $Ìn5E0 CW&K ÝCE$;Ì;6I?I
îv=?Ï (*C7$ * nA>áh!Î*(5EK45EÒ*.5RÒ*'< $:ÙIJ6CEÏ $
<' C7=J.5E=U01=?3K7Î!CE$; Gº6I?0 !ÏGW= V$CE$l5aG=?C7$Ìn57=?0 9K
06Ö%5EÒ!$D=?!Î!(!5RK7Î* Ì$
Ña=?IUIÒ*'<1$
]IJ6CEÏ $DÌr0 9G=¦5E=U01º>(!ÓP9$;C4 *GK7IU0.ÑxI?$; C7!=?!Ï9A 9G¾K70
Ñ)$@CE$;Ìr01ÓÓ$;*G C
A&'
!.0" % %$#!2')"0!3 %1=<>C%A"3 * #!2')" .%1

áOÖ:5EÒ!$Á=?!Î!(53<.6CE=? P!IU$K6CE$ÁÌr01C7CE$IJ.5E$;Gc-®5EÒ!=?KºÑa=UI?I
*065ºÓ6Í1$57Ò!$ $CEC701CKM(!C7Ö» Ì$
KMÎ!Ò*$CE=?Ì;6I[-P!(5=U5Ña=UI?I%Î,01KEKM=?P!I?ÐC7$G(*Ì$:=U5EK$;ÌÌ$l57CE=JÌr=U5eÐ A
&)0 CEC7$;I?657$;G=U!Î*(5a<' C7=J6P*IU$K)(9KM(* IUI?ÐÌ (*K7$D5EÒ!$@$=?Ï $;l<1$;Ìr570 CWK0 Ö 570P,$:CE065W.5E$;G
'Ñ4'Ð:ÖÝCE0 Ó 57Ò*$Ìr0>0 CWG=?*.5E$).æ$1K Àî=UÏ1(!C7$ (6
<1$CWKM(*K ('P %5EÒ>(*K®Ñ)$;=UÏ1Òl5(!ÎG!657$;K C7$4!0 5
G$;Ì0 (!Î!I?$;G%A*Û
$Ìr01(!Î!I?$;G3Ñ)$;=UÏ1Òl5EKRÓ6Í1$D5EÒ!$Áè70 !$@I?$;6CE!=?!ÏCE657$@Î,$CÑ4$=?Ï Òl5EêÓ$r5EÒ!0G
0 Î5E=UÓ6I[-5EÒl(9K-Ñ4$@Ò*'< $:57Ò*$@ÖÝ0 I?IU0.Ña=?!Ï57CE=?ÌWSÍ C
%( :'-')%1.02%A% "3 * #!2')" .%1
0.ÑõKM(!Î*Î90lKM$5EÒ*.557Ò!$º=U!Î*(5<.6CE=J6P!I?$;K0 Ö#!$(*C701¼Ò*'< $P,$$;çG$;Ì0 CEC7$;I?657$Gc-

57Ò!$]Ø
$;KEKM=J63ÖÝ0 CR5EÒ!=JK!$;(!C701¾=JKR5EÒ!$#G=J6Ï10 * I%6*G3=U5EKa$;=UÏ1$><.6I?(!$;KRÎ,0 =?l5
6I?0 !Ï57Ò*$
Ìr0>0 CWG=?*.5E$º.æ$;K;A/áhTKM(9ÌWÒç Ì; K7$57Ò!$3Ï CW G!=U$;15=?K!06557Ò!$3P,$;KM5G$K7Ì$l5G=?CE$;Ìn5E=U01
KÌ6¼P,$KM$;$z=?çî=UÏ ('P%A 45Ù5EÒ!$3Î901=Ul5 ®-®6ã6CEC70.ÑõKMÒ*0.ÑK57Ò9.5Ï1CE1G=?$l5G0>$;K
!065@Î901=Ul5@570.ÑR6CWG!K57Ò!$Ó=U*=UÓ(!ÓA%Ø0.Ñ4$< $;C;-,=UÖÑ)$=?*Ke5E$;1G 1K7K7=UÏ1Á$;1ÌWÒÁÑ4$=?Ï Òl5:=U5EK
0.Ña I?$;6CE!=?!Ï3CE657'$ Ý$;Ül(* I57Ò!$=?l<1$CWKM$06Ö57Ò!$Ìr01C7CE$;K7Î,0 *G=?!Ï¾$=?Ï $><.6I?(!$ a5EÒ!$å57Ò*$
G$;KEÌr$;15G=?CE$;Ìn5E=U01¾Ña=?I?IcP9$=?º5EÒ!$]G=?C7$Ìn5E=U01º06Ö57Ò*$:0 57Ò!$;C6CEC70.Ñì5EÒ*.5aÎ,0 =?l5EKaG=?C7$Ìn5EIUÐ
570.ÑR6CWG!K)57Ò!$Ó=?!=UÓ(!Ó'C
# % % !'-!% .%12')3C"3C4 ')2% > &' %1!- %1"4&;
åøMó (>Ë7Êó®ø lò/ÊÇÄDÈ ÇÆ*Èò/ÆTÇ Å!Ë õËeùcóÅ!ËeÇ)Ä òcÅ ÇaÈ?

áhÙ5EÒ!$4ÖÝ0 I?IU0.Ña=?!Ï:Ñ)$RÑa=?IUIP!CE=?$*Ð=?l57CE0>G!(*Ìr$457Ò*$
$ÑR5E0 %-6Ì0 Pe(!Ïl.5E$)Ï1CE1G=U$;l5;-68@6(*KEKML
$ÑR5E0 %-l"%$;< $>P,$CEÏQÁ6CWÜl(*6CWG>569GÙ5EÒ!$ D(*1KM=UL $ÑR5E0 @»2Rî8 ?"®Ó$r5EÒ!0G@»K7$$
I?K70
- - *- " *nA
A% <3 8 .04<&'-"0
Þ/0Ï $5@ (**G$CWKM5E69G=U*Ï¾0 Ö57Ò*$

$ÑR5E0 åÓ$57Ò!0GåI?$r5(*K@CE$;Ì Î!=U57(!IJ.5E$Ù5EÒ!$C7$KM(*I¦5WK
ÖÝC701ÓK7$;Ìn5E=U01 "A7 AXDK7K7(!Ó=U*Ï]Ü1(9 GCW.5E=?Ì4I?01KEKÖÝ(!*Ìn5E=U01& »K7$$ A)Ü9A8 E ;® KG$;Î!=JÌn57$G
=Uî=UÏ1(!C7$ & Ý=?=8r-6Ñ)$RÌ Ì0 ÓÎ!(5E$4 57FDÒ! $aÑ4 $+=?Ï Òl5®(!Î,G*.57$ IU01!ÏD 57Ò! $RI?=U!$K06ÖSAÜ,A8 E OL- E
0
0 +

F
ÑaÒ!$CE$ 0 Ó(*KM5]570#P,$ºÌWÒ!0lKM$;å=?ú57Ò*$CE !Ï $ 0 ºKM=?*Ì&$ =?K=?¼Î!CW Ìr57=JÌr$!0 5
Î9$;CMÖÝ$Ìn57I?Ð#Ül(* GCW.5E=?Ì A!áh#5EÒ!=?K
$;Ül(*657=?0 #=?ÖÝ0 CEÓ.57=?0 Á P901(55EÒ!$Ø
$;KEKM=J6 é=JK5W6Í1$
=Ul5701ÌÌr01(!l5;A>áOÖ/5EÒ!$$CECE0 C)ÖÝ(!*Ìn5E=U01¾ÑR KRÜl(*1GCE657=JÌ
01!$Ke5E$Î3Ñ)01(!IJGºP,$KM(ÕÌ=U$;15R5E0
Ìr0 ><1$CEÏ $ A

K7(*6I?IUÐç57Ò!$ $!$;C7Ï1ÐãK7(!CMÖ»1Ìr$Á C701(!*Gç57Ò!$ Ó=?!=?ÓÙ(!Ó =JKCW.57Ò*$C$I?I?=UÎ*K70 =JGc-)0 C=?
57Ò!$$ræ>5EC7$;Ó$I?=UÍ1$º5E1Ìr0KMÒ!$;IUI[-cG$Î,$9G=U*Ï301 5EÒ!$Ìr0 9G=¦5E=U01!=?!Ï¾0 Ö5EÒ!$Ø$;KEK7=? %A
ÑaÒ!=¦5E$!=?!Ïa5ECE *KMÖÝ0 CEÓ3-nÑ4$I?I Í>!0.Ña:ÖÝCE0 Ó KM=?Ï * I6Î!CE0Ìr$;KEK7=U!ÏRI?=¦5E$CW.5E(!C7$ E - 1Ì ÌWÒ*6!Ï1$
57Ò!=JK$;IUI?=UÎ9KM01=?GK7Ò*6Î,$R570ÙK7Î!Ò!$;C7=JÌ I!KMÒ96Î,$R57Ò!CE0 (!Ï1Ò B + EF »K7$$
î=?Ï (!CE$ ": *G
AÜ,7A # %nPA ?>0D57Ò!$4=?l<1$CWKM$)Ø$;KEK7=? Ù=? AÜ,8A P*1KM=JÌ IUI?ÐKMÎ*Ò!$CE$;Kv0 (557Ò*$)$;C7CE0 CKM(!C7Ö» Ì$

IU0Ì IUI?Ð AlÞRÒ!$aÖÝ01IUI?0.Ña=U*Ï@5eÑ)0Ù Î!Î!CE011ÌWÒ!$;KÌ;6P9$:KMÒ*0.Ña5E0ÙP,$$;Ül(!=?<.6I?$lD5 C » (*K7$a57Ò*$

$ÑR5E0 Á IUÏ10 CE=¦5EÒ!Óí=?Á6#(!l5ECE *KeÖÝ01C7Ó$G¾Ñ4$=?Ï Òl5
K7Î* Ì$]6*G »P G!0(*K7(*6I%Ï1CE1G=?$l5
G$;KEÌr$;15a=?#ÑaÒ*=¦5E$!$G#Ìr0>0 CWG=?*.5E$:K7ÐKe5E$Ó ÀKM$;$]îv=?Ï (*C7$ " - OA
?>(!ÓÓ6CE=Uë;=U!Ï9->57Ò!$
$ÑR5E0 #6I?Ï 01C7=U57Ò!ÓÌ0 >< $;C7Ï1$;K)=U01!$]Ke5E$Î=UÖv5EÒ!$$CEC701C4ÖÝ(!*ÌnL
57=?0 ç=JKÜl(* G!CE657=JÌº69G Ý(*!IU=?Í $Ï1CE1G=U$;l5G$K7Ì$l 5 Ù=¦5=JK=U><.6CE=? l5Ña=U57ÒTC7$KMÎ,$;Ìr55E0
IU=?!$; C57CW6*KMÖÝ0 CEÓ.57=?0 9KÙ0 Ö57Ò!$=?!Î!(5<1$;Ìr570 CWK;AÞRÒ!=JKÓ$;69K57Ò*655EÒ!$#Ìr0 ><1$CEÏ $9Ìr$
57=?Ó$#=JK!0 5Q V,$Ìn5E$;GTP>ÐçKMÒ*=¦Ö×5WK-KEÌ IU=?!Ï¼6*GãCE065E657=?0 ã06ÖD=?!Î!(!5< $;Ìr5701CEK;AØ0.Ñ4$< $;C
0 !$¾06Öa57Ò*$ºÓ6=?çGCW'ÑaP* ÌWÍK=JKÙ57Ò*656 Ø
$;KEKM=J6zÓ657CE=¦æúÓÙ(*KM5P,$Ke5E0 CE$;G
6*G=?>< $C757$Gc-!ÑaÒ!=JÌWÒ5E Í $K ÁV aÎ,$C=U57$;CE657=?0 *K
6*G=JKa5EÒ!$CE$rÖÝ01C7$=?ÓÎ!CE1Ìn5E=?Ì;6IcÖÝ01C

Ó01C7$@5EÒ*6#ÖÝ$;Ñ <. C7=J6P!I?$;K;A ?>=?*Ìr$]57Ò!$]$;C7CE0 C4ÖÝ(!9Ìn57=?0 #=JK=?#Ï $;!$CW6Ic*0 LhÜl(* GCW.5E=?Ì -

57Ò!$;C7$=JK!0Ï (96CW6l57$;$0 Ö4Ì0 >< $;C7Ï1$*Ì$ AáOÖ)5EÒ!$ºØ

$;KEKM=J6å=?K]!065]Î,01K7=¦5E=U<1$G$râ9!=¦5E$ Ý=UÖ
=¦5:Ò* KDKM01Ó$Ùë$CE001C
$<1$#!$;Ï1657=?< $ A=?Ï $;><' IU(*$;KaÑaÒ!$;C7$]57Ò!$$CEC701C
KM(*CMÖ»1Ìr$]=JK 965D01C
KM01Ó$:G=?C7$Ìn57=?0 9K4 C7$DÌr(!CE< $GºG0.Ña>ÑR6CWG n- 57Ò!$;57Ò*$
$ÑR5701¾ IUÏ10 CE=¦5EÒ!ÓõÑa=UI?IcG=U<1$CEÏ $1-
KM057Ò*$]Ø$;KEK7=? RÎ,01K7=¦5E=U<1$G$râ**=¦5E$ AB
ÖÌr01(!CWKM$D57Ò!$]Ø
$;KEKM=J6Ó.5EC7=Uæº0 ÖÓ(!I¦5E=¦L
I?'Ð1$C
*$r5eÑ40 CEÍ>K
=?K:=? Ï1$!$;CE I/!0 5:Î,01K7=¦5E=U<1$G!$râ*!=U57$$<1$CEÐ>ÑaÒ!$CE$ A,î!0 CD57Ò*$;K7$CE$;1KM01*K

57Ò!,$ $;ÑR5701 6I?Ï 01C7=U57Ò*Ó=U =¦5WK@0 CE=UÏ1=U* I/ÖÝ01C7Ó=JK:!065@(*KE6P!I?$ÖÝ0 C@Ï $;!$CW6I!$(*CE I*$r5ML
Ñ)01C7ÍI?$; C7!=?!Ï9AlØ
0.Ñ)$;< $C4=U5Ï =?< $;K4Ï10l0Gº=U*K7=?Ï Òl5EK)ÖÝ0 CG!$< $;IU01Î!=?!ÏÙÓ0 CE$KM01Î!Ò!=JKe5E=?Ì;.5E$;G
6I?Ï 0 CE=U57Ò!ÓK;->1KaG=JK7Ì(*K7K7$;G¾=?¾5EÒ!$@ÖÝ0 I?I?0.Ña=U!Ï9A
U
ω
Λ-½ Θ′
ΘΛ -½
Newton Algorithm here ...... ....is like Gradient Descent

there
output output
ω ω
Network
U Λ -½ Θ Network
input input
L<M7N ¹PO *¹ _Esef7od;°seo1_4olise_Wj1ikjl^@q bedq_Ebhseik_Wgd;°seo1_a4_Esed;j\¦^;d;beiseolZ©

<3*4&2%') 9 "%13;
ÞRÒ!$CE$ C7$K7$< $;CE I/=?ÓÎ901CM5W6l5Î!C701Î9$;CM5E=U$K
=?úÌr0 Q e(!Ï1657$Ï CW G=?$l5@0 Î5E=UÓ=?ë;.5E=U01 C
¦= 5Ù=JK @Ó$r57Ò*0>G%- E :=¦5G0>$;K7 R 5](9KM$5EÒ!$Ø$K7K7=? ú$ræÎ!I?=?Ì=¦5EIUÐ1- :=¦565M5E$ÓÎ5EK
570â*9G#G$;KEÌr$;15:G=UCE$;Ìr57=?0 *Ka57Ò*6557CEÐº5E0Ó=U*=UÓ6I?I?Ð3K7Î901=UI/57Ò!$ÙC7$KM(!IU5D1ÌWÒ!=U$;< $Gº=?#57Ò*$

Î!C7$;<>=U01(*K=U57$;CE657=?0 *K;- =¦5R(*K7$;K4]I?=U*$:K7$; CEÌWÒ%-69GÓ01KM54=?ÓÎ901CM5W6l57I?Ð -S#" =U54Ñ40 CEÍK

0 !I?ÐÖÝ0 CaP9.5EÌWÒI?$; C7!=?!Ï9A
ÞRÒ!$5EÒ!=UCWGÎ!CE0 Î,$C75eÐ:=?KKMÒ*0.Ña=Uîv=?Ï (*C7$ &!A
KEKM(!Ó$)Ñ)$)Î!=?ÌWÍDG$;KEÌr$;15G=UCE$;Ìr57=?0 %-
$ A Ï*A,57Ò!$Ï1CE1G=U$;l5;-957Ò!$; Ñ4$Ó=?!=?Ó=?ë$ IU01!Ï¾¾I?=U!$=?Á5EÒ!=?KG!=UCE$;Ìr57=?0 »IU=?!$K7$;6CWÌWÒ rA
?>(!P*K7$;Ül(!$;15EIUÐúÑ4$ºK7Ò!0 (!IJGå57CEÐå570#â9*Gz G!=UCE$;Ìr57=?0 z6I?0 *Ï#ÑaÒ!=?ÌWÒz57Ò!$¾Ï CW G=?$l5ÙG0>$;K
!065ÌWÒ* !Ï $3=¦5WKG=?C7$Ìn57=?0 /-P!(5Ó$CE$I?Ðz=¦5WKIU$;!Ï65EÒ ÀÌr01P e(!Ï1657$#G=?C7$Ìn5E=U01 n-®P,$;Ì (*K7$
Ó0.<>=?!Ï IU01!Ï57Ò!=JKG=UCE$;Ìr57=?0 zÑa=?I?I)!0 5K7Î901=UI57Ò!$3CE$;K7(!I¦506Öa57Ò*$ºÎ!CE$<>=?0 (*KÙ=¦5E$CW.57=?0 /A
ÞRÒ!$$<10 I?(57=?0 ¾06Ö57Ò!$]G$K7Ì$l5G=?C7$Ìn57=?0 9K $ .5a=U57$;CE657=?0 º=JKRÏ =?< $;31K
$ F $ 7 $ $ +

ÑaÒ!$CE$457Ò!$
ÌWÒ*0 =JÌr$R06Ö $ Ì P,$G01!$R$=U57Ò!$;C Ì;Ìr0 CWG=?!ÏD570]îIU$5EÌWÒ!$;C6*GNa$;$<1$;K
first descent
direction gradients
conjugate
L M/N ¹PO *¹ _Esef7oÙd;°fWdj Ol^\se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j\¢px_7bhbed;bgh1bh°J\;fW_©

direction
$ & $ + & $ E
& $ + + & $ +
0 C ®0 IJ6Í *G3Na=UP*=U$;C7$
$ & &$ F & + $ + ; + $ 5
$ + $ +
ÞRÑ)0G=?C7$Ìn5E=U01*K $ 69G $ + 6CE$@G!$râ*!$G KaÌr01Pe(!Ïl.57$:=UÖ
+ $ +
$
=ÀA $ AÌr0 Qe(!Ï1657$ºG=?CE$;Ìn5E=U01*KÙ C7$01CM5EÒ!0 Ï10 * IG=?C7$Ìn57=?0 9K]=?¼57Ò!$3KMÎ9 Ìr$0 Ö
6¼=JG$l5E=¦5eÐ
Ø$;KEK7=? ]Ó.57CE=UæÀKM$;$)î=UÏ1(!CE$: (XnA$CEÐ@=UÓÎ,0 C75E6l5%ÖÝ01CÌ0 >< $;C7Ï1$*Ì$=UÙP90 57ÒÌWÒ*0 =JÌr$;K/=?K
ρκ−1
ωκ
ρκ
L M/N ¹PO !¹ _Esef7oÙd;°fWdj Ol^\se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j\¢px_7bhbed;bgh1bh°J\;fW_©

Ï10l0GÙIU=?!$RKM$6CWÌWÒ]Î!CE0>Ì$;G(*C7$1Aî*0 C
Î,$C7ÖÝ$;Ìr57I?Ð]Ül(* GCW.5E=?ÌÖÝ(!*Ìr57=?0 Ña=¦5EÒ í<' C7=J6P*IU$K
Ì0 >< $;C7Ï1$*Ì$aÑa=¦5EÒ!=U ÔKM57$;Î*KRÌ6ºP9$@Î!CE0.< $GcA1î*0 C4!0 LhÜl(* G!CE657=JÌaÖÝ(!*Ìr57=?0 *K®01I? Í
6*GTNa=?P!=U$;C7$ R KÌWÒ!01=?Ì$3K7$$;ÓKÓ01C7$3C701P!(*KM5;A&)0 Qe(!Ï1657$Ï CW G=?$l5' Ì6T6IJKM0åP,$
<l=?$Ñ4$;Gì1K¼KMÓ6C75ºÌWÒ!01=?Ì$¾ÖÝ01CºÌWÒ!0>01K7=?!Ïå57Ò!$ÁÓ01Ó$;l57(!Ó 57$CEÓ Íl*0.Ñaã=?x!$(*CE I
!$r5eÑ40 CEÍ5ECE =U!=?!Ï9A*áO5@Ò* K
P9$;$ Î!Î!I?=U$G#Ña=¦5EÒÁIJ6CEÏ $]K7(*ÌÌ$;KEK=?ÁÓÙ(!IU57=ULOI?'Ð1$C!$5eÑ)01C7Í
57CW6=?!=U*Ï0 Î!CE0 P!I?$ÓK®5EÒ*.5R6CE$aÓ0>G!$CW.57$K7=?ë$;GÑa=U57ÒºCE657Ò!$;CIU0.ÑTCE$;G(!9G!6*ÌÐÙ=?57Ò*$
G!.5W!A/Þ)Ð>Î!=?Ì;6I Î!Î!I?=?Ì;.5E=U01*KCW6!Ï1$ÖÝCE0 Ó ÖÝ(!*Ìr57=?0 ç Î!Î!CE0'æ>=?Ó.5E=U01%-C701P90 57=JÌÌr0 l5EC701I
- O->57=?Ó$LOK7$CE=?$;KRÎ!CE$;G=JÌn5E=U013 *G3065EÒ!$CaCE$; I,<. IU(!$G3Î!C701P!I?$ÓKRÑaÒ!$CE$@Ò!=?Ï Ò# Ì;Ìr(!CW ÌÐ
=?KÙÑ4 15E$;GcA&)IU$6CEIUÐ 0 ¼IJ6CEÏ $ *GúC7$G(!*G*6l5 »ÌI?1K7K7=Uâ9Ì657=?0 :Î!CE0 P*IU$;ÓKKe5E0ÌWÒ* KM57=JÌ
P* ÌWÍ>Î!CE0 Î* Ï1657=?0 =JK@Ö»1Ke5E$CA IU57Ò*0 (!Ï1Òz.5M5E$ÓÎ5WK]Ò*'<1$P,$$;zÓ G$5E0 G$â*!$Ó=?!=¦L
P*.5WÌWÒ!$;K E " O-.57Ò!$DÓ6=?G=?KE G!<' l5E6Ï1$a06Ö%Ìr01P e(!Ïl.57$
Ï CW G=?$l5Ó$r5EÒ!0G!KCE$Ó6=?*K57Ò*65
=¦5=JKåP*65EÌWÒãÓ$57Ò!0G ÝÎ* CM5EIUÐzG!(!$3570 57Ò!$Î!CE$;Ì=?K7=U01çCE$;Ül(!=?C7$;Ó$l5EK=UTI?=U!$#K7$; CEÌWÒ
Î!C70Ì$;G(!CE$ rA
=*C!" A% &3 + ! A

ÞRÒ!$ D(* K7=¦L $;ÑR5701 À24î8 ?")Ó$r57Ò*0>G % 4=U57$CW.5E=U<1$I?ÐÌr01ÓÎ*(57$Ka63$;KM57=?Ó657$@06Ö57Ò*$

=U>< $;CEK7$Ø$K7K7=? %-< E :=?KÙ6 F @6I?Ï 01C7=U57Ò*Ó3-<# :CE$;Ül(!=?C7$K@IU=?!$K7$; CEÌWÒú6*G @=U5
Ñ)01C7ÍK40 !I?ÐÖÝ01CaP*.5WÌWÒ3I?$; C7*=U!Ï9A

ÞRÒ!$
Î,01K7=¦5E=U<1$
G$â*!=U57$:$;KM57=?Ó657$0 Öc57Ò!$:=?l<1$CWKM$Ø
$;KEKM=J6=JK4G0 !$:G=?C7$Ìn57I?ÐÑa=¦5EÒ!0 (!5
C7$Ü1(*=UCE=U*ÏÓ657CE=¦æ3=U><1$CWKM=?0 #69G¾P>Ð30 !I?Ð3(*KM=?!ÏÏ1CE1G=U$;l5=UÖÝ01C7Ó657=?0 %A I?Ï 0 CE=U57Ò!Ó=UL
Ì6I?I?Ð#57Ò!=JKÙÌ;6åP9$G!$;KEÌrCE=UP,$;Gú K:ÖÝ01IUI?0.ÑDK C< Dâ9CEKM5Ù3Î90lKM=U57=?< $G$â*!=U57$Ó.5EC7=Uæ =?K
ÌWÒ!01K7$%-$1A Ï9A *- E )5EÒ!$35EÒ!$]KM$6CWÌWÒ¾G=?CE$;Ìn5E=U01¾=JKK7$r5R570
%. %. & /%. %4
®@I?=?!$
K7$;6CWÌWÒÙ=JKÎ,$C7ÖÝ0 CEÓ$;G6I?0 !Ï ,- ÑaÒ!=JÌWÒÏ =?< $K57Ò!$(*Î,G!657$RÖÝ01C57Ò!$
Î*6CW6Ó$r5E$CWK
.5a57=?Ó$'.
%. /. F F10 %. S/%. 45
îv=?* IUI?Ð 57Ò*$#$;KM57=?Ó657$#0 ÖD5EÒ!$Á=?l<1$CWKM$Ø$K7K7=J6T=?K(*Î,G!657$GcAR&)01ÓÎ96CE$;Gç570ú57Ò*$
$ÑR5E0 º IUÏ10 CE=¦5EÒ!ÓÚ5EÒ!$ D(9 K7=¦L $;ÑR570 Î!Î!CE01 ÌWÒ0 *IUÐ!$$G!KÏ1CE1G=?$l5=?ÖÝ0 CEÓ.57=?0 /A
ÞRÒ!$
Ó01KM5)K7(*ÌÌ$;KEKeÖÝ(*;I D(*1KM=UL
$ÑR5E0 6I?Ï 01C7=U57Ò*Óà=JK5EÒ!$
24C70.ÐG$;LhîvI?$r5WÌWÒ!$C7Le8:0 IJG>Ö»6CEPL
?>Ò*6*!0 »2Rîv8 ?"Ó$57Ò!0GcA1ÞRÒ!$a(!ÎG!.5E$aC7(!I?$4ÖÝ0 C®5EÒ!$a$;KM57=?Ó.57$a0 Ö*5EÒ!$a=U><1$CWKM$aØ$K7K7=J6
=?K
/%. < /. F
7 + + + + F
+ +7 +

ÑaÒ!$CE$KM01Ó$ P!P!CE$<>=?657=?0 *K4Ò*'<1$@P9$;$(*K7$;GºÖÝ0 CR57Ò*$@ÖÝ0 I?IU0.Ña=?!Ï @< $Ìn5E0 CWK

& /%. ; F . F %

%. F /. F 45 "
IU57Ò!01(!Ï Ò%-® KÙÓ$l57=?0 !$G¼6P,0.< $1-%57Ò*$¾Ìr01ÓÎ!IU$æ=¦5eÐå=?KÙ0 !I?Ð ÁF n-Ñ)$¾6CE$ºKe5E=UI?I4C7$L
Ü1(*=UCE$;Gz570¼Ke5E0 CE$31 Ó657CE=¦æc-KM0 57Ò*$ IUÏ10 CE=¦5EÒ!Ó =JK01!I?ÐzÎ!CW Ìn5E=?Ì;6I)ÖÝ0 CK7Ó IUI

!$r5eÑ40 CEÍK]Ña=U57Òç*0 LOC7$G(!*G*6l5]57CW6=?!=?!Ï K7$r5WKA®Na$Ìr$l5EIUÐ¼K70 Ó$º<.6CE=J6l5EKÙ$ræ=?KM557Ò*65

6=?Ó 570CE$;G(9Ìr$Ke5E0 CW6Ï1$DCE$;Ül(!=?C7$;Ó$l5EGK »K7$$$1A Ï9A UrA

!* A% &3 !3 9 @B%(#&%13 %(')4 2'
*2' 9

8@6(*KEKeL $;ÑR5701ú *G¼"%$;< $;lP,$CEÏ#QÁ6CWÜl(*6CWG>5Ù IUÏ10 CE=¦5EÒ!Ó % @(*K7$5EÒ!$ºKEÜ1(96CE$ 11Ìr0 P*=

6 Î!Î!CE0'æ=UÓ657=?0 %- E v C7$4Ó6=?!I?Ð]G$;K7=UÏ1!$;G]ÖÝ0 CP*65EÌWÒIU$6CE!=U*Ï*-$ /Ò9'< $)@Ì0 ÓÎ!I?$ræ=¦5eÐ
06Ö #ÁV D69G Ó01KM5@=UÓÎ,0 C75E6l5-*5EÒ!$Ð#Ñ40 CEÍ¾01!I?ÐÖÝ0 C:Ó$6åK7Ül(* C7$G$CEC701C
I?01KEK
ÖÝ(!*Ìn5E=U01*K;A,ÞRÒ!$8@6(*KEKML
$ÑR5701Á6I?Ï 01C7=U57Ò!Óï=JK
I?=UÍ1$]5EÒ!$
$ÑR5701 6I?Ï 01C7=U57Ò*Ó3-9Ò!0.Ñ4$< $;C

57Ò!$]Ø
$;KEKM=J6=JK6Î!Î*C70'æ=?Ó657$GP>Ð5EÒ!$ÙKEÜ1(96CE$D0 Öv5EÒ!$ l Ìr01P!=J6 ÀKM$;$]6IJKM0K7$;Ìr57=?0 (>A E
ÖÝ0 CÖÝ(!C757Ò!$;C
G=JK7Ì(*K7K7=?0
J

+

+
& -5 &
%

ÞRÒ!$:"/$<1$>P9$;C7ÏQÁ6CWÜl(*6CWG>5Ó$r5EÒ!0G=JK4IU=?Í $
57Ò!$8@6(*KEKML
$ÑR5701º6P,0.< $1- P!(!54=U54Ò9 K4
C7$;Ï (!IJ6CE=Uë.5E=U01ÙÎ* CE Ó$57$;C ¾5EÒ*.5)Î!C7$;< $;15WK®=¦5ÖÝC701ÓP!I?0.Ña=?!Ï@(!Î%- =UÖ%KM01Ó$a$=?Ï $><.6I?(!$K
6CE$@K7Ó6I?I +
J
+

7 & -
X(
ÑaÒ!$CE$ G$*0657$K#5EÒ!$ã(*!=¦5eÐ Ó.5EC7=UæcADÞRÒ!$x8@6(9K7K $ÑR5E0 ÚÓ$57Ò!0GÚ=JKÁ<. IU=JGßÖÝ01C
Ü1(9 GCW.5E=?Ì:Ìr0lKe54ÖÝ(!*Ìr57=?0 *KaÒ*0.Ñ)$;< $C4KM=?Ó=UIJ6CRÎ!CE0Ìr$;G!(!C7$@6IJK70Ñ40 CEÍKÑa=U57ÒH@(!I?IUP*1ÌWÍlL
"%$=?P!I?$CÌ01KM5a *G3=?KaÌ;6I?IU$G D.5E(!CE I/8:CE1G=?$l5 »K7$$$ A Ï*A - - E *nA
Æ*Ë7Ê Å>Ç ÊÇ DÉÅ>òíÅ ò ò 1>ËeóÄ ËMÄ WÇÆ óÅ!ËeÇ)Ä ËMÄ
ÚÉDøhÅ!ËMøMó ò%ÆzÄ
òc6Å úÇÆ

ä $)Ña=UI?I1*0.ÑúG!=?KEÌr(*KEK/K7$<1$CW6I.5E$;ÌWÒ!*=?Ül(!$Kv =UÓ$;G65Ì0 ÓÎ!(5E=U!Ï

ÖÝ(!I?I101C/Î* CM5E=? I1Ø$K7K7=J6
=UÖÝ01C7Ó657=?0 3PlÐ » â9!=¦5E$ÙG/= V,$;C7$;*Ìr$@Ó$r5EÒ!0Gc- »P RKEÜ1(96CE$ l Ì0 P!=J636Î!Î*C70'æ=?Ó657=?0
×ÖÝ0 C38@6(*KEKeL $;ÑR5701ì *Gì"%$;< $>P,$CEÏ6LhQÁ6CWÜl(*6CWG>56I?Ï 0 CE=U57Ò!&Ó n- »DÌ Ìr0 ÓÎ!(!5E.5E=U01ì06Ö
57Ò!$G=? Ï 01*6I%0 Ö®57Ò!$Ø$;KEK7=? Á6*G ÀG aP>Ð30 P5W6=?!=?!ÏºÎ!CE0G(*Ìr5D06Ö®5EÒ!$Ø
$;KEKM=J6Á *G
< $;Ìr5701CaÑa=¦5EÒ!0 (5:Ìr0 ÓÎ!(!57=?!Ï57Ò!$]Ø
$;KEKM=J6/A,B
57Ò!$;C
K7$Ó=¦Lh696I?Ð15E=?Ì;6I5E$;ÌWÒ!!=JÜl(!$;Ka57Ò*65
6I?IU0.Ñß5EÒ!$Ìr01ÓÎ*(5E657=?0 å06Ö5EÒ!$ÖÝ(!I?IØ$K7K7=? C7$0 Ó=U5M57$G P,$;Ì;6(*K7$57Ò!$;Ð 6CE$CE657Ò!$;C
Ìr0 ÓÎ!I?=JÌ.5E$;G36*G I?K70CE$;Ül(!=?CE$:Ó lÐÖÝ0 CEÑ4 CEG 2.P* ÌWÍ>ÑR6CWGÎ!C701Î*6Ïl.5E=U01ºKe5E$Î*K "!- * OA
!"3C"0%
" B%(')%(3 %
ä $]Ì;63ÑaC7=U57$@5EÒ!$ l L[57Ò3IU=?!$06Ö57Ò*$]Ø$;KEK7=?

$
& % & 7 $ F &
$

ÑaÒ!$CE$ $

65D565-
DX
65D5654
=?KD< $Ìn5E0 C0 Öë$CE01K
6*G#01!I?Ð¾01!$&Ù65
57Ò*$ÙÍlLÀ5EÒ
Î90lKM=U57=?0 %AÞRÒ!=JKDÌ;6ÁP,$Ù=?ÓÎ!I?$Ó$l57$GÁÑa=U57ÒåKM=?ÓÎ!I?$ÙCE$;Ìr=?Î,$XC DÌr01ÓÎ!(57$Ù57Ò!$Ù570 5E6I

Ï CW G=?$l5)P>ÐÓ(!I¦5E=UÎ*IU$:ÖÝ0 CEÑR6CWG6*GºP* ÌWÍ>ÑR6CWGÎ!CE0 Î* Ï1.5E=U01Ke5E$Î*K;A E DG!G @57057Ò*$

lLÀ5EÒ Î96CW6Ó$r5E$C6*GåÌr01ÓÎ!(57$ Ï16=? 57Ò!$Ï CW G!=U$;15-c6*G â** IUI? Ð @KM(*P57CW Ìr5@P,065EÒ

C7$KM(!IU5EK469GG=?<l=JG$DPlÐ >A>Û
(*$
5E0Ù>(!Ó$CE=?Ì;6I9$CEC701CEK=?5EÒ!=JK)Ì0 ÓÎ!(5W.57=?0 ¾K7ÌWÒ!$;Ó$57Ò*$
C7$KM(!IU57=?!ÏåØ$;KEK7=? zÓ=UÏ1Ò15!065P,$¾Î,$C7ÖÝ$;Ìr57I?ÐúK7Ð>ÓÓ$57CE=?Ì Aváhç57Ò!=JKÌ1KM$=U5KMÒ!01(!IJGzP,$

[ün/ÿ T Eþ@1KaG$;KEÌrCE=?P9$G¾P,$I?0.ÑA

*C!'-%! 0" :3 ') "
!"0<3 > &'A%
!* A% <3 :3 9

@ % #<1% 3 %('-4 2'
*C2' 9 =!.04<&'-"0

KEKM(!Ó=?!ÏÓ$;6KEÜ1(96CE$;GºÌ01KM5aÖÝ(!*Ìr57=?0
& E J F
; +1 F
; *

57Ò!$;¾5EÒ!$Ï CW G!=U$;15a=JK
& F F
% +
-
J %
6*Gº57Ò!$]Ø
$;KEKM=J6¾ÖÝ0 I?I?0.ÑKa K
J
+
7 J F
; + F
5 )"

K7=?ÓÎ*IU=UÖÝÐ>=U!Ï Î!Î!CE0'æ>=?Ó.5E=U0106Öv57Ò!$Ø$K7K7=J6º=JK457Ò*$@KEÜl(*6CE$:06Ö/5EÒ!$'11Ìr01P!=? ÑaÒ!=JÌWÒ
=?KÎ,01K7=¦5E=U<1$KM$;Ó=ULhG$râ**=¦5E$Ó657CE=¦æ¾06ÖG!=UÓ$9KM=?0 C%
J
+

)$"

ÑaÒ!$CE$5EÒ!$aKM$Ìr01*G5E$CEÓ ÖÝC701Ó AÜ,8A #" cÑR K®GCE0 Î!Î,$;G%A'ÞRÒ*=?K®=JK$;Ül(!=?<' IU$;l5v5E0@1K7K7(!Ó=?!Ï
57Ò*6557Ò!$!$r5eÑ40 CEÍ=JK
I?=?!$; CaÖÝ(!*Ìr57=?0 Á0 Ö5EÒ!$]Î* CE Ó$r57$;CEK A
Ï16=?57Ò*=?K
=?K
C7$ G=?IUÐ
=UÓÎ!I?$Ó$l5E$;G#ÖÝ01C5EÒ!$ >LÀ5EÒ Ìr01IU(!ÓÁ0 Ö57Ò!$ 11Ìr01P!=? C!ÖÝ01CD IUIv57CW6=?!=?!ÏÎ*65M57$;C79K-
Ñ)$RÖÝ01C7ÑR6CWGÙÎ*C701Î*6Ïl.57$1-'57Ò!$; E ®KM$557Ò*$
Ìr57=?<l=U5eÐ06Ö,57Ò!$01(57Î*(5)(!*=¦5WK570 6*G0 *IUÐ
57Ò!$ lLÀ5EÒ¼0 (5EÎ!(5]5E0 1- ]P*1ÌWÍlÎ*C701Î*6Ïl.57=?0 úKM57$Î¼=JK5W6Í1$z69Gå57Ò!$Ï1CE1G=?$l5]=?K
ÌÌ(!ÓÙ(*I?657$;G%A

+ ! C') :4&2"034 %( &3 9 9 %(')" #!!" #<%1
"%$r5(9KÌr0 9KM=JG$C:Ó(!I¦5E=¦LOIJ'Ð $CK7ÐKe5E$ÓÚÑa=U57ÒK70 Ó$4ÖÝ(!*Ìn5E=U01*6I*P!IU0ÌWÍKÑa=¦5EÒ , =?!Î!(5WK-
0 (5EÎ!(5EKa *G ÷Î* CE Ó$57$;CEK)06Ö%5EÒ!$:ÖÝ0 CEÓ
r2A 0.Ñ 1K7K7(!Ó$DÑ4$:Íl*$Ñ
DF @F -cÑaÒ!=?ÌWÒå=JK Ó.57CE=UæA%ÞRÒ*$å=¦5]=JKKe5ECE =UÏ1Òl5DÖÝ01C7ÑR6CWG570#Ì0 ÓÎ!(5E$

57Ò!=JKaÓ.5EC7=Uæ

6F + 6F F )" E
F F 7 F5

ä $RÌ ]GC701Î57Ò*$)K7$;Ìr01*G@5E$CEÓ =? A)Ü98A #" E /6*G@5EÒ!$CE$;K7(!IU57=?!Ï

$Ke5E=UÓ657$0 Ö57Ò!$RØ$K7K7=J6
=?K)Î90lKM=U57=?< $@K7$Ó=¦LhG$â*!=U57$ A ÖÝ(!CM5EÒ!$CRCE$;G(9Ìn57=?0 º=?K4 ÌWÒ!=?$<1$;Gc-l=UÖ/Ñ)$D=UÏ1!0 CE$
IUI,P!(5R57Ò*$
G=? Ï 01*6I,57$;C7ÓKR0 Ö' C
DF DF
$ F 5 )"
,F J $ F$ ,
ßKM=?Ó=UIJ6CG$;C7=?<..5E=U013Ì;63P9$]G01!$:57001P5E =U¾57Ò!$ , 57=?Ó$;K , Ó657CE=¦æ DF F6A

+ ! C') :4&2"034 % 9 "0!4<<3C!.A%1"0:3 "3 3C%1*C'-:. 3%(

241ÌWÍ>Î!C701Î*6Ïl.5E=U01]Î!CE0>Ì$;G(*C7$K®ÖÝ0 CÌ0 ÓÎ!(5E=U*Ï57Ò!$DG=? Ï 01*6I!Ø

$;KEKM=J66CE$aÑ4$I?I*Í>!0.Ña
*!- 4- - [A9áO5D=JK
KEK7(!Ó$;G357Ò9.5D$ ÌWÒ#IJ'Ð $;Ca=U#5EÒ!$Ù*$r5eÑ40 CEÍºÒ*1Ka57Ò*$]ÖÝ(!*Ìr57=?0 * I%ÖÝ01C7Ó
, , , , , »K7$$Ùî=?Ï (!CE$ *ÖÝ01C5EÒ!$K7=UÏ1Ó0 =JG!6I%*$r5eÑ40 CE$Í r A
K7=?!Ï57Ò*$
8@6(*KEKeL $;ÑR5701Ù6Î!Î*C70'æ=?Ó657=?0 ÀGCE0 Î!Î!=?!Ï
57Ò!$457$;C7Ó 5EÒ*.5Ìr01l5E6=? %/Ñ4$)01P5E =U C
6F 4F ) % F
)"
$F F$ $
6F DF
$F , % $F F, )" "
6*G F6 F6 F , 5
,F J $ $F $ )"&
äx=¦5EÒ1úP,$=?!Ï¾38@6(*KEK7=? Á!0 *IU=?!$; C7=U5eÐ K:KMÒ!0.Ña =Uåîv=?Ï (*C7$ *ÖÝ01C
5EÒ!$N
24îì*$r5ML
Ñ)01C7ÍK4Ñ)$@01P5E =U F F , F ,F
$F , $F $ )" X(
6*G DF 4F , F , F 5
F, J $ $F $ )"*
ÞRÒ!$Ìr01KM5@06Ö4Ì0 ÓÎ!(5E=U*Ïº5EÒ!$G=? Ï 01*6IK7$;Ìr01*G G!$CE=U<..5E=U<1$;KDP>ÐÁC7(*!!=?!Ïº5EÒ!$;K7$$;Ül(*6L
57=?0 *K@ÖÝCE0 Ó 57Ò!$IJ KM5]IJ'Ð $C:5E057Ò!$â9CEKM50 !$=JK$;KEK7$l57=J6I?IUÐÁ57Ò!$KE6Ó$ K:5EÒ!$CE$Ï1(!I? C
P* ÌWÍ>Î!CE0 Î*657=?0 Î9 KEKR(*KM$GÖÝ01CR57Ò!$Ï1CE1G=?$l5;-$æÌ$Î5R5EÒ*.5a5EÒ!$]K7Ül(* C7$:06Öv57Ò!$Ñ4$=?Ï Òl5WK
6CE$(*KM$G#=?#57Ò!$ÙÑ)$;=UÏ1Ò15E$;G#K7(!ÓKAÞRÒ!=JKa5E$;ÌWÒ!!=JÜl(!$]=JKD Î!Î!I?=U$G=UÁ57Ò!$ èM0 Î!57=?Ó I/P!CW6=?
G!6Ó6Ï1$;êÎ!CE(!!=?!ÏÎ!C70Ì$;G(!CE$ »K7$$ E *nA
z
f( )
y
y 1/2 ||ω−x ||2

ω ωx x
x
L<M7N ¹PO *¹ ®\;fM6q1bedql\;^\seikjl^@seo1_a1i¦\;^;djl\; W_ ghghi¦\;j*¯>ghik^Zd;iU g ¦ _7°?s \;jlm4g eb i¦^;o.s 7©

*C"3C4 %'- 9 *6,<>% A%1"0:3 !3 9 #&%16:'

áhÙÓ6>ÐÓ$r5EÒ!0G!Kv57Ò*65®Ó Í $(9KM$406Ö!5EÒ!$aØ$K7K7=? %-;57Ò!$aØ$K7K7=J6]=JK®(*K7$;G]$æ!ÌrI?(*KM=?< $;IUÐ@=?

Î!C70G(9Ìn5EKÑa=¦5EÒ¾<1$;Ìr570 CA áhl5E$CE$;KM57=?!Ï I?Ð - 57Ò!$;C7$=JK4Ñ4'Ð06Ö%Ì0 ÓÎ!(5E=U!ÏKM(9ÌWÒÎ!C70G(9Ìn5EK
ÿ RÏ 01=U!Ï 57Ò!CE0 (*Ï Òz5EÒ!$¾57CE0 (!P!I?$306ÖDÌ0 ÓÎ!(5E=U!Ï 57Ò*$Ø
$;KEKM=J6ç=¦5WKM$;I¦ÖeAÞRÒ!$¾â*!=U57$
GW= V$CE$9Ìr$Ó$r5EÒ!0G3Ì;6¾ÖÝ(!IUâ*IUI%57Ò!=JKR5E1KMÍÖÝ0 C6# C7P!=U57CW6CEÐ< $Ìn5701C

7: F
)"-
(*KM=?!Ïå0 !I?Ðú5eÑ40 Ï CW G!=U$;15Ìr01ÓÎ*(5E657=?0 *'K »65Î,0 =?l5 69G 7 íCE$;K7Î9$Ìn57=?< $;IU"Ð r-
ÑaÒ!=?ÌWÒ#Ì;63P9$CE$;1G=UI?ÐÌr01ÓÎ!(57$G3Ña=¦5EÒ3P9 ÌWÍ>Î!CE0 Î z=JKaKMÓ6I?I/Ì0 *KM5E 1-5 nA
ÞRÒ!=?K)Ó$r5EÒ!0GºÌ P,$: Î!Î!I?=U$G570Ìr01ÓÎ*(57$D57Ò!$:Î!CE=U9Ìr=?Î*6I,$=?Ï $;l<1$;Ìr570 C)6*Gº$=?Ï $!L
<' IU(*$06Ö ÷P>Ð5EÒ!$Î90.Ñ4$CRÓ$r5EÒ!0GcA*24Ðº=U57$;CE657=?!Ï6*G3K7$r5M5E=U*Ï
/. 7 < %.
#&
/.%
57Ò!$< $;Ìr5701C /%. Ña=UI?IÌ0 >< $;C7Ï1$:5705EÒ!$ÙIJ6CEÏ $Ke5$;=UÏ1$>< $Ìn5701Ca06Ö *G %. :5E057Ò*$
Ìr0 CECE$;K7Î901*G=?!Ïú$=?Ï $><.6I?(!$ E *4- 4- [1A ?>$$ I?K70 ÖÝ0 C36x$<1$xÓ0 CE$Á Ì;Ìr(!CW.5E$
Ó$57Ò!0G¾57Ò9.5 RG0>$;KR!0 5(*K7$Dâ9!=¦5E$]G/= V,$;C7$;*Ìr$K6*G E 4Ò* KaK7=?Ó=?IJ6CÌr01ÓÎ!IU$æ=¦5eÐ1A
xÄ
ó®ø lË ¼ÇÅ
ò ò1>ËeóÄ ËMÄ ÚÉDøhÅ!Ë
.øeóò/ÆçÄòcÅ åÇÆ

Oá 5=?K=Ul57$;C7$Ke5E=U*Ï@570](!9G$CWKe5W6*GÒ!0.ÑìK70 Ó$a06Ö,57Ò!$57CE=?ÌWÍKK7Ò!0.ÑaÎ!C7$;<>=U01(*KMI?ÐÙ=?*(*$*Ì$
0 57Ò!$DØ$;KEK7=? %-.=ÀA $ A1Ò!0.ÑãG!0l$K®57Ò*$
Ø$K7K7=? ÌWÒ96!Ï1$4Ña=U57Ò CEÌWÒ*=¦5E$;Ìn5E(!CE$R *GG$r5W6=?I?K06Ö
57Ò!$=UÓÎ!I?$Ó$;15W.5E=U01%A,Þ)Ð>Î!=JÌ6I?I?Ð -!5EÒ!$$=?Ï $><.6I?(!$ÙG!=?KM57CE=UP*(57=?0 Á0 Ö57Ò!$Ø$K7K7=? ÁI?0l01ÍK
IU=?Í $5EÒ!$]01!$]KMÍ1$r5WÌWÒ!$;G3=? î=UÏ1(!C7$ E C*ÖÝ$;ÑÚKMÓ IUI%$;=UÏ1$><.6I?(!$;K;-!Ó6>Ð¾Ó$G=?(!Ó 0 !$K
6*GÖÝ$;Ñ< $;C7ÐIJ6CEÏ $
01!$;K;A äå$:Ña=UI?I!0.Ñ6CEÏ (!$57Ò*65)5EÒ!$ ?ý.üÀû ÿ¦û :5.ý ! Ña=?IUIcÌ;6(*K7$
57Ò!$@5EC701(!P!I?$:=?357Ò!$@5ECE =U*=U!ÏÎ!CE0Ìr$K7K4P,$;Ì (*K7$ E !- E E

!0 !L[ë;$CE0Ó$; ¾=?!Î!(!5EK01CR!$(!CE0 KM5E.5E$;K EXE

Ña=?G!$<' C7=J.5E=U01*K406Ö57Ò!$]K7$;Ì0 *G3G$;C7=?<..57=?< $K)ÖÝC701ÓI?'Ð1$C4570IJ'Ð $;C
Ìr01C7CE$IJ.5E=U01ºP,$r5eÑ4$$KM5E.5E$<.6CE=? P!IU$KA
Þ/0ã$ræ$ÓÎ!I?=¦ÖÝÐì5EÒ!=JK-4Ñ)$åKMÒ*0.Ñ 57Ò!$ $=?Ï $><.6I?(!$åG=?KM57CE=?P!(57=?0 06Ö¼*$r5eÑ40 CEÍç5ECE =U!$G
0 çB&4NõG!.5W=Uzî=?Ï (!CE$ E Av&)IU$6CEIUÐ1-c57Ò!$;C7$=JK]Ña=JG$ºK7Î!CE$; G 06Öa$;=UÏ1$><.6I?(!$;K ÀKM$;$
îv=?Ï (*C7!$ - *GºÑ4$:0 P*K7$CE< $
57Ò*6545EÒ!$@CE657=?0P,$r5eÑ4$$;º$1A Ï9A15EÒ!$:â*CWKe569G57Ò*$:$;IU$;< $;15EÒ
$=?Ï $><.6I?(!$R=JK6P,0 (5 *!A6ÞRÒ!$I?0 *ÏD5W6=?I!06Ö5EÒ!$a$=?Ï $;l<. IU(!$G!=?KM57CE=UP*(57=?0 @ »K7$$î=?Ï (!CE$ E
=?K:CW.57Ò*$C:Î*6=?ÖÝ(!IP,$;Ì;6(*K7$Ù5EÒ!$CE657=?0¾P,$r5eÑ4$$;Á57Ò*$IJ6CEÏ $Ke5@6*G KMÓ6I?I?$;KM5:$;=UÏ1$><.6I?(!$
Ï =?< $;K:5EÒ!$ºÌ0 *G=U57=?0 *=U!Ï0 Ö45EÒ!$I?$;6CE!=?!ÏÎ!CE0 P!I?$Ó0A IJ6CEÏ $CW.5E=U0#Ìr01C7CE$;K7Î,0 *G!KD5E0Á
P!=UÏG!W= V$CE$*Ì$]=?57Ò!$Ù6æ=?KR0 Ö5EÒ!$]$;IUI?=UÎ9KM01=?G! I/K7Ò*6Î,$;G3$CECE0 CRÖÝ(!*Ìr57=?0 C*57Ò!$ÙI? C7Ï1$CR57Ò*$
CE657=?0*-957Ò!$Ó0 CE$]Ñ)$â**G 5W Ìr0 LOK7Ò!$;IUIKMÒ* Î9$GÁÓ=?!=UÓ*-,ÑaÒ*=?ÌWÒ C7$$ræ>57CE$Ó$;IUÐ#KM57$$;Î
570.ÑR6CWG!K)57Ò!$]K7Ó6I?I%.æ=?Ka *G¾< $CEÐ 9656I?0 !Ï57Ò*$IU01!Ï6æ=?K;A
!0 57Ò!$;CDÏ1$!$;CE IvÌWÒ* CE1Ìn57$;C7=JKM57=JÌ06Ö5EÒ!$Ø
$;KEKM=J6 =U ÓÙ(!IU57=UL[IJ'Ð $;C
!$5eÑ)01C7ÍK
=?KD57Ò*$
KMÎ!CE$;1GçP,$r5eÑ4$$;ãIJ'Ð $;CEK;A®áhTî=?Ï (!CE$ E Ñ4$3CE0 (*Ï Ò!I?ÐzKMÍ1$r5WÌWÒãÒ!0.Ñí57Ò!$ÁK7Ò* Î9$06Ö:57Ò*$
Ø$;KEK7=? ¼<' C7=?$;K]ÖÝC701Ó÷P,$=?!Ï CE657Ò!$;C 965Ù=Uz57Ò!$ºâ*CEKM5IJ'Ð $;C570 P9$;=U!ÏåÜl(!=¦5E$¾KM57$;$Îz=?
0
−0.5 the ratio between the 1st and
−1
the 11th eigenvalues is 8
−1.5
Log10 Eigenvalue
−2
−2.5
−3
−3.5
−4
−4.5
−5
−5.5
−6
0 100 200 300 400 500 600 700 800
Eigenvalue order
/ik^_Ej ;\;k1_ghq_EfEshbelZikj]\R£U\W._7bghol\be_n:_Wikô.segj1_Es[d;be ¢;¡~r¢;¤;£~n
hsL<bMM7\N ikjl¹P_nO *¹ d;j¢;@o>\j>6beikshse_Ej1ikîsegW©
57Ò!$3I?1Ke5IJ'Ð $CA ÞRÒ!=?KQV,$Ìn5EKÙ57Ò*$3I?$; C7*=U!Ï KMÎ,$$Gç69GçÌ zÎ!CE0.<>=?G$36ã=U!Ï1C7$G=?$l5
5703$ræÎ!IJ6=?#57Ò!$K7IU0.ÑßI?$; C7!=?!Ï¾=U IU0.Ñ4$CDI?'Ð1$CWK
69G57Ò!$Ö» KM5 »K70 Ó$r5E=UÓ$01KEÌr=?IUIJ.5E=U!Ï
IU$6CE!=U*Ï=U5EÒ!$
IJ KM5I?'Ð1$CAXì5EC7=JÌWÍ]5E0ÙÌr01ÓÎ,$9K7657$a5EÒ!=?K)G=/V,$;C7$;154K7Ì;6I?$a06ÖcIU$6CE!=?!Ï=?K
570(*K7$
5EÒ!$@=U>< $;CEK7$DG!=? Ï 0 96IcØ$K7K7=? 5E0Ì0 l57CE0 I,57Ò*$:I?$; C7*=U!ÏCE657$ »K7$$6IJK70K7$;Ìn5E=U01
&!A
Dø Ë7Äô
4òvÊÇÄ
È zÆ*Èò%
Æ òcÅ Ça?È Å
Ç É
øhÅ!Ë7øeó ò/Æ
òc6Å úÇÆ
2)$ÖÝ0 CE$ÙÑ4$Ì0 *Ì$l57CW.5E$Ù=? 5EÒ!=JK:K7$;Ìr57=?0 0 Ò*0.Ñ 57035E =UI?0 C@KM$Ìr01*G#0 CWG$;C
5E$;ÌWÒ!!=JÜl(!$;K
ÖÝ0 C57CW6=?!=?!ÏDIJ6CEÏ $)!$r5eÑ40 CEÍK-I?$r5(*Kvâ*CWKe5CE$Î,$;65®K70 Ó$4CE657Ò!$;CÎ,$;KEK7=UÓ=JKe5E=?ÌÖ» Ìr5EK6P,0 (!5
6Î!Î!I?Ð>=U*ÏÌrIJ KEK7=?Ì;6I9K7$;Ì0 *G0 CWG$C)Ó$57Ò!0G!K;AÞ/$ÌWÒ!!=JÜl(!$;K)(*K7=U!ÏÙÖÝ(!I?IØ
$;KEKM=J6º=UÖÝ01C7Ó6L
57=?0 À8@6(9K7K4L $;ÑR570 /-!"%$<1$>P,$CEÏ6LhQÁ6CWÜl(*6CWG>5) *G¾2Rî8 ?"4Ì630 *IUÐ Î!Î!I?Ð570< $;C7Ð
KMÓ6I?IR!$r5eÑ40 CEÍK]5ECE =U*$;Gz=?TP*.5WÌWÒçÓ0G$ -®Ò!0.Ñ4$<1$C57Ò!0lKM$KMÓ IUIR!$5eÑ)01C7ÍK6CE$º!0 5
57Ò!$01!$;K@5EÒ*.5]*$$;GúK7Î9$;$;G=?!Ï#(!Îú5EÒ!$Ó01KM5;A/QÁ01KM5ÙKM$Ìr0 9G 01CEG$;CÓ$r57Ò*0>G*&K »Ì0 P e(L
Ï1.5E$Ï CW G=?$l5-%24î8 ?-A;A#A :CE$;Ül(!=?CE$I?=?!$rLhKM$6CWÌWÒå *GúÌ 5EÒ!$CE$rÖÝ01C7$!0 5]P9$º(*KM$G
=Uú5EÒ!$ºKM570ÌWÒ* KM57=JÌÓ0G$ A/Q 6>Ð 0 Ö45EÒ!$5EC7=JÌWÍKG=?KEÌr(9K7K7$;GåÎ!CE$<>=?0 (*K7IUÐå6Î!Î*IUÐ 0 !I?ÐÁ5E0
P*.5WÌWÒ#IU$6CE!=U*Ï*A9î*C701Ó 01(!C
$æÎ9$;C7=?$*Ì$ÙÑ4$]Í>!0.Ñ 57Ò*65:Ì;6CE$rÖÝ(!I?I?Ðº5E(!!$;G Ke5E0ÌWÒ* KM57=JÌ
Ï CW G=?$l5G$;KEÌr$;15=JKÒ*6CWGç570úP9$.501ãIJ6CEÏ $ÌrIJ KEKM=Uâ9Ì;.57=?0 ãÎ!CE0 P!I?$ÓK;A®î*0 CK7Ó6I?IU$;C
Î!C701P!I?$ÓKa5EÒ*.5@C7$Ül(!=UCE$Ù1ÌÌr(*CE657$CE$;6IULO<' IU(*$;G0 (!57Î!(5WK:IU=?Í $]=?ÁÖÝ(**Ìn5E=U01 6Î!Î*C70'æ=?Ó6L
57=?0 ì0 CÌ0 l57CE0 IRÎ!CE0 P!I?$ÓK;-Ñ)$#K7$$5EÒ*.5ºÌ0 P e(!Ïl.5E$3Ï1CE1G=?$l'5 »Ña=¦5EÒ ®0 IJ6ÍlLON=UP!=?$CE$
Number of Eigenvalues
20
19
18
17
16
15
14
13
12
11 Big killers
10
9
8
7
6
5
4
3
2
1
0
0 2 4 6 8 10 12 14 16
Eigenvalue magnitude
/ik^_Ej ;\;k1_ghq_EfEshbelZikj]\R£U\W._7bghol\be_n:_Wikô.segj1_Es[d;be ;
¢ ¡~r¢;¤;£~n
hsL<bMM7\N ikjl¹_n 9¹ d;j¢;@o>\j>6beikshse_Ej1ikîsegW©
L<M7N ¹ O>¹ lseikU\W._7be_nD\rbef7o1ise_WfEse1be_;¯Wseol_/gh_WfWd;j>1_Ebeik;\seik'_%ikgd;°Use_WjghZ]\;kk_Ebikjkdn®_Ebc¦\W._EbegW©

AÜ,A7 %)0QV$CWK457Ò!$P,$;KM5DÌ0 ÓÙP*=U*657=?0 306ÖKMÎ,$$Gc-!CE$I?=? P!=?IU=U5eÐº69G¾K7=UÓÎ!I?=JÌr=U5eÐ A ?>$;< $;CE I
.5M5E$ÓÎ5WK@(*KM=?!ÏTèMÓ=?!=P*.5WÌWÒ!$;KEê=?ú6Î!Î!I?Ð>=U*Ï3Ì0 Pe (!Ïl.5E$Ï1CE1G=U$;l5
5703IJ6CEÏ $ *G C7$L
G(!*G! l5@Î*C701P!IU$;ÓKDÒ9'< $ÙP,$$; Ó1G$CE$;Ì$l57I?Ð (>- E "- "OA <' C7=J6l5:06Ö4Ì0 Pe(*Ï1.5E$
Ï CW G=?$l5a0 Î5E=UÓ=?ë;657=?0 » Ì IUI?$;GKEÌ IU$G&R8 R K7$$;ÓK=Ul57$;C7$Ke5E=U*Ï C Ò!$;C7$:57Ò*$IU=?!$ÙK7$; CEÌWÒ
Î!C70Ì$;G(!CE$@=?KRCE$Î*I?1Ìr$;G¾P>ÐºB;ÛÚ"/$<1$>P9$;C7ÏQÁ CEÜl(* CEG>545eÐ>Î9$] IUÏ10 CE=¦5EÒ!Ó E OA
8 -! "0 9 "!4<&3!. @B%(#&%13 %(')4 2'
*2' 9
%( 9
Þ/030 P5W6=? 3Ke5E0ÌWÒ* KM57=JÌÙ<1$CWKM=?0 #0 Ö5EÒ!$"%$<1$>P,$CEÏºQÁ6CWÜl(*6CWG>5@6I?Ï 0 CE=U57Ò!Ó 5EÒ!$=JG$
=?K]570 Ì0 ÓÎ!(5E$57Ò*$ºG=J6Ï 01*6I)Ø$;KEK7=? ú57Ò!CE0 (!Ï1Ò¼#C7(*!!=?!ÏÁ$;KM57=?Ó.5E$06ÖR57Ò*$¾K7$;Ìr01*G
G$CE=U<.657=?< $@Ña=¦5EÒ#C7$KMÎ,$;Ìr5R570$;1ÌWÒ¾Î96CW6Ó$r5E$CA!ÞRÒ!$=U9Ke5W6l5E !$01(*KaKM$Ìr01*G¾G!$CE=U<..5E=U<1$
Ì6#P,$Ù01P5E =U*$;G<>=?P9 ÌWÍ>Î!CE0 Î* Ï1.5E=U0131KK7Ò!0.Ña#=U5EÒ!$]ÖÝ01C7Ó(!IJ Ka0 ÖK7$;Ìr57=?0 (A
K
KM0>0 1KÑ4$aÒ*'< $R5EÒ!01K7$aC7(*!!=?!Ï]$;KM57=?Ó.5E$;KÑ4$Ì (*K7$a57Ò!$;Óà5E0ÙÌr01ÓÎ!(57$
=U*G!=U<>=JG(*6I
IU$6CE!=U*ÏCW.5E$;K)ÖÝ0 Ca$ ÌWÒ3Î*6CW6Ó$57$C
0$, 7
#"&

ÑaÒ!$CE$ G$!0 57$K5EÒ!$Ï I?0 P96I*I?$; C7*=U!ÏCW.5E$ -l6*G =JKÙC7(!*!=U*Ï]$;KM57=?Ó.57$
06Öc57Ò*$
G=? Ï 01*6I/K7$;Ì0 *GG$;C7=?<..5E=U<1$Ña=¦5EÒÁC7$KMÎ,$;Ìr5570 , A ú=?KDÎ*6CW6Ó$57$CR5E0Î!CE$<1$l5 0 ,

ÖÝC701ÓßP!IU0.Ña=?!Ï:(!Î=UÌ K7$)57Ò!$aK7$;Ìr01*GÙG!$CE=U<..5E=U<1$$ =JKKMÓ IUI[-'=ÀA $ A.ÑaÒ!$;]5EÒ!$R0 Î5E=UÓ=?ë;.5E=U01$

Ó0.<1$;K4=? ,.5Î* CM5WKR06Ö/5EÒ!$$CECE0 C4ÖÝ(!*Ìr57=?0 %A*ÞRÒ*$C7(!*!=U*Ï$Ke5E=UÓ657$@=?K
Ìr0 ÓÎ!(!57$;G1K
6F F , . % F 6F F , 7 6F GF ,
#& E
$ $ $

ÑaÒ!$CE$ =?K3çK7Ó6I?I:Ì0 *KM5E l557Ò*65G!$r57$;C7Ó=?!$;Kº57Ò*$å Ó01(!l5¾0 Ö]Ó$;Ó0 CEÐã5EÒ*.53=?K

P9$;=U!Ï¾(*K7$;GcA,ÞRÒ!$K7$;Ì0 *G#G$;C7=?<..5E=U<1$;K
Ì;6#P,$Ì0 ÓÎ!(5E$;G#Î!CE=?0 Ca5E057CW6=?!=?!Ï0.<1$Ca$ A Ï*A
KM(*P*KM$5D0 Ö5EÒ!$]5ECE =U*=U!Ï¾KM$5;A ?=U*Ì$]5EÒ!$Ð#ÌWÒ* !Ï $01!IUÐ3< $;C7ÐK7IU0.ÑaI?Ð5EÒ!$Ð0 *IUÐ3!$$G
5703P9$C7$;$;KM57=?Ó.57$G#$<1$CEÐ3ÖÝ$ÑÚ$;Î90ÌWÒ*K;<A
065E$Ù5EÒ*.5:57Ò!$ G*G=¦5E=U01*6IÌ01KM5D0.< $;C
CE$Ï1(!I? C
P* ÌWÍ>Î!CE0 Î* Ï1657=?0 #=JKD*$Ï I?=?Ï =?P!IU$ *G Ì0 >< $;C7Ï1$*Ì$Ù=JK 1K:¾CE(!IU$0 Ö57Ò>(!ÓP Á6P,0 (!5
57Ò!CE$$:57=?Ó$;KRÖ»1Ke5E$CR5EÒ*6#Ì C7$ÖÝ(!IUI?Ð5E(!!$;GKM570ÌWÒ*1Ke5E=?Ì:Ï CW G!=U$;15 IUÏ10 CE=¦5EÒ!ÓA
áhîv=?Ï (*C7$ E E 6*G E @Ñ)$DKM$;$a57Ò!$DÌr0 ><1$CEÏ $9Ìr$R06Ö57Ò*$DKM570ÌWÒ* KM57=JÌaG=J6Ï10 * I*"%$;< $!L
P9$;C7ÏQÁ CEÜl(* CEG>54Ó$r57Ò*0>G #"& ÖÝ01C]5E0.Ð$ræ!6ÓÎ!I?$@Ña=¦5EÒº5eÑ40G/= V,$;C7$;15K7$r5WKR06ÖvI?$; C7!L
=U!ÏCW.5E$;K;AlBDP><>=U01(*KMI?Ð5EÒ!$$ræÎ,$CE=UÓ$;154KMÒ!0.Ñaî=?Ï (!CE$ EXE Ìr01l5E6=?*K®ÖÝ$;Ñ)$;C *(*Ìr57(*657=?0 *K
57Ò* 3=?#î=UÏ1(!C7$ E G(*$@570K7Ó IUI?$CRI?$; C7!=?!ÏCW.57$KA

*C"3C4 %'-"3C " !. "4&%13;#!!.*C%
!#&%16:'=<>C% A%1"!3
áh57Ò!$aÖÝ01IUI?0.Ña=?!Ï@Ñ)$Ï1=U<1$457Ò!CE$$a5EC7=JÌWÍKÖÝ0 C4Ìr0 ÓÎ!(!57=?!Ï@57Ò!$
Î!C7=?*Ì=UÎ* I!$=?Ï $;!<.6I?(!$2 $;ÌrL
570 C¾06Ö5EÒ!$ Ø
$;KEKM=J6xÑa=U57Ò!01(5¾Ò9'<l=?!Ï¼5E0ãÌ0 ÓÎ!(5E$#57Ò!$úØ$K7K7=J6x=U5EK7$IUÖeA4Na$;Ó$ÓÙP,$C
57Ò*65=?TK7$;Ìr57=?0 A!(Ñ4$3 I?K70 =?l57CE0>G!(*Ìr$Gç Ó$57Ò!0Gz570ú6Î!Î!CE0'æ=UÓ657$5EÒ!$KMÓ6I?I?$;KM5
$=?Ï $><1$;Ìn5E0 C06Ö:57Ò!$ÁØ
$;KEKM=J6 ÝÑa=U57Ò!01(5ºÒ*'<>=?!Ï 570¼Ìr01ÓÎ*(57$5EÒ!$ÁØ$K7K7=? Ù57Ò!CE0 (*Ï Ò
'< $CW6Ï1=U*Ï »K7$$ I?K70 E * *nA
Weight space
2
Learning 1.8
rates: 1.6
η0 = 0.12
η1 = 0.03
1.4
η2 = 0.02 1.2
Hessian
0.8
largest
eigenvalue: 0.6
λ max= 0.84 0.4
0.2
0
−1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1
Maximum Log MSE (dB)

admissible 0
Learning
rate (batch): −5
η max= 2.38 −10
−15
−20
0 1 2 3 4 5 6 7 8 9 10
epochs
.sed.f7ol\;gOseikf@ i¦\;^d;j>\vy*_W'_Wj6{_Ebe^| \b .>\rbM s4\;k^dbeikseo1Z©!pa\sM\gh_Es4°?bedZõ¢ \lgO|

hgL<i¦\M7N jl¹g) *i¹ seo~W_E½1\;Zq1¦_EgW©>u®o1_
j1_Es[d;beo>\;gdj1_¦ikj1_n\b)lj1iksn}¢:ikjlql seg\;j>3~d;1seq11sn}1iÝ© _©

seo be_W_aq>\rbM\;Z_Ese_7beg ¢
®_Wik^;o6segW}9~a{li¦\g 7©
Weight space
2
Learning 1.8
rates: 1.6
η0 = 0.76
η1 = 0.18
1.4
η2 = 0.12 1.2
Hessian
0.8
largest
eigenvalue: 0.6
λ max= 0.84 0.4
0.2
0
−1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1
Maximum Log MSE (dB)

admissible 0
Learning
rate (batch): −5
η max= 2.38 −10
−15
−20
0 1 2 3 4 5 6 7 8 9 10
epochs
.sed.f7ol\;gOseikf@ i¦\;^d;j>\vy*_W'_Wj6{_Ebe^| \b .>\rbM s4\;k^dbeikseo1Z©!pa\sM\gh_Es4°?bedZõ¢ \lgO|

hgL<i¦\M7N jl¹g) *¹iseo~W_E½1\;Zq1¦_EgW©>u®o1_
j1_Es[d;beo>\;gdj1_¦ikj1_n\b)lj1iksn}¢:ikjlql seg\;j>3~d;1seq11sn}1iÝ© _©

seo be_W_aq>\rbM\;Z_Ese_7beg ¢
®_Wik^;o6segW}9~a{li¦\g 7©
%(' % C 9 ä $CE$Î,$;65a57Ò!$CE$;K7(!IU506Ö®0 (!CG=JKEÌr(*KEKM=?0 =?#KM$Ìn57=?0 (A ""C!Ke5W6C757=?!Ï
ÖÝC701ÓíCE *G0 Óí=U!=U57=J6I/< $;Ìr5701C -!57Ò!$=U57$;CE657=?0
.

Ña=UI?I*$;< $l5E(*6I?IUÐÌr01l<1$CEÏ $4570]57Ò!$Î*C7=?*Ìr=?Î* I*$=?Ï $;>< $;Ìr5701C »0 C4@< $;Ìr5701C=U5EÒ!$Î!CE=?*Ìr=?Î*6I
$=?Ï $9KMÎ*1Ìr$ ) *G
Ña=?I?I/Ìr01l<1$CEÏ $D57057Ò*$]Ìr0 CECE$;K7Î901*G=?!Ï$;=UÏ1$><.6I?(!$ 4- OA
.0&' !3"0<3
!065EÒ!$C@Ó$r5EÒ!0GÁÓ6Í1$;KD(*KM$06Ö5EÒ!$Ö» Ìn5:57Ò9.5KMÓ6I?IÎ9$;CM5E(!CML
P*.5E=U01*KR06Ö57Ò!$Ï1CE1G=?$l5R I?K70IU$ Gº57057Ò*$Î!C7=?*Ì=UÎ* Ic$=?Ï $;l<1$;Ìr570 CR0 Ö
.
% 7 F
#&

ÑaÒ!$CE$ #=?K@K7Ó6I?I!Ìr0 9Ke5W6l5;A1BD!$R=U57$;CE657=?0 06Ö*5EÒ!=JKÎ!CE0>Ì$;G(*C7$4C7$Ül(!=UCE$;Kv5eÑ40:ÖÝ0 CEÑ4 CEG
6*Gº5eÑ)0P*1ÌWÍ>Ñ4 CEGºÎ!C701Î*6Ïl.5E=U01ºKe5E$Î*KaÖÝ0 Ca$;1ÌWÒ¾Î9.5M5E$CE¾=?357Ò!$@5ECE =U*=U!ÏK7$r5A
3.0"03%
*2"&3 &> ÞRÒ!$ÖÝ0 I?IU0.Ña=?!ÏCE(!I?$ÙÓ6Í1$;KD(*KM$06Ö5EÒ!$CE(!!*=U!Ï3'<lL
$CW6Ï $D57001P5E =U¾57Ò*$I? C7Ï1$;KM54$;=UÏ1$><.6I?(!$@06Ö/5EÒ!$]'< $;CE Ï $:Ø$;KEK7=? ¾<1$CEÐÖ» KM5
. F 7
7 F 5 #&

Þ/0K7(!ÓÓ C7=?ë$1->57Ò!$$;=UÏ1$><.6I?(!$ 2.< $Ìn5701C4Ì0 ÓÎ!(5W.5E=U01*6K C
AaCE *G0 Óí< $;Ìr5701C4=JKÌWÒ!0lKM$;ÖÝ01C=U*=¦5E=? IU=?ë;657=?0 306Ö -
E Aa6=?!Î!(5
Î9.5M5E$CE=?K
Î!C7$KM$;l57$;G¾Ña=U57ÒÁG$KM=?C7$G30 (5EÎ!(5;-,ÖÝ0 CEÑ4 CEG36*G3P*1ÌWÍ>Ñ4 CEG
Î!CE0 Î* Ï1.5E=U01%-Ke5E$Î3=?KÎ9$;CMÖÝ01C7Ó$;G369G5EÒ!$Ï CW G=?$l5WK a C7$@KM570 CE$;G%-
!A

=?Ka1G!G$Gº5E057Ò!$]Ì(!C7CE$l5aÑ4$=?Ï Òl5a< $;Ìr5701C -
AaÖÝ01C7ÑR6CWG6*G#P9 ÌWÍ>Ñ4 CEG3Î!CE0 Î96Ï1657=?0 Ke5E$Î =?K
Î9$;CMÖÝ01C7Ó$;GÁÑa=¦5EÒ#57Ò!$Î,$C757(!CEP9$G
Ñ)$;=UÏ1Òl5R<1$;Ìr570 Ca *G¾57Ò!$Ï1CE1G=U$;l5EK R C7$KM570 CE$;G%-
"A457Ò!$G!W= V$CE$*Ì$ 1 F ;@=?KÌ0 ÓÎ!(5E$;Gå6*G 57Ò*$CE(!!*=U!Ï#'<1$CW6Ï $Ù06Ö
57Ò!$$;=UÏ1$>< $Ìn5E0 CR=?KR(*Î,G!657$Gc-
&!ARÑ)$@I?0>0 Î3ÖÝC701Ó E O-L & (*15E=UIvC7$ K70 * P!IUÐKM5E P!IU$@CE$;K7(!IU5=?KR01P5E =U!$GÖÝ01C -
(>A457Ò!$01Î57=?Ó6I%I?$; C7*=U!ÏCW.57$@=JK457Ò!$;#Ï =?< $;¾ K
0 ( 5
áhî=?Ï (!CE$ E Ñ4$aKM$;$457Ò!$R$<10 I?(57=?0 06Ö957Ò!$R$=?Ï $;><' IU(*$41KDÖÝ(!9Ìn57=?0 06Ö957Ò!$R>(!ÓP9$;C06Ö
Î*.5757$CEÎ!CE$;K7$l5E657=?0 *K,ÖÝ01CvR!$;(!CW6I6!$5eÑ)01C7ÍD=U]Ò*6*G!ÑaC7=U5M5E$]ÌWÒ* CE1Ìn57$;CC7$Ìr0 Ï1!=U57=?0
5E K7ÍAáh Î!CW Ìr57=JÌr$Ñ)$ G*6Î5@57Ò*$I?$; ÍÁKM=?ë$06Ö)57Ò!$CE(!!!=?!Ï'< $;CE Ï $]=? 01CEG!$C:5703Ï $5
ÖÝ$Ñ4$C *(*Ìr57(*657=?0 *@K À K6IJK70 =?*G=JÌ657$;Gã0 ç57Ò!$â9Ï (!CE$ rAáhã57Ò*$¾â9Ï (!CE$Ñ)$KM$;$357Ò*65
.Ö×57$;C]ÖÝ$;Ñ)$;CÙ5EÒ*6 Î*65M5E$CEzÎ!CE$;K7$l5E657=?0 *K@5EÒ!$¾Ì0 CEC7$Ìn5Ù01CEG!$C]0 ÖÓ Ï !=U57(9G$ÖÝ01C
57Ò!$¾$=?Ï $><.6I?(!$1-%=ÀA $5EÒ!$I?$; C7!=?!ÏÁCW.5E$=?KÙC7$ ÌWÒ!$GcAvî*C701ÓÔ5EÒ!$º$æ>Î,$CE=?Ó$;l5EK]Ñ4$º I?K70
0 P*K7$CE< $D57Ò*65a57Ò!$ 9(*Ìn5E(*.5E=U01*KR06Ö57Ò!$]'<1$CW6Ï1$DØ$K7K7=J630.< $C)57CW6=?!=?!Ï6CE$KMÓ6I?I[A
80
70
60
50
eigenvalue
40
30
γ=0.003
γ=0.01
20
10
0
0 50 100 150 200 250 300 350 400
γ=0.1 γ=0.03 Number of pattern presentations
/'d;k1seikdj#d°seo1_]_Wik^_Wj6;\;kl_Ù\;g:\°J1jlfEseikdj#d°seol_]j6lZ:{_7bd;°q>\rshse_Ebejq1be_Egh_Wj1|
MsL<\rM7seN ikd¹jl g@,¹ °?d;b]\gho>\rbe_n#®_Wikô.s]j1_Es[d;be3iseoå¡º¦\W._EbegW} ;£ ;¤3fWdj1jl_Wf7sei¦d;jlg\j>¼~r¢;;¤º°Ube_W_
ql\bM\Z_Ese_EbegW©lu®ol_RshbM\;ikj1i¦j1^@gh_EsfWd;jlghikgOseg)d°®~n;o>\j>6beikshse_Ej1ik^;iksegW©
áh î=UÏ1(!C7$ E "º6*G E &Ñ4$KM5E CM5:Ña=¦5EÒÁ5EÒ!$KE6Ó$=U!=U57=J6IÌ0 *G=U57=?0 9K-6*G Î9$;CMÖÝ01C7Ó
â!æ$;G3>(!ÓÙP,$C0 Ö$;Î90ÌWÒ*KÑa=¦5EÒ3I?$; C7*=U!ÏCW.5E$;KÌ0 ÓÎ!(5E$;G3P>ÐºÓÙ(*I¦5E=UÎ!I?Ð>=U*Ï57Ò!$]Î*C7$L
G=?Ìr57$GI?$; C7*=U!Ï:CW.57$4P>ÐÙ:Î!CE$;G$â*!$;GÌr01*KM5E6l5A6&)Ò*0l0lKM=?!Ï@Ìr01*Ke5W6l5»=ÀA $ A (*KM=?!Ï:57Ò*$
Î!C7$G=JÌn57$G0 Î5E=UÓ I/CW.57$a6I?ÑR'Ð>KÏ =?< $;KC7$KM=JG(* I%$CEC701CEKRÑaÒ*=?ÌWÒ C7$<1$CEÐ¾ÌIU0lKM$@5E057Ò*$
$CEC701C ÌWÒ!=?$<1$;GP>Ð57Ò!$DP9$Ke5RÌWÒ!0 =JÌr$0 Ö57Ò!$:Ìr0 9Ke5W6l5;A1áh065EÒ!$C)Ñ)01CEG!K;-.5EÒ!$ºè7Î!C7$G=JÌn57$G
0 Î5E=UÓ6IcCW.5E$;ê=JKR0 Î5E=UÓ6I/$!01(!Ï Ò%A
2.5
2
MEAN SQUARED ERROR
1.5
1 epoch
2 epochs
1
3 epochs
4 epochs
5 epochs
0.5
0
0 0.250.50.75 1 1.251.51.75 2 2.252.52.75 3 3.253.53.75 4
LEARNING RATE
PREDICTED OPTIMAL LEARNING RATE
_W\;jzg .>\be_Wz_7bhbed;b\g\°J1jlfEseikdjçd;°seo1_ºbM\rsei¦d {_EsÀ®_W_Wjzk_n\rbejlikjl^ÁbM\se_¾\;jl
qL<beM7_nN 1¹ik fEse*¹_W d;q1seikZ]\;k_n\rbejlikjl^ºbM\se_°?d;bÙ\°JlkÁfWd;jljl_EfEse_nÁjl_EsÀ®d;be ¤;£ #; ~n 7©u®o1_
shbM\ikjlikjl^@gh_7s)fEdjlghikgOsegd;°/;:ol\;j>6beishse_Wj1ik^;iksegW©
2.5
2
MEAN SQUARED ERROR
1.5
1 epoch
1
2 epochs
3 epochs
4 epochs
0.5
5 epochs
0
0 0.25 0.5 0.75 1 1.25 1.5 1.75 2 2.25 2.5 2.75 3
LEARNING RATE
PREDICTED OPTIMAL LEARNING RATE
_W\;jzg .>\be_Wz_7bhbed;b\g\°J1jlfEseikdjçd;°seo1_ºbM\rsei¦d {_EsÀ®_W_Wjzk_n\rbejlikjl^ÁbM\se_¾\;jl
qL<beM7_nN 1¹ik fEse*_W¹ ådq sei¦Z]\)k_n\rbejlikjl^bM\rse_°Jd;b\gho>\rbe_n _Wikô.sj1_Es[d;beÁiseoz¡3¦\n'_Ebeg ~W'¢r£
~n¡ ;¤ Á¢ #£ å~n ú~n 7} £ ;¤ kd.fn\ ÙfWd;jljl_EfEseikdjlg\;jlã~r¢;;¤°?be_E_ºql\bM\Z_Ese_Ebeg
ghol\be_nÙ®_Wikô.seg 7©lu®ol_RshbM\i¦j1ikjl^gh_EsfWd;jlghikgOsegd;°~n;@ol\;j>6beishse_Wj i¦^;isegW©
Â Ë >ÊcÉ?1>ËeÇÄïóÄ
È åÇÄ
Êcø7É?>ËeÇÄ

ÌÌ0 CWG=?!Ï¼570ã57Ò*$ CE$;Ì0 ÓÓ$*G!657=?0 *KºÓ$l57=?0 !$G6P,0.< $1-)çÎ!CE1Ìn5E=¦5E=U01!$CºÖ» Ìr=?!ÏT
ÓÙ(!IU57=UL[IJ'Ð $;CR!$(!CW6Ic*$r5a57CW6=?!=?!ÏÎ!CE0 P!I?$ÓÑ40 (*I?G¾Ï 057Ò*C701(!Ï Ò¾57Ò!$@ÖÝ01IUI?0.Ña=?!ÏKM57$;Î*KDC
KMÒ>( $@5EÒ!$$ræ!6ÓÎ!I?$;K
Ìr$;15E$CR5EÒ!$=U*Î!(5
<.6CE=J6P!I?$;K4P>ÐºK7(!P57CW Ìr57=?!Ï57Ò!$Ó$6
!0 CEÓ6I?=Uë;$:57Ò!$=?!Î!(5<. C7=J6P!I?$:570Ke5W6*G*6CWG¾G$;<>=?657=?0 306Ö
=¦Ö®Î,01KEKM=?P!I?$ -*G$Ìr01C7CE$IJ.5E$57Ò*$=U!Î*(5
<.6CE=? P!I?$;K;A
Î!=JÌWÍº!$r5eÑ40 CEÍÑa=U57Ò357Ò!$]K7=?Ï Ó0 =JGÖÝ(**Ìn5E=U01K7Ò!0.Ña3=U3â*Ï1(!CE$
KM$5a57Ò!$@5W6CEÏ $54<.6I?(!$KaÑa=¦5EÒ!=?¾5EÒ!$CW6!Ï1$D0 Öv5EÒ!$]KM=?Ï Ó01=?Gc->5eÐ>Î!=JÌ IUI?Ð 7 @6*G¾ L A
=U*=¦5E=? IU=?ë$@5EÒ!$Ñ)$;=UÏ1Òl5EK4570CW6*G!0 Ó<.6I?(!$Ka KRÎ!CE$;KEÌrCE=UP,$;G¾P> Ð &*A
ÞRÒ!$@Î!C7$ÖÝ$CEC7$GºÓ$57Ò!0G¾ÖÝ0 CR5ECE =U!=?!Ï57Ò*$!$r5eÑ40 CEÍKMÒ*0 (!IJGºP,$Î!=JÌWÍ $G¾1K4ÖÝ0 I?IU0.ÑKDC
=¦Ö957Ò!$)57CW6=?!=?!Ï@KM$5=JKI? C7Ï1:$ ÝÓ0 CE$)57Ò*
ÖÝ$ÑzÒ>(!*G!C7$GÙKE6ÓÎ!I?$; K %69G]CE$;G(!9G!6l5;-
6*G=UÖ57Ò*$]5E1KMÍ3=JK
ÌrIJ KEK7=¦â9Ì;.5E=U01%-*(*K7$ÙKM570ÌWÒ*1Ke5E=?ÌÏ1CE1G=?$l5Ña=¦5EÒ Ì C7$ÖÝ(!I%5E(!!=?!Ï*-
0 Ca(*K7$:57Ò!$]KM570ÌWÒ*1Ke5E=?Ì@G=J6Ï10 * Ic"%$<1$>P,$CEÏQÁ CEÜl(* CEG54Ó$r5EÒ!0GcA
=¦Ö57Ò*$@57CW6=?!=U*ÏK7$r5a=JKR!065a5E0l0IJ6CEÏ $ ->01Ca=¦Öv57Ò!$@5W K7Í=?KRCE$Ï1C7$K7K7=?0 %-l(*K7$@Ì0 P e(*Ï1.5E$
Ï CW G=?$l5A
&)I?1K7K7=?Ì;6IcK7$;Ìr01*G>LO0 CWG$C4Ó$r5EÒ!0G!K6CE$@=UÓÎ!CW Ìr57=JÌ Ic=U#6I?Ó01KM56I?Ic(*KM$ÖÝ(!I/Ì; K7$;K;A
ÞRÒ!$D*0 LOIU=?!$6CRGÐ>*6Ó=JÌK)06ÖKM570ÌWÒ*1Ke5E=?Ì
Ï CW G=?$l5RG$;KEÌr$;15R=?ºÓÙ(*I¦5E=¦LOI?'Ð1$C4!$(*CE I
!$r5eÑ40 CEÍK-6Î96C757=JÌr(!IJ6CEIUÐ K=¦5RÎ9$;CM5W6=?*K5E0ÙÏ1$!$;CE IU=?ë;657=?0 %-.=JK)KM57=?I?I*Ö» CÖÝCE0 Ó P9$;=U!ÏÑ)$;IUI
(!*G$;CEKM570>0GcA1QÁ0 CE$a57Ò!$;0 CE$r5E=?Ì;6I!Ñ40 CEÍ *GKMÐKM57$;Ó657=JÌa$ræÎ,$CE=UÓ$;15W6I9Ñ)01C7Í=?K!$$G$;GcA
8 3C ,.% 9 4<%
%(3; A "A "A 2:A HA LhNA6Q¼A6Ï1CE657$ÖÝ(!IUI?ÐÙ1ÌWÍl*0.ÑaIU$GÏ $4ÓÙ(5E(*6I
$ræ!ÌWÒ*6*Ï $:Ï CW6l5EK)ÖÝCE0 Ó :Û :
Ûà6*$G ?!î)A
ò Eò/Æ!ò/Ä
ÊòC
~©
©!t)Z]\rbei×©4)_W1bM\k_n\bej1i¦j1îkjºgOshbelfEse be_nq>\rbM\;Z_Ese_7bRghq>\fW_Wg jl\se bM\;,beik_WZ]\jljli¦\j
^bM\ i¦_Ej6sn©YÀj i¦fMo>\_Wv )© dW_Ebn} ikfMo>\;_E/YM©*d;bM1\;j*},\j>u®old;Z]\;ga`_7seghf7o1_}*_n1ised;begW}
}'dklZ_ }'ql\;^;_R~r¢.©.u®o1_ YOu
`cbe _Wgh
gW}9 ~n6©
"!$#%&
'()# +*,#" - .0/21-'3%+
¢6©
©vt)Z]\bei×© R\rse1bM\;^;bM\;1ik_Wj.s®dbe6g5_ 4fWik_Wj.se i¦j k_n\bej1i¦j1^1©
768# %9':
'()# }
~W ¢ 7¯ ¢;¡6~ ; ¢ }%~n;¤6©
©am© ®\shseisei×©*ibegOsh|c\;jl@gh_WfWd;j> |»dbM1_EbvZ_Eseold6 gc°Jd;bvk_n\bej1ikjl^1¯._Es[_W_Wj]gOse_W_Wq_EgOs® _WghfW_Wj.s
\j>Ùjl_Esed;=j < gZ_Eseold6!© }>£1¯k~E£1~ ;l~ }c~n;'¢.©
£1©
©>v_Wf7_Eb)\;j>A @D©>y*_r lj*>©YÀZ
q1?be68dr6# ik%jl^D9se':o1
_a'()fW# d j6'_7be^_Wj1fW_d;°%{>\f76{ bedq>\^'\rsei¦d;jk_n\bej1i¦j1^
iseo¾gh_WfWdjl3d61_7bZ_Eseold1gW©YÀj¾pa\n6i¦3u,d;1be_EseE6.} _Ed;¿be_E ikj.sedj*},\j>¾u,_Ebhbe_Wj1fW_
6_ Oj1dngh i×}l_n1ised;begW} }
ql\;^;_Wg)¢;R ;.'.©!y,\Wbe_W*j1fWB_ #" % be k{>\. l0ZÚ#B!Ct'ghD2gh&d.fWEi¦\F seGH_WGIgW}968~n#2¤;J © 5'()#2K-'MLN#"5 O/2%+%7/P DQ#"#
¡6©
)© ©.ikghold;q9© SB
Q'(TM#-UV!$# M*
'('3XWY -#-. 2K'((# ©, ¦\be_Wjl1d;j`cbe_WghgW}1)½6°JdbM*}
~W¡6©
©y%©ndshsed*©64jlkikjl_/\¦^;d;beiseolZg,\;jlRgOsed.f7ol\;gOseikf\qlq bedr½ ikZ]\seikd;jlgW©;Y[japa\n6i¦a1\;\*}W_n1ised;bn}
}
®Z \Z: KP{ beiU [\^_
}*Q~n;K.]¤6©Ku®ôl_a)_E
,sed>j'(Y[T?jl# gOseiUse` se_a_EFH F_Ebebdik_WcAgW}># ®\;UZDBDQ{1#be9di¦1
^;'0_a'4DQAj1i¦_EbeTghi':s[# e`% be2_Egh-gW'(K© '('3af
6©apD©1!©1vbed.dZo1_n\Ù\;jlÙpD©ly*dn®_© 1sei¦;\bei¦\{lk_R°J1jlfEseikdjÙikj.se_Ebeqd¦\seikd;j\;jl\;l\;q seik'_
¤ © j1_Es[©*y/d;©*be6gW1© j668seik# j1%_:9P\ j> /Qt
1 ©9-'3© %+ }_W¢6ik^¯ '_Ej>¢.~*;6© ¡¡.d}/Z~Wql ¤;se¤ ik© jl^]gh_WfWd;j>d;bM1_7b1_Ebeik;\seik'_Wg4i¦j¾l_W_W |

1d;bh\rbM3jl_7s[®dbe6gW¯,tbe_W6ik_Ea© 2B
2
H 5'((# 2X#
>'(T?# U }~W6©u,d
©
\ )ql©!qpR_n\r\bnbe©'_Wjº\j>1© © d.d6 .©a)d;se_:d;j¦_W\bejlikj1^ÙbM\rse_:ghfMol_n lk_Wg4°?d;bagOsed.fMo>\gOsei¦f:dq1sei|

Zikn\rseikdj9©>Y[j@m©.`©.y*ikqlqlZ]\jlj*} © © d.d6 .}6\j>:pD©6!©'u,d be_EseW..};_n1ised;begW} Y

0>B
$!$# %
'((# >*,#" - ./Q1 -'3%0 };'d;¦1Z_6}rq>\^_Wg%¤;'"¢ ;.¤;¤ © dbe^'\j:¬\; °?|
~W ©a¬@©\Y7jl©.j*p4}1iU1\\;Z]j \; j.sM\\sebM_W\d g®}!\ ®j>t
Ù}*!~n©H;@D ~;©'©¬a1jl^1© *,P 5 9S
=68# %O9S# P2'\SB
2>'(T?# U © ikk_E.}
]
Z
~;~©a)m_E©v k@v_Esed;f7beo1_E}9bn~W© *,©
H 5'((
L 'DQ#" #B! Z 9'(%+ "
'()# }vf7ol\;q1se_7bÙ¤ © ¯`/d;k j1dZi¦\;seikZ_
~n¢6©
\k© ^ d;be_WiZ]seo1\;Zj*gW} }lql©.\;vî¦_E_Eg
jl_W~Wj1¤RgOse;ld.~nf7¤;¤ }©\;;j>d
olm
j © pRikd;¦1_7bege\rwsn©>64djl_E1gW}1bM\;46_7j1 _Es[@vd;d;bebe6}g/gh\;_Wj>fWd;j>seol_®_W1{1ii¦se\;ikg dj9;}*\be~ni¦;\¤'jl.fW© _

~W ©y%ik© ¦_E ZdZ]¦1\ gOse© _Ei¦j*©

_n8\68j# g %O.9>\rbe':
_4'(d(# q se}likZ]£ \;~ ki7s[¯k]~ ; ik¡;jÙ¤6se}co1~n_4;'fWd;¢6j.© sei¦j61dlgvsei¦Z_md{l{1ikjlg d;j1bed:q bed;|

fE_n1 be_©*u,_WfMolj1i¦fW\;>m_Wqd;bhspRm)v|À 6}.pR_Wq sn©'d° \rseol_WZ]\rseikfWgW}64j1i¦_Ebeghis[Dd;° d seol_Ebej

~E£1© ® \© kik°?d;© be j1iUd;\6k}!l{y,t\;jl}9~W )¤6©!© © v\;jy*d'\;j*© LN
'( 68# %9':
'()# Q ¢j>_W*©)do1jlg d;ql6ikjlg
~n¡6©)u4jl© ik'© _Ebe ghi_WsÀghÙ'_E`%gDbe_W\ghj>gW}>®\;©,se¬ikZ\qld;qbe_;_W},j*~n©;¤46j © |»¦ikj1_¦_W\bejlikj1^q1bed.fW_Wghgh_EgDikj#\rbhseikªlfWi¦\;vjl_W bM\;j1_Esh|

d;be6gW©/Y[j1© ©lu\W ¦_7bn}l_n ised;bn} LI

'D2%
'() -
M9H9#"
D2':#&
P>'(T?# U }'d|
~ ©a1mZd{_a_7¡.bhs%~}>t
ql©\;'^;\_WfWgad{1~ngW"© ; Y[jl¢f7be _n© \;%gh_nkgh_WbM6\ik_Esebn_W}gctd°>ZfWgOd;sej6_E'bM_Elbe\^Z_Ejl}fW~n_/se;o1 be© d1ô
k_n\bej1i¦j1^)bM\rse_\1\;q1sM\rseikdj9©
~n6©t© ©r
¬RP>bM\Z'(T?_Ebc# \Uj> }~t
¯ ¢©r'1"¡ \;;.j1îk6dr}c\~njl;j1¤ik¤6| ©)i¦j1fW_Wj.se_Wkki×© 4fEi¦_Ej6s,q>\rbM\;kk_W1k_n\rbejlikjl^)\;k^;d;beiseolZg
°?d;bj1_W1bM\cjl_EsÀ®d;be6gW©
Y[jp:©9©*u,d be_EseW..}!_n iksedbn} Y
+KN
V $!$# %
'()#

*,#" --K./21-'3%+ =*,#" - K. >#B!C'D20E FGHG 68# "!"P }1q>\;^;_Wg£'" ;.£'¤6}! \;j \se_Wd }
~W¤ C© @D ®t©ry9}9_n~W l¤;j9© © LNd#"be^'5\ j¬ -# \;Q1J°?Z] \;)#j12j92© '3YH
9H9-Q'(K-
"._3 -# 2P 5'()# 2 '\ -
QK.O%#"

~W C© @D5 :©;f y9©v_r`/ o11pTj9© se ol_E_Eghjli¦_EgWbM}1\4¦ikj1n\rik'se_EikdbeghjÙis \;_jl`:©ljl_E_Es sÀ® d©beD 1 be_Wikgh_ ik^ j`cgO\shbebMikg\rse4_W^Y ik7_W}9gW~W©YÀ¤j:6m© ©'`c°J_Eik°?_Ebn} ©.6f7o be_Ese_Ebn}

©/1d^_E¦Z]\j9}/\j>Áy/©v.se_W_WkgW}%_n1isedbegW} 68#2J 5'()#2K-% K`*Y)9Q 5'(K }tZgOse_EbMl\Z}

~W¤; © %¦gh_E ik_Ebn©9`cbed.fW_W_n ikjl^gd°!seol_Y[j.se_Ebejl\seikdjl\;! d;j1°J_7be_WjlfW_R dj1jl_WfEseikd;jlikghZ ikj]`_Ebh|

¢ C© @Dq©6_Ey9fEse_nik '_l}1j94}.)jlik© '_7bedghghiksÀ_7]bn}ld; ° ©1!1« ©.bepRikfM_Eo9jl}*'~n_E6bnQ©}p:;© ~W ©!_W4j> f7_Esebedgh{d_Ej*b}.~nm
;©¤¤6© © dr®\bM!} © 1{l{l\bM*}'\;jl
h
g
y%©!p:©*'\f7'_EÝ© \;jl beishse_Wj¾1ikîsRbe_WfEd^j1isei¦d;j¾iseo¾\Ù{l\;fM q bedql\;^'\rseikdj3j1_Es[d;be©Y[j

pD©!!©lu,d;1be_Esegh. .}>_W1ised;bn} Y
0K
$!$# %
'((# *,#" --K.A/Q1 -'3%+ ?#
¢.~C© @D}©' y*\;_rj lj*\r}.se1_Wd1© }©' ®pRt
_Wj1}*'~n_E;bn} \;© jl d;!be© ^'t
\©'j ¬d;k\;U\6 ©9°JZ]4\;q1j*seik© Z]\; {1bM\ikjl\Z]\;^_;©Y[j@pD©.©'u,d;1be_Esegh..}

_W1ised;bn}
YK>B
2 "!$# %
'()# &*B#" --K./Q1 -'3%+ \# }'ql\;^;_Wg¡;;R¤ ; '¡.}
¢;¢6©C@D~W©6;y9 _n© lj9}6YM©.¬\;j.se_Ebn}.\;j>Ù© t
© 6dk¦\ ©%6_WfWd;j>d;bM _Eb®q bedq_Ebhseik_Wg®d°,_7bhbed;bgh bh°×\;fE_WgW©cY[j

YK >
Q "!$# %
'()# *,#" --K.&/21-'3%+ # } 1\j \rse_Wd1}1 ®t}>~n; ~;©

¢ C© @D©1dy9be^'_r\ j1¬j9}1\;`1S©°?Z]@D\;©lj1 j9ikZ]© \bM!}l\j>)©1`_n\bekZ: shse_Ebn©%t1sedZ]\rseikfRk_n\bej1i¦j1^:bM\se_4Z]\½ ikZi¦W\|

seikd;jå{.Ádj |Àkikjl__WgOseikZ]\seikdjúd°Rseol_ol_Wghghi¦\;j < gÙ_Ei¦^;_Wj6'_WfEsedbegW©zY[j ik¦_EgW} \jlghd;j9}v\;jl

dn®\;j9}9_n iksedbegW}
N>B
$!$# %
'((# N*B#" -K.I/21-'3%+ # },1\j
¢r£1© \r© se _Wd1}¦k ®_Ebnt
©ã}*~ntÚ;gh fn© \;k_n d;befW^d\;j jOl¬^\;\ se_°JZ]^;\bMjl\;j91©ik_Wj.sÙ\;k^;d;beiseolZ°Jdb]°×\;gOsÙgh1q_Ebe6i¦gh_W k_n\bej1ikjl^1©

P>'(T?# U } ¯ ¡;¢"¡ ;6¡;; }c~n;6©
"!
¢;¡6© © k¦_7bn© 1q_Ebe6i¦gh_WÁk_n\rbejlikjl^ºdjÁ¦\be^;_be_n ljll\;j.s
shbM\;ikjlikj1^¾gh_EsegW© 2'3 P
'()#P

}>£ ~7¯k~n¡"; ¢;¡6}c~W6©
"!
¢ © ©#S © P
\d.d6#B!6\;jlSB
)=©/Q11 ©r-'3pa%0\rbe '_Wj9 ©;>\gOsk_n\rbejlikjlîkj
j1_Es[d;be6g,d° ¦d.fW\;k |Ýse1jl_naq1bed.fE_Wghghikjl^
1jlisegW© },~;¯ ¢;¤ ~ ; ¢;£1}%~W¤6©
¢;6©a
© 1bM\sM\6S©B
_:? 68#%O
9S9
J':
5'()a#f ©`%olpTseo1_WghikgW}l)jlik'_EbeghisÀd°%u,d;6'd1}*~n¢6©
¢¤ ©a
© bM\sM\6}c¬@© |Àm© #l« kk_Ebn}/t
© !ik_Wo1_}%\j>#©ct)Z]\rbei×©t41\;q sei¦_dj1|»kikjl_]k_n\bej1ikjlîkj
fMo>\jl^;i¦j1^_Wj66ibedjlZ_Ej6segW©úY[j ikfMo>\;_Ea )© dW_Ebn} ikf7ol\;_WRYM©vd;bM1\;j9}®\;jlúu®old;Z]\;g

`_7seghf7o1_}_n ised;begW} }%'d;¦1Z_ }

ql\;^;_
¡;6©u®o1_ YOuz `%
be_Egh gW}, ~nK; '.©
"!$# %
'()# *B#" -K.I/21-'3%+
¢ ©t© D©4q1q_Wjlo1_WikZÔ\;jlúm
© © fMo>\°?_Ebn© . K':
/Q . P
*,#" - . ©`%be_Ej6seikfW_ \kÝ}
%jl^;k_E®d.d6 ki¿!gW},~W'¡.©

; © ©l)©>)bhbn© 1P
%+) 5
P0 .H# K'D%+ !$# 7/2':#" DS
-'() +
2K. ©/`/o1pTseol_WghikgW})be_W^d;j
bM\;1l\se_aY[j1gOseise1se_}!~n;'¡.©
6~© © )©D)bhbn© m_WZdr6i¦j1^¼jld;i¦gh_ ikj d;j1|»kikjl_ gh_n\befMolghikjl^ç\1\;q sei¦_ {l\sefMo ghikW_EgW©éY[j
ikfMo>\_Wv )© d;W_Ebn} ikf7ol\;_W/Y7©*dbMl\j9}9\;jl3u®old;Z]\;ga`_7seghf7o1_}*_n1ised;begW}
P &
}.'d;¦1Z_ }q>\^_¢;¢6©6u®o1_ YOu `%be_EghgW}l~n;'.©
¢6© © 1©y%
©>)"bh!$bn# ©* m%_W
^'()1# ¦+\be*iknB\#"se ikd; j-Kikj.0se/2ol1_-gh'3_Wk%+_WfE seikdjÙd;°*bM\ i¦\;!{>\ghi¦gv°Jlj1fEseikdj]fW_Wj.se_EbegW©

}! 7¯ R; '¢;6}c~n;'¡6©
; ©68©#t%O©>9`_W':\
be'()kZ:# shse_E bn©v>\;gOs_E½1\;f7s)ZDlseikqlkikfn\seikd;j{.Ùseo1_aol_Wghghi¦\j9© >
?68# %9':
'()# }
6¯k~W£.$ ;>~ }c~W£1©
£1© © ©,`cbe_WghgW})©`©,¦\;jlj1_Ebh.}!©9t
©,u,_W1'dkgh..}9\;j> ©,u4© /_Eshse_Ebekikjl^ © O% ) -

©# ®\Z:{ beiU ^_]4j1ik'_Ebeghis[`%be_WghgW}
®W\ 5Z: 9{ :beiU ^_ } %6jl ^=¦\D2j>A*
}*~n'>;¤#B!¤6© /P 5)2'( ? *B#-.
%0%+K.

¡6©apD©61\;\!}._n1isedbn© Z KP,[\
2K.&
Q'(T?# -U0_aEFHFb cA# UBDQ#9I
''D2T
©Áu®o1_)_Esedj#YÀjlgOseise1se_6_Ebeik_WgW}v ®\;ZD{1bei¦1^;_)jlik'_Ebeghis[3`cbe_WghgW}v ®\;Z@|
{':#bei¦1^ _;Q}9 '(~W'(S'3¤6a© f

©apD©91\\;¾\j>¾!©*t©* d;¦¦\6© c½1\;fEsaghd;k1seikdjº°Jd;bd;j1|»kikjl_:k_n\rbejlikjlîkj¾ZDlseikU\W._7bajl_W bM\;
j1_Es[d;be6gW© }!£1¯ £'$ ;.£;£'6}v~W¡6©
6© ©9 d;Zqdk*?ikjlDgh1 .-.)} -
DP©*WY\"be);T \;i×}9[\\;j>'('3 © ©9 _W1jl^1©D4j |»¦ikj1_:k_n\bej1ikjl^d° i¦fMoldsedZik_WgW¯9\;|
^;d;beiseolZg4\;jlk_n\rbejlikjl^ÙfW be'_WgW©)Y[jº;| ©*4o*}* )©!¬R®d;j9}!\j>º!©! old1}!_W1ised;begW}

}6ql\;^;_Wg)~W'"¡ ;l~n; ©l ikjl^\;qdbe_¯ dbe¦

6fWik'(_WT?j.se# iª>Uf}! ~n=;D2'Y¡.© /2':
'(K-'() -
2L DQ
2( 5,*Y :9Q 5'(K
;¤ ©am© !©> shsedj9©®t41\;q1seikj1^@{li¦\;g{.^bM\ i¦_Ej6s41_EghfW_Wj.sn¯>tjikjlfEbe_EZ_Wj.sM\;,_Ebeghikdjd° _WsM\|
{l\bh|À1_EksM\6©YÀj ikk¦i¦\Z6®\bhsed sn}n_n iksedbn} *,#" --K. #a!?'D2E 'D77
'()#
68# $!"-
}lql\;^_Eg
~n6~ ;l~r }91\jd;gh_}! ®t}>;l¾~W¢6© Y[uz`%be_WghgW©
; ©`#A©EY\j'(1 ? _E 5b)
Z]P \2^;'3sn5© K .ikjlikZ ikge\seikdjZ_Eseo1d61g°Jdb,shbM\;ikj1i¦j1^°J_W_n6|Ý°Jd;bh®\bMajl_7s[®dbe6gW©

}! ~ 7¯k~ ;>~~;}~n;;£ ©
£ ©
©'(vT?\;# q1jlUik © =D27
'(-C#B!/2':
'( '((
2[V-
QK. =D2# 1 ©6q1beikjl^;_Eb v_Ebe¦\^1}.)_E^ @vd;be}
~W¡6©
"
£ ~©
© \qljlik© /Q':
'(K-'() -
J[\
2. =D2# 1 ik¦_7.}l)_E @dbe!}!~W¤6©
£'¢6©t© \ik{_W×} u4© \;jl\;n\W®\ } © ikj.sedj*}.¬@©1 o1i¦;\;j1d1}6\j>¬@©61© y9\;j1^1©c`%old;jl_WZ_be_WfEd^;|

j1isei¦d;j]lghikjlâseikZ_E|À1_W¦\W@j1_W1bM\jl_EsÀ®dbe gW© 2B

2
H 5'()#27#XY -# -'() 5 /9Q- D
}tRl `%|À6¯ '¢R¤ ;6;6}c~n¤; ©

£ ©
P© /2 i¦. _E^_E
beikjl*,fM#" }1t
--© K¬a. dZd61\ }1\;jlu4© _Wgh_WgW©/6sed.fMo>\gOseikfa j>\ZikfWg®d;°¦_W\bejlikj1^:iseo
Zd;Z_Wj.selZ ikjjl_E1bM\;*jl_7s[®dbe6gW© }>¢6¯ £;£.¢$¡ ;.£;£''.}%~n£1©
£;£1© © © @®\jl^\j>©ctZ]\bei×©u®ol_5_ 4#SfE i¦P_Ejl
fE\#B!Y\;*?j>Dº1 se-ol) 5_:Obe d;{llgOsej1_Wghg
d;°j>\rse1bM\^;bM\;1ik_Wj.s
_WghfW_Wj.sk_n\rbejlikjl^Dbelk_©%Y[j ikf7ol\;_W*Y7©1dbMl\j9} i¦fMo>\_W91©l¬a_W\bejlgW}l\;jl \bM\@t©1 d;¦¦\6}
_W1ised;begW}
P K
2 $!$# %
'()# *,#" - .&/21 '3%0 }1dklZ_a~n6© u®ol_ YOu
`cbe_WghgW}9~n;¤ ©

Lecun 98b PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Lecun 98b PDF

Uploaded by

Copyright:

Available Formats



IU$ 6CE!=U*ÏÁÓ ÌWÒ!=?!$ -® KÙC7$;Î!CE$;K7$l57$ Gú=Uçî=?Ï (!CE$1-Ì0 ÓÎ!(5E$;K ÖÝ(!*Ìr57=?0  

L<M7N ¹PO>¹  bM\;1ik_Wj.sh|»{>\;gh_W k_n\bej1i¦j1^@Z]\;fMolikj1_ ©

Ó 01C7$G$5E =UUI nA

P9$ Ì6(9KM$R06Ö,57Ò*$GW= V$CE$l5Î,0 =?l5EKKE6ÓÎ!I?$;GcXA A) ÌWÒ06Ö,57Ò!$ KM$G!65E@K7$r5EK®Ñ40 (*I?G6IJK70DCE$;K7(!IU5

 0 Öv5EÒ*.5a$ræ! Ó Î*IU$1-*6*Gº57Ò*$357Ò!$Ñ4$=?Ï Òl5WKa6CE$D(!ÎG!657$;G C

!A ?l5E0>ÌWÒ9 KM57=JÌDI?$; C7*=U!ÏÌ ¾P,$(*K7$;G¾ÖÝ0 CR5ECE1ÌWÍ>=U!ÏÌWÒ* !Ï $ KA

!0 57Ò!$;CÒ!$;(!C7=JKM57=JÌaÖÝ0 C e(*GÏ1=U*ÏÙÒ!0.ÑìÓÙ(9ÌWÒ!$Ñx=?ÖÝ01C7Ó.5E=U015ECE =U!=?!Ï]$æ!6ÓÎ!I?$

Ì6åÎ!CE0G(*Ìr$IJ6CEÏ $ $CECE0 CWK

Ò*6*G%-15EÒ!=JK5E$;ÌWÒ!!=JÜl(!$@Ì6ºP9$:Î*6C757=JÌr(*I? C7I?ÐP,$*$râ9Ì=? I*ÖÝ01C)P,0>01KM57=?!Ï]5EÒ!$DÎ,$C7ÖÝ0 CEÓ6*Ì$

&)0 >< $;C7Ï1$*Ì$)=JK(*K7(* IUI?Ð]Ö»1Ke5E$C=UÖ57Ò!$

ÌWÒ*6!Ï1$ºG=?C7$ Ìn5E=U01z=¦5Ì z0 !I?ÐúG0 K70ÁP>Ðúë=?Ï ë; Ï Ï1=U!Ï#ÑaÒ*=?ÌWÒz=JK=U!$ÕÌr=?$l5  *Gú57Ò>(*K

I?'Ð1$C - OA/ÞRÒ!=JKÎ!CE0 P!I?$Ó÷Ì6úP,$ G!G!C7$ K7K7$;G P>Ð Ìr0>01CEG=?*657=?!ÏÒ!0.ÑÚ5EÒ!$=U*Î!(5EK6CE$

IU$ 6CE!=U*ÏP9$ Ì6(9KM$D=¦54Ò!$I?Î*K5E0ÙP* I? *Ìr$a01(55EÒ!$

570357Ò!$=?!Î!(5]*0>G!$;K:IU$ 6CE%AcÞRÒ!$<.6I?(!$06Ö5EÒ!$Ìr0.<.6CE=J6*Ì$K7Ò!0 (!IJG P9$Ó.5WÌWÒ!$;G Ña=¦5EÒ

6IJKM0@Î!CE0G(*Ìr$G!$Ï $;!$CW Ì=U$ KÑaÒ!=?ÌWÒÓ'ÐÙK7I?0.ÑçI?$;6CE!=?!Ï*A1&)01*K7=?G$;C57Ò*$Ì K7$aÑaÒ!$;C7$R0 *$

6I?0 !Ï@5EÒ!$;K7$DG=?CE$;Ìn5E=U01*:K ÀKM$;$Dî=?Ï (!CE$ E rA1Q#0.<>=?!ÏÙ IU01!Ï@57Ò!$ KM$DIU=?!$ KÒ*1K6P9KM01IU(5E$I?Ð*0

L<M7N ¹*¹ y9ikjl_W\be _Wq_Wjl1_Wj.sikjlq11segW©

L<M7N ¹!¹ u*bM\;jlgO°?d;beZ]\rsei¦d;jd;°%ikj1ql1segW©

L<M7N ¹,¹ \4d;sbe_WfEd ZZ_Wjl1_n!¯ seo1_agOsM\;jll\bMkd;^ ikgOseikfD°J1jlfEseikd;j9} x~ ~ 7© {

ÞRÒ!$Ke5W6C757=?!Ïº<.6I?(!$ KD0 Ö5EÒ!$Ñ4$=?Ï Òl5WK:Ì;6 Ò*'< $ ¾K7=UÏ1!=Uâ9Ì 15@4$ V$;Ìr50 Á5EÒ!$ 57CW6=?!=?!Ï

57Ò!$@0 (!57Î!(5a0 Ö%57Ò!$:â*CWKM54Ò!=JG!G$;¾IJ'Ð $;C)Ñ4$ e(*Ke5a!$;$;G570 (*KM$:5EÒ!$6P,0.< $

1A)5EÒ!$@57CW6=?!=?!ÏKM$5aÒ* KRP,$$;3*0 CEÓ IU=?ë$ Gc-!69G

   &"034 @ %12')3C"3C4 ')2%(

Ì6 =?*ÌrCE$;1KM$RKMÎ,$$ GÙÑaÒ*$57Ò!$Ì01KM5K7(!C7Ö» Ì$)=JK®Ò!=?Ï Ò!I?Ð]!01*KMÎ*Ò!$CE=?Ì;6I>P,$;Ì (*K7$4=U5G!6ÓÎ*K

ÑaÒ!$CE $  :G$;!065E$;KR5EÒ!$ F:!01C7ÓA!Ø

Ìr0 ÓP!=?*.5E=U0130 ÖÏ CW G=?$l5

η < ηopt η = ηopt

ÖÝ01C®:Ül(* G!CE657=JÌÌr0lKe56CE$40.<' I>=U KMÒ* Î9$a1KK7Ò!0.Ña]=?îv=?Ï (*C7$ (>A.ÞRÒ!$R$=?Ï $;>< $;Ìr5701CEK/06Ö

ldb@seol_ y  Á\;k^ dbeiseolZ}cseol__Wik^ _Wj6'_EfEsed;beg]\j>#_Wik^ _Wj6;\;kl_Egd;° Z_n\;gh be_Ùseo1_

&   & ,7. 7 E F ,7.  + +

QÁ6Í>=?!ÏããÌWÒ*6!Ï1$Á06Ö Ìr0>0 CWG=?*.5E$;K5E0   F ,7. ¾KM=?ÓÎ!IU=Uâ*$ K5EÒ!$å P90.<1$

&   & 7 E + # & 

K7Ì;6IJ6CRIU$ 6CE!=?!ÏCW.5E$:ÖÝ0 C6I?I%Ñ4$=?Ï Òl5EK)5EÒ!$Ñ4$ÓÙ(*KM5aC7$ Ü1(*=UCE$

+  ,/.ÁK705EÒ*.5:=¦5:=?K:G$;K7=?CE P!IU$]570Ò*'<1$Ù KDKMÓ IUI6Á$;=UÏ1$><.6I?(!$ÙK7Î!C7$  G#1K

Ø0.Ñ4$< $;C;-cK7=U9Ìr$Ñ4$Ò*'< $CE065E657$ G 5E0#P9$º IU=?Ï *$;GåÑa=¦5EÒú57Ò!$¾Ìr0>0 CWG=?*.5E$6æ$;K;-

06Ö57Ò*$)Ìr0.<. C7=J6*Ì$Ó.57CE=Uæ@ C7$ A * 6*G A  &*Aräå$57CW6=?ÙK7=?!Ï I?$IJ'Ð $C/IU=?!$; C/!$5eÑ)01C7Í

L<M7N ¹*¹ 6ikZqlk_Rkikjl_n\rb4j1_Es[d;be©

Weight space Weight space

Log MSE (dB) Log MSE (dB)

 _Wik^ o.sÚshbM\ O_WfEsedbh \;jlé_Ebhbed;b  _Wik^ o.s3shbM\ O_Wf7sed;beik_WgÁ\;jlx_Ebhbed;beg

 *C.0".0 &%(' A%(  :' î=UÏ1(!C7$ K7Ò!0.ÑK)57Ò*$]6CWÌWÒ!=¦5E$;Ìr57(!CE$:ÖÝ0 C< $;C7ÐK7=?Ó Î*IU$Ó(!I¦L

Ìr0 ><1$CEÏ $9Ìr$ÙÑa=?I?IP9$<1$CEÐÁKMI?0.ÑAcÞRÒ!$KM01IU(5E=U01 =JK:570#K7=UÓÎ!I?ÐÁÎ!CE$Î*C70Ìr$ K7KD5EÒ!$=U!Î*(5EK

 A%  <3 8 .04<&'-"0

Þ/0Ï $5@  (**G$CWKM5E69G=U*Ï¾0 Ö57Ò*$

IU0Ì IUI?Ð AlÞRÒ!$aÖÝ01IUI?0.Ña=U*Ï@5eÑ)0Ù Î!Î!CE011ÌWÒ!$;KÌ;6P9$:KMÒ*0.Ña5E0ÙP,$$;Ül(!=?<.6I?$lD5 C » (*K7$a57Ò*$

57Ò!$;C7$=JK!0Ï (96CW6l57$;$ 0 Ö4Ì0 >< $;C7Ï1$*Ì$ AáOÖ)5EÒ!$ºØ

Newton Algorithm here ...... ....is like Gradient Descent

L<M7N ¹PO *¹   _Esef7od;°seo1_4olise_Wj1ikjl^@q bed q_Ebhseik_Wgd;°seo1_a4_Esed;j\¦^;d;beiseolZ©

Î!C7$;<>=U01(*K=U57$;CE657=?0 *K;- =¦5R(*K7$;K4]I?=U*$:K7$; CEÌWÒ%-69GÓ01KM54=?ÓÎ901CM5W6l57I?Ð -S#" =U54Ñ40 CEÍK

L M/N ¹PO *¹   _Esef7oÙd;°fWd j Ol^ \se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j \¢px_7bhbed;bgh1bh°J\;fW_ ©

L M/N ¹PO !¹   _Esef7oÙd;°fWd j Ol^ \se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j \¢px_7bhbed;bgh1bh°J\;fW_ ©

ÞRÒ!$ D(* K7=¦L $;ÑR5701 À24î8 ?")Ó$r57Ò*0>G % 4=U57$CW.5E=U<1$I?ÐÌr01Ó Î*(57$ Ka63$;KM57=?Ó657$@06Ö57Ò*$

ÑaÒ!$CE$KM01Ó $ P!P!CE$<>=?657=?0 *K4Ò*'<1$@P9$;$(*K7$;GºÖÝ0 CR57Ò*$@ÖÝ0 I?IU0.Ña=?!Ï  @< $ Ìn5E0 CWK

  &  /%. ; F    . F %

!$r5eÑ40 CEÍK]Ña=U57Òç*0 LOC7$ G(!*G*6l5]57CW6=?!=?!Ï K7$r5WKA®Na$ Ìr$l5EIUÐ¼K70 Ó$º<.6CE=J6l5EKÙ$ræ=?KM5 57Ò*65

6=?Ó 570CE$;G(9Ìr$Ke5E0 CW6Ï1$DCE$;Ül(!=?C7$;Ó$l5EGK »K7$$$1A Ï9A  UrA

8@6(*KEKeL $;ÑR5701ú *G¼"%$;< $;lP,$CEÏ#QÁ6CWÜl(*6CWG>5Ù IUÏ10 CE=¦5EÒ!Ó % @(*K7$5EÒ!$ºKEÜ1(96CE$ 11Ìr0 P*=

ä $)Ña=UI?I1*0.ÑúG!=?KEÌr(*KEK/K7$<1$CW6I.5E$;ÌWÒ!*=?Ül(!$ Kv =UÓ$;G65Ì0 ÓÎ!(5E=U!Ï

Ï CW G=?$l5)P>ÐÓ(!I¦5E=UÎ*IU$:ÖÝ0 CEÑR6CWG6*GºP* ÌWÍ>ÑR6CWGÎ!CE0 Î* Ï1.5E=U01Ke5E$Î*K;A E  DG!G @570 57Ò*$

ä $RÌ ]GC701Î57Ò*$)K7$;Ìr01*G@5E$CEÓ =? A)Ü98A #" E /6*G@5EÒ!$CE$;K7(!IU57=?!Ï

241ÌWÍ>Î!C701Î*6Ïl.5E=U01]Î!CE0>Ì$;G(*C7$ K®ÖÝ0 CÌ0 ÓÎ!(5E=U*Ï57Ò!$DG=? Ï 01*6I!Ø

y 1/2 ||ω−x ||2

IU$6CE!=UÏÁÓ ÌWÒ!=?!$ -® KÙC7$;Î!CE$;K7$l57$Gú=Uçî=?Ï (!CE$1-Ì0 ÓÎ!(5E$;KÖÝ(!Ìr57=?0

L<M7N ¹PO>¹ bM\;1ik_Wj.sh|»{>\;gh_Wk_n\bej1i¦j1^@Z]\;fMolikj1_©

Ó01C7$G$5E =UUI nA

P9$Ì6(9KM$R06Ö,57Ò$GW= V$CE$l5Î,0 =?l5EKKE6ÓÎ!I?$;GcXA A) ÌWÒ06Ö,57Ò!$KM$G!65E@K7$r5EK®Ñ40 (I?G6IJK70DCE$;K7(!IU5

0 Öv5EÒ.5a$ræ! ÓÎIU$1-6Gº57Ò*$357Ò!$Ñ4$=?Ï Òl5WKa6CE$D(!ÎG!657$;G C

!A ?l5E0>ÌWÒ9 KM57=JÌDI?$; C7=U!ÏÌ ¾P,$(K7$;G¾ÖÝ0 CR5ECE1ÌWÍ>=U!ÏÌWÒ* !Ï $KA

!0 57Ò!$;CÒ!$;(!C7=JKM57=JÌaÖÝ0 C e(GÏ1=UÏÙÒ!0.ÑìÓÙ(9ÌWÒ!$Ñx=?ÖÝ01C7Ó.5E=U015ECE =U!=?!Ï]$æ!6ÓÎ!I?$

Ì6åÎ!CE0G(*Ìr$IJ6CEÏ $$CECE0 CWK

Ò6G%-15EÒ!=JK5E$;ÌWÒ!!=JÜl(!$@Ì6ºP9$:Î6C757=JÌr(I? C7I?ÐP,$$râ9Ì=? IÖÝ01C)P,0>01KM57=?!Ï]5EÒ!$DÎ,$C7ÖÝ0 CEÓ6*Ì$

&)0 >< $;C7Ï1$Ì$)=JK(K7(* IUI?Ð]Ö»1Ke5E$C=UÖ57Ò!$

ÌWÒ6!Ï1$ºG=?C7$Ìn5E=U01z=¦5Ì z0 !I?ÐúG0 K70ÁP>Ðúë=?Ï ë; Ï Ï1=U!Ï#ÑaÒ=?ÌWÒz=JK=U!$ÕÌr=?$l5 Gú57Ò>(K

I?'Ð1$C - OA/ÞRÒ!=JKÎ!CE0 P!I?$Ó÷Ì6úP,$ G!G!C7$K7K7$;G P>Ð Ìr0>01CEG=?657=?!ÏÒ!0.ÑÚ5EÒ!$=UÎ!(5EK6CE$

IU$6CE!=UÏP9$Ì6(9KM$D=¦54Ò!$I?ÎK5E0ÙP I? Ìr$a01(55EÒ!$

570357Ò!$=?!Î!(5]0>G!$;K:IU$6CE%AcÞRÒ!$<.6I?(!$06Ö5EÒ!$Ìr0.<.6CE=J6Ì$K7Ò!0 (!IJG P9$Ó.5WÌWÒ!$;G Ña=¦5EÒ

6IJKM0@Î!CE0G(Ìr$G!$Ï $;!$CW Ì=U$KÑaÒ!=?ÌWÒÓ'ÐÙK7I?0.ÑçI?$;6CE!=?!ÏA1&)01K7=?G$;C57Ò$Ì K7$aÑaÒ!$;C7$R0 *$

6I?0 !Ï@5EÒ!$;K7$DG=?CE$;Ìn5E=U01:K ÀKM$;$Dî=?Ï (!CE$ E rA1Q#0.<>=?!ÏÙ IU01!Ï@57Ò!$KM$DIU=?!$KÒ1K6P9KM01IU(5E$I?Ð*0

L<M7N ¹*¹ y9ikjl_W\be _Wq_Wjl1_Wj.sikjlq11segW©

L<M7N ¹!¹ u*bM\;jlgO°?d;beZ]\rsei¦d;jd;°%ikj1ql1segW©

L<M7N ¹,¹ \4d;sbe_WfEdZZ_Wjl1_n!¯ seo1_agOsM\;jll\bMkd;^ikgOseikfD°J1jlfEseikd;j9} x~ ~ 7© {

ÞRÒ!$Ke5W6C757=?!Ïº<.6I?(!$KD0 Ö5EÒ!$Ñ4$=?Ï Òl5WK:Ì;6 Ò*'< $¾K7=UÏ1!=Uâ9Ì 15@4$ V$;Ìr50 Á5EÒ!$57CW6=?!=?!Ï

57Ò!$@0 (!57Î!(5a0 Ö%57Ò!$:âCWKM54Ò!=JG!G$;¾IJ'Ð $;C)Ñ4$ e(Ke5a!$;$;G570(*KM$:5EÒ!$6P,0.< $

1A)5EÒ!$@57CW6=?!=?!ÏKM$5aÒ KRP,$$;30 CEÓ IU=?ë$Gc-!69G

&"034 @ %12')3C"3C4 ')2%(

Ì6=?ÌrCE$;1KM$RKMÎ,$$GÙÑaÒ$57Ò!$Ì01KM5K7(!C7Ö» Ì$)=JK®Ò!=?Ï Ò!I?Ð]!01KMÎÒ!$CE=?Ì;6I>P,$;Ì (K7$4=U5G!6ÓÎK

ÑaÒ!$CE$ :G$;!065E$;KR5EÒ!$ F:!01C7ÓA!Ø

Ìr0 ÓP!=?*.5E=U0130 ÖÏ CW G=?$l5

ÖÝ01C®:Ül( G!CE657=JÌÌr0lKe56CE$40.<' I>=UKMÒ Î9$a1KK7Ò!0.Ña]=?îv=?Ï (*C7$ (>A.ÞRÒ!$R$=?Ï $;>< $;Ìr5701CEK/06Ö

ldb@seol_y Á\;k^dbeiseolZ}cseol__Wik^_Wj6'_EfEsed;beg]\j>#_Wik^_Wj6;\;kl_Egd;° Z_n\;gh be_Ùseo1_

& & ,7. 7 E F ,7. + +

QÁ6Í>=?!ÏããÌWÒ6!Ï1$Á06ÖÌr0>0 CWG=?.5E$;K5E0 F ,7. ¾KM=?ÓÎ!IU=Uâ*$K5EÒ!$å P90.<1$

& & 7 E + # &

K7Ì;6IJ6CRIU$6CE!=?!ÏCW.5E$:ÖÝ0 C6I?I%Ñ4$=?Ï Òl5EK)5EÒ!$Ñ4$ÓÙ(KM5aC7$Ü1(=UCE$

+ ,/.ÁK705EÒ.5:=¦5:=?K:G$;K7=?CE P!IU$]570Ò'<1$Ù KDKMÓ IUI6Á$;=UÏ1$><.6I?(!$ÙK7Î!C7$ G#1K

Ø0.Ñ4$< $;C;-cK7=U9Ìr$Ñ4$Ò'< $CE065E657$G 5E0#P9$º IU=?Ï $;GåÑa=¦5EÒú57Ò!$¾Ìr0>0 CWG=?*.5E$6æ$;K;-

06Ö57Ò$)Ìr0.<. C7=J6Ì$Ó.57CE=Uæ@ C7$ A * 6G A &Aräå$57CW6=?ÙK7=?!Ï I?$IJ'Ð $C/IU=?!$; C/!$5eÑ)01C7Í

L<M7N ¹*¹ 6ikZqlk_Rkikjl_n\rb4j1_Es[d;be©

_Wik^o.sÚshbM\ O_WfEsedbh \;jlé_Ebhbed;b _Wik^o.s3shbM\ O_Wf7sed;beik_WgÁ\;jlx_Ebhbed;beg

C.0".0 &%(' A%( :' î=UÏ1(!C7$ K7Ò!0.ÑK)57Ò$]6CWÌWÒ!=¦5E$;Ìr57(!CE$:ÖÝ0 C< $;C7ÐK7=?ÓÎ*IU$Ó(!I¦L

Ìr0 ><1$CEÏ $9Ìr$ÙÑa=?I?IP9$<1$CEÐÁKMI?0.ÑAcÞRÒ!$KM01IU(5E=U01 =JK:570#K7=UÓÎ!I?ÐÁÎ!CE$ÎC70Ìr$K7KD5EÒ!$=U!Î(5EK

A% <3 8 .04<&'-"0

Þ/0Ï $5@ (G$CWKM5E69G=UÏ¾0 Ö57Ò$

IU0Ì IUI?Ð AlÞRÒ!$aÖÝ01IUI?0.Ña=UÏ@5eÑ)0Ù Î!Î!CE011ÌWÒ!$;KÌ;6P9$:KMÒ0.Ña5E0ÙP,$$;Ül(!=?<.6I?$lD5 C » (K7$a57Ò$

57Ò!$;C7$=JK!0Ï (96CW6l57$;$0 Ö4Ì0 >< $;C7Ï1$*Ì$ AáOÖ)5EÒ!$ºØ

L<M7N ¹PO *¹ _Esef7od;°seo1_4olise_Wj1ikjl^@q bedq_Ebhseik_Wgd;°seo1_a4_Esed;j\¦^;d;beiseolZ©

Î!C7$;<>=U01(K=U57$;CE657=?0 K;- =¦5R(K7$;K4]I?=U$:K7$; CEÌWÒ%-69GÓ01KM54=?ÓÎ901CM5W6l57I?Ð -S#" =U54Ñ40 CEÍK

L M/N ¹PO *¹ _Esef7oÙd;°fWdj Ol^\se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j\¢px_7bhbed;bgh1bh°J\;fW_©

L M/N ¹PO !¹ _Esef7oÙd;°fWdj Ol^\se_^;bM\;1ik_Wj.s)1ibe_WfEseikd;jlgi¦j\¢px_7bhbed;bgh1bh°J\;fW_©

ÞRÒ!$ D( K7=¦L $;ÑR5701 À24î8 ?")Ó$r57Ò0>G % 4=U57$CW.5E=U<1$I?ÐÌr01ÓÎ(57$Ka63$;KM57=?Ó657$@06Ö57Ò$

ÑaÒ!$CE$KM01Ó$ P!P!CE$<>=?657=?0 K4Ò'<1$@P9$;$(K7$;GºÖÝ0 CR57Ò$@ÖÝ0 I?IU0.Ña=?!Ï @< $Ìn5E0 CWK

& /%. ; F . F %

!$r5eÑ40 CEÍK]Ña=U57Òç0 LOC7$G(!G6l5]57CW6=?!=?!Ï K7$r5WKA®Na$Ìr$l5EIUÐ¼K70 Ó$º<.6CE=J6l5EKÙ$ræ=?KM557Ò65

6=?Ó 570CE$;G(9Ìr$Ke5E0 CW6Ï1$DCE$;Ül(!=?C7$;Ó$l5EGK »K7$$$1A Ï9A UrA

8@6(KEKeL $;ÑR5701ú G¼"%$;< $;lP,$CEÏ#QÁ6CWÜl(6CWG>5Ù IUÏ10 CE=¦5EÒ!Ó % @(K7$5EÒ!$ºKEÜ1(96CE$ 11Ìr0 P*=

ä $)Ña=UI?I10.ÑúG!=?KEÌr(KEK/K7$<1$CW6I.5E$;ÌWÒ!*=?Ül(!$Kv =UÓ$;G65Ì0 ÓÎ!(5E=U!Ï

Ï CW G=?$l5)P>ÐÓ(!I¦5E=UÎIU$:ÖÝ0 CEÑR6CWG6GºP ÌWÍ>ÑR6CWGÎ!CE0 Î Ï1.5E=U01Ke5E$ÎK;A E DG!G @57057Ò$

ä $RÌ ]GC701Î57Ò$)K7$;Ìr01G@5E$CEÓ =? A)Ü98A #" E /6*G@5EÒ!$CE$;K7(!IU57=?!Ï

241ÌWÍ>Î!C701Î6Ïl.5E=U01]Î!CE0>Ì$;G(C7$K®ÖÝ0 CÌ0 ÓÎ!(5E=UÏ57Ò!$DG=? Ï 016I!Ø

áhÙÓ6>ÐÓ$r5EÒ!0G!Kv57Ò65®Ó Í $(9KM$406Ö!5EÒ!$aØ$K7K7=? %-;57Ò!$aØ$K7K7=J6]=JK®(K7$;G]$æ!ÌrI?(*KM=?< $;IUÐ@=?

!0 !L[ë;$CE0Ó$; ¾=?!Î!(!5EK01CR!$(!CE0 KM5E.5E$;K EXE

L<M7N ¹ O>¹ lseikU\W._7be_nD\rbef7o1ise_WfEse1be_;¯Wseol_/gh_WfWd;j>1_Ebeik;\seik'_%ikgd;°Use_WjghZ]\;kk_Ebikjkdn®_Ebc¦\W._EbegW©

ÖÝC701ÓßP!IU0.Ña=?!Ï:(!Î=UÌ K7$)57Ò!$aK7$;Ìr01*GÙG!$CE=U<..5E=U<1$$ =JKKMÓ IUI[-'=ÀA $ A.ÑaÒ!$;]5EÒ!$R0 Î5E=UÓ=?ë;.5E=U01$

ÑaÒ!$CE$ =?K3çK7Ó6I?I:Ì0 KM5E l557Ò65G!$r57$;C7Ó=?!$;Kº57Ò$å Ó01(!l5¾0 Ö]Ó$;Ó0 CEÐã5EÒ.53=?K

.sed.f7ol\;gOseikf@ i¦\;^d;j>\vy*_W'_Wj6{_Ebe^| \b .>\rbM s4\;k^dbeikseo1Z©!pa\sM\gh_Es4°?bedZõ¢ \lgO|

.sed.f7ol\;gOseikf@ i¦\;^d;j>\vy*_W'_Wj6{_Ebe^| \b .>\rbM s4\;k^dbeikseo1Z©!pa\sM\gh_Es4°?bedZõ¢ \lgO|

Zikn\rseikdj9©>Y[j@m©.`©.yikqlqlZ]\jlj} © © d.d6 .}6\j>:pD©6!©'u,d be_EseW..};_n1ised;begW} Y

~W ©y%ik© ¦_E ZdZ]¦1\ gOse© _Ei¦j*©

fE_n1 be_©*u,_WfMolj1i¦fW\;>m_Wqd;bhspRm)v|À 6}.pR_Wq sn©'d° \rseol_WZ]\rseikfWgW}64j1i¦_Ebeghis[Dd;° d seol_Ebej

d;be6gW©/Y[j1© ©lu\W ¦_7bn}l_n ised;bn} LI

©/1d^_E¦Z]\j9}/\j>Áy/©v.se_W_WkgW}%_n1isedbegW} 68#2J 5'()#2K-% K`*Y)9Q 5'(K }tZgOse_EbMl\Z}

~W¤; © %¦gh_E ik_Ebn©9`cbed.fW_W_n ikjl^gd°!seol_Y[j.se_Ebejl\seikdjl\;! d;j1°J_7be_WjlfW_R dj1jl_WfEseikd;jlikghZ ikj]`_Ebh|

y%©!p:©*'\f7'_EÝ© \;jl beishse_Wj¾1ik^isRbe_WfEd^j1isei¦d;j¾iseo¾\Ù{l\;fM q bedql\;^'\rseikdj3j1_Es[d;be©Y[j

seikd;jå{.Ádj |Àkikjl__WgOseikZ]\seikdjúd°Rseol_ol_Wghghi¦\;j < gÙ_Ei¦^;_Wj6'_WfEsedbegW©zY[j ik¦_EgW} \jlghd;j9}v\;jl

`_7seghf7o1_}_n ised;begW} }%'d;¦1Z_ }

{':#bei¦1^ _;Q}9 '(~W'(S'3¤6a© f

j1isei¦d;j]lghikjl^aseikZ_E|À1_W¦\W@j1_W1bM\jl_EsÀ®dbe gW© 2B