Professional Documents
Culture Documents
/
0 !-1 2'2')"!* !*354(6 !* 78 9 :;<)* = !*
0.4
wVmÝi\onrsfVo½lryxzknorX°\j\knrsfVtbã0 æ fDwhmuo®»\Â
ܲm'8yxzfÛVxxnj\gmáJ±\³lm"½¸½lryxkonrs°\jlkrXfhjt ¡:fDwVm"Lo 5onfhg
¹'k nrso~q 8r st\krXotVr¾JXtxzrXmut\bk ¾@¢ m*³\ 8gai\\ã s|m"£nxýz5ú 8o£ æ m¥¤£P½l¦ o~ ¹ fVt'= § rsrs½^ÂÝܲmVonm¾VrswVmut
0.35
error
m*³\VgiXmºxu{¾Vm"tl´
m"o8knmº½@°aç±oxzk<x8gi\srXt¾¢»¨+hquq*fhü o½\rXt\¾kf¢k mi\onrsfVo© {
0.3
0.2
ionfh°8°\rssrkrXmºx «o ú £ ä | £ ýn» ¨; :¬ \ã | £ æ Â hrst8ssV{ sm*k
ã » ¢ æ ½\mut\fVknmk m.iZfFxkmuorXfho½lryxkonrs°\jlkrXfhtõf8ݻپVrswVmut
0.15
k m½\Dk~Vxnm*Jk ¢Âܲmm*³li\srsqurkX.VXsf ¹ k mquhxzmf88 §
koVrXtrXt\¾m*³\8gi\sm"x"{FrXt ¹ rsq quVxnmk m<i«fhxzknm"onrsfVobonmº½ljqum"x
0 1 2 3
10 10 10 10
Number of features
Рת|â ¡`Û'êÔÑ.kÔ ÚVÖuÌ\Ñ-ÊÍÒÉ ×Lã ú æ ÿ ÑuȲÉê\Ô8É ÊÍÉÍêlÊÍÌõÑuÈDë¢Ö ¹rst\ ¾Ùmuorst\mm"÷FfVjo+Vk XrX km@ÁxnãËm"8quyfVxzfÙt½²om*rst\m"m"on÷Fojm"½ÀVXrXknkfÆV{ Vx¹ m¢k jZmJxzmºV½½²\k½\ rkZm rXwhY mfa;m fV^o½ag ´
Ñ-ë¢ÔDÓÍÓ|ÊÍÌZÉøÖu:× äDÔD%Ó \Cþ Dý\Cþ "ÿZã ú æ ÚhÈ"Ö*Ñ+Ì«ÈD[É äÔ8:× ×¢ÉøȺÈ
ë ãÒ~ê Tê\ÔDÉçÉÍêÖ*×nÖ²ÊyѼÑuÈDë¢ÖÙÒÈ8Ì\Ñ-ÉÅÔDÌÉ ¿Ñ*ȸÉê\Ô8É fVk mÆe muot\+f °Zfhj\t½^à¢xnmumV{mV ¾ÂsW{ gÝm"VontxVt½ûÞ8ùurX´
xnj\i !#" $&%(' Þ !&" $*)+',(;ã ú .æ - Ùrstl / !#" $0%1' Þ !&" $*)+'2, ;ã ú æ 3Tê\ÖuÌ
õ
Éê\Ö5Ô Ú+ÚDÊÍÉöÊÈDÌTÔDÓ ×nÖuÓXÔ8ÉËOÊ äDÖ¢Ö*×-×ÈD×4È .ÇZÈ8ÉËÊÍÌaÎ.Ï®ÊкÐ-ÑÊyÑ ãÙ+ÙÖ*×-é o~8trË{ äºV8 æ { ¹ ryq °Zfhj\t½\xk mq 8tZq*mf8ßk mgm"8t²f8
Ð~GÈ ãl2Ì ÚV-Ö Ú@;Ð × Ú rXry½ÆoVt½lfVg wD8ory8°\sm"x°Zm"rXt¾JVoofVg k mm*³li«m"q-km"½
wDVXj\mh ¬® ryx'i\ofDwVm"x à ÷hjZDknrsfVtãö æ  ¬ 8arst\¾¥m*³liZmºq-k~D´
Ð Ü Ý Þ ß ã [Æ ½©Ç æ Ð Ü Ý Þ ß Òã ± æ
ÿÈ ä krXfhtx²fVt °«f8k xnrs½\m"x ¹ rk om"xniZmºq-k¼knf | â ¡`Û¾hrXwhm"x
â
ÐGÜ8Ý\Þ ßOãÒ®± æ
"
Ú ý ã m æ ÐGÜ8Ý\Þ ßOÒã <Æ ½©Ç æ =ÐGÜ8ÝdÞ ß;ã ± ?
k mݱo~xkiVoz=ÿ kÈ fV;k m+i\ofFfVÂ
æ - ä+å î @ Ú { ¹ rsq qufVgi\sm*knmºx
êÖ*×Ö+Éê\Ö ÐuÊÎ8éâ(Ì«È8ÉøÔ8ÉËÊÈ8ÌáêadÊ ÚhÖ-Ñ Ò~ÈDÌÑ~ÉÅÔDÌZÉÑÝÈDÌÓ ×bÚhÖ ÙÖ*Ì ÚDé hfVok mâãäDå ÚJæ °Zfhj\t½^{hxnxnj\gm Vx®°«m*fhonmÝk Dk ú«dã | [ æ
ÊÍÌaÎ@È85Ì %ÔD2Ì Ú6 «ßo ú ä |Oý ¢F - \Cþ áfho8s" |O¼ sxnf¼hxnxnj\gm ¹ rXk fhjlk
sh½fh\x½lxrXknf8rsßfVt¾hVmut\^m"8°oVxnXfVrXksájlknk m ã8ko~[Dk mu- o=k þ 58tláÂonp m"s8kf n¹ rswVrsmt\æ ¾m"8tonÛofVo=â°Zãäfhåj\ÚJt½ æ
7 BD|( 859*:<;«C {"> = I v<j\mkfJxziZVq*m¢qufVtxzkno~8rstFkx"{ mfht\s
ionfDwhm muomk Dkk m@V½½lrkrXfht8®8°ZxzfhXjlkm¼ão8k ¹ m"ok 8t kmuhq³l-k8trsxzj@k8xxsXk~¼q¸DknuomºfVm"½t÷FrXxzj\tkrsVtonk mºF x k m ¹ k m"Û®mu8fhxnhf.onmum"oçkg hxàDkn¢¹xnj\m xzgjoiilm"÷Fk/rXj\ fhrst!&on"mx$&%(fhfh' t\t Þ !#s" $X]ú )^k \ xá '2,0Dk½lmuã k út ZæxnmurXko- m
omuyDkrXwhm æ muoonfho Ð Ü Ý Þ ß ã [Æ ½©Ç "ÿ È æ Ð Ü Ý Þ ß ã ± æ rsx°«fVj\tZ½lm"½
°ak m"xnm®âãzäå+î Ú.æ 8t½âãäå ÚJæ ÷hjZ8tFknrXknrsm"x" ¬® m=i\ofaf8x LÛÂãÃøkrsx mºVxnrXs whmuor±mº½ k Dkßk ryx ryxxn8knryx±Zm"½°Fi\ryq~Frst\¾
fhoh½\½lrXknrsfVtVhomuyDkrXwhmßm"onofVoOVonmb¾VrswVm"t rXt k mbj\slwVmuo~xnrXfht rsLtFoknÛ rXm"kn¾Vmo~kDk_ nmm knå_h½fça\{½l¾hrXxzonknrsmºrstfVDkq*tmJmuVo|f8k 8°k 8tmuxnÆofV¹ sjläVrsk{Txnmm'çqm"k *on fhom¼fVtFokn½lo~hxV½m"tlxzryq-rXkkrXfht|; ã æ ú æ ܲ¹ mfhq"j\8ts½
fV;k ryx®i8i«muoã c ¾¢ ïVfho½\Vt|{\8h\ä æ Â
¬ f¿ionfDwhmÛk mÁä+å î Ú °«fVj\tZ½^{ ¹ mÀx f ¹ k 8kJk m¸h½a´ ¹
½\rkrXfht8+8°ZxzfhXjlkmJm"onofVo@fVt¿VtFõiZ8onknryq*j\y8o@rXt\ijlnk |Áryx `a*b c M\ &0d ó^ef+gihVj0MON Q.k
°«fVjt½lm"½á°a a
HlGnm G/o ô G QqpM G Qsr G
¬® rsxrsgi\srXmºx=k 8k
mu³liZmºq-knmº½^{bk m'V½½lrkrXfht8omuyDkrXwhm@m"onofVo½lfam"x¢½\m"q*om"hxzm
ã» æ
÷Fj\rXknmo~8i\ry½ls ¹ rk ²Ú ÂÃøbk m¢V½½lrkrXfht8omuyDkrXwhmm"onofVo
½\m"qulxVx+âãäDå ÚJæ {^k mut m fhj\y½J8yxnf@mu³ai«m"q*kfhtJk m
gWfbã 2XP'º æ ² 2ã» æ sfV¾
º ã» æ
³ » ãä" æ sfV¾V´ösfV¾xnq"8smbfVk m®i\XfVkknf+¹ xzm"m=¹ srXtm ¹ rXk xnXfhiZm8ii\onf³a´
- ² 2ã» æ sfV ¾ nÒã õä æ s ¬ ¾ ³ »-ã¥ä æ rsg¢Dkmus¢´ähÂÞVt\fhonrst\¾ k m+xzrst\¾hXmiZfhrXtFk q*fhonom"xni«fVt½lrst\¾knf
Ú äçãËxzm"mquVilknrsfVt æ 2{ hrs¾Vj\omã° æ xnmum"g¢xknfá8sgfhxzk m*³a´
Comparison of Voting Gibbs and the Bayes optimal classifier Experiment with 10 training examples Experiment with 50 training examples
0 0
0.16 10 10
0.14
0.08
0.06 −2 −2
10 10
0.04
0.02
ãË æ ã° æ ãq æ
−3 −3
0 10 10
0 1 2 3 0 1 2 3
0 20 40 60 80 100 120 140 160 180 200 10 10 10 10 10 10 10 10
m (number of training examples) N N
.ÉG2M\/¥Q!I# $&'&(&%)G*-, 1G3476 $&# !'&0/ ?1?1T=$XÊ/ 4W>$-*<Ë#9&%!(D$>ÌF/Í$-*>+!(?4@/ GA-/*'*'?CB$ &"MO*'?KQ /1KV#Å&%S[U7MI;QR¥S[U7MÎQ
/1KLS"U7Mda I;Q=M\K/ *'D5]K5 !:RGH8?!(DõD?TD5$ &J°A &'&($-*'> 1K5?15T7!(J:HF$ &[A-35&()$-*0Q, ñ D$A-3+&()¥$"#9 &"S[U7MdaI;Q©/4W* !<A-4W>$ !($-ÏÍ;)¥$ &(/>5*
!(D/ !7#<!(D6 $ ÌF/ Í$-*7>5!(?4@/ FA-/*'*'?CB$&:,kM ñ D$@&($-*'3C!(*7&($ > &'!($:KnD$&($õ/;&($b/:)¥$ &0/ T$-*J;)¥$&@aûûûN!'&(?/*-, Q¿MO6 QX !W#"/K5K5?C!(?1/
&($-/ !(?)¥$=$ &'&( &©#9 &8S"U7M JbQF/*8/V#Å315A !(?1#FMOGK5KQVJÃR5#Å&Ë H I:ûG, ñ D$K+!'!($:K@>/;&'!©#!(D$"?1$"A-&'&($-*'> 1K+*8!(V15ÏÍ@1$"> ?1!
1W!(D$8T&0/ >DW!(D/;!FD/Ð K J H I+ , Ñ#ZH.$[?T15&($<!(D?* Ò)¥$ 2& ÍW*'4@/ *(/4W>5$*ÓVA-/*'$R!(D5$[*'> $<#®!(D$©&($-* !.#®!(D$8?1$"?*./>>+&(ÔÊ5?4@/;!($-ÏÍ
]4I,8MOA;Q8_5/ 4W$/*©!(D$">5&($-)G?35*8BT3+&($R6535!©H8?C!(3 D Ë H a û+,
hq-kXÝg¢Dk~q k m®VxnagilknfVknryqßxnXfhiZmbi\onmº½lryq-knmº½+°aÝfVj\o;k mu´ ½\r TmuomutFk <x ionmº½lrsq*knmº½'°a@k mufhonh{k m ¾VfaflZ½ i\orXfho ryx
fhonhÂ.É mui«m"DkrXt¾ k rsx ¹ rk ÝkoVrXtrXt\¾xzmuk=xnrXù"m f8§ V\{ whmuoÄrstxzm"txnrkrXwhm'knfÛk m.i\om"xnmutqum'f8+y8o¾Vmtaj\g°«muo~x¢f8
hrs¾Vj\om@ãq æ x f x t\m"Vons¼ry½lm"thkrsq"8b°Zm warXfho rXt rsq rsoonm"Xm"wVtFk m"8knj\om"x"{|8tZ½¼½lfamºx<fht\s.xzsrX¾ kns ¹ fhoxnm k 8t
k m V½½lrkrXfht8^o¹muyDkrXwhm<m"onofVoVsxnf¢½lm"q"ax®hx âãäå ¹ÚJæ Â rX ¹ m V½¼°«mumut¼knfhs½¼m*³\hq-kns ¹ ryq m"Dkj\om"x ¹ m"onmomusm*´
wDVthkºÂÃÅtáqufVtFkno~Vxzk"{aVxßk mÝtaj\g°Zm"o=fVOrsonomusmuwD8tFkbm"Dkj\om"x
Å I uÖÕ C {#× BD~ C yºCFËC G {" Z? Ø ¶ C h yºC.] 8VÎ yy Æ C h\z CaA °«m"qufVgm"xy8o¾Vmh{;k mámuoonfhojxnrXt¾Jk m t8rswVm 'i\orXfhoVil´
Æ B ZB y ionfFVq mºx k Dkf8Oo~8tZ½lfVg¶¾Vjm"xxzrst\¾@ãË\C æ F c f8kmÝVsxnf k m
xquVXmf8;k Jm |´ø8³aryx ¥m"wVmut mutásm"8ot\rst\¾ rk fht\X'äºV
<joxnm"qufVt½Æxzmukf8<m*³liZm"onrsgmutFkxxzknj½\rXmº½Ùm"8knj\omxzm"Xmºq-´
krXfht|Ä <j\o+sm"VontrXt\¾i\ofV°Xm"g ¹ Vx+®Vmºxzry8t¼Xfh¾Vryxkrsqom*´ koVrXtrXt\¾m*³\8gi\sm"x=8tZ½'ä"hV¹ ÝmºDknjonmºx<ãËVV ¹ f8 ¹ ryq Vonm
¾honmºxnxnrsfVt ãhx@½\m"xq*orX°«m"½¿rXt·pam"q*knrsfVt æ {<Vt½õk mÛ=hm"x rsoonm"Xm"wVtFk æ {ak m 8s¾VfhonrXk gôxkrXs|i«muonfVogx ¹ musöÂ
fhilknrsg¢8=q*yVxxzrX±muo ¹ rsq xzm"onwhm"x hx+fVj\o°Vxnmusrst\mat\f ¹ x hrs¾Vj\oX m ãË æ ionmºxzm"thk~xk m om"xnj\k~xfV^Vtm*³aknm"t½lm"½m*³liZm"onrX´
mu³\Vq-kX rsq G¨@fV k im ¸mºDkj\onmºx8omçomusmuwD8tFk"ÂÙܲm gm"thkrst ¹ ryq k mmuoonfhoxfVZÞ ¯ã Ú¼æ ¹ muomVxxzmºxnxnm"½^{8fVo
km"xzknmº½Þ ¹ ¯ã Ú¼æ jxnrst\¾k m ¾Vfafl½Z+ionrsfVo®8t½k m tZ8rswVm Ú ähý ý~aý"ä Vt½ rXk °«f8k i\orsfVo~xu ÃÅt²8sq"Vxnm"x"{k m
sf ¹ muoÝXrst\mºx q*fhonom"xniZfh¹ t½'kfsVon¾hmuoÝwD8sj\m"x+fV Ú Â¢Ü²mxnmum
ionrsfVoáã ¹ ryq i«fhxnrk~x+k Dkryx¼xzmº÷hjmutqumf8 rst½lm"iZm"tl´ k DkbmuwVm"t ¹ rk k m xng¢8sXm"owD8sj\m"xfV Ú {Vi«muonfVogVtq*m®ryx
½\mutFkqufVrst kfhxxzmºx æ ½lm"xq*orX°«m"½ rXtk m®i\omuwarsfVjx;xzmºq-knrsfVtO. hfVo xzknrssß÷Fj\rkm¢onmºVxnfVtV°\smVL hrst8ssVI{ hrs¾Vj\oNm ã° æ x f xk m
fhj\o mu³ai«muorsgm"tFkx"{ ¹ m+jZxzmº½¼äºVkno~8rst\rst\¾8tZ½¼äºVhVknm"xzk om"xnj\Xkx ¹ m"tk muom 8o=m <omusmuwDVthkmºDknjonmºxu <tq*m¹ 8¾F8rst|{
mu³\8gi\sm"x"{®Vt½¥omuwVm"oxnrs°\Xõm j\gi¿ØJ8oVfDwÀq VrXtõØ'fhtFknm mÝxzm"m k m ¾VfaflZ½ +i\orsfVo=m*³ rs°\rk~x®whmuo rs¾ knfhXm"oVtq*m
e=Vonsf'ã˯omum"t|{|ä"h5 æ kf½lo~ Ú q*yVxxzrX±m"ox=fho Þ ¯ã ÚJæ  k¹ fk m+i\om"xnmutZq*mÝf8rXoomusmuwD8tFk=m"Dkj\om"x"Â
ܲmXmukk mknf8k~8taj\g°«muoÝfV¹ m"8knj\om"x<wD8oVt½.sm*"k jxzk
xnrXt\¾hXm m"8knj\om<°«mÝonm"Xm"wD8tFk"ÙÂ <j\o=onmºxzjk~xbjZxzrst\¾ ø Ú ä
Vonm x f ¹ t¢rs`t hrX¾hj\onmäV ¬® m om"xnj\k~xßx f ¹ t¢8om wVm"oV¾Vm"x ìí6í ò s s©¨ î
fV[8çrXt½\mui«mut½lm"tFk<konry8yxu ¬® mxzfhXry½Xrst\mt\m"Vo k m°«f8kn´ V
0.45
0.45
0.4
0.4
0.35
error
error
0.35
0.3
0.3
0.25
0.25
0.2
ãË æ ã° æ
0.15 0.2
0 1 2 3 0 1 2 3
10 10 10 10 10 10 10 10
Number of features Number of features
vô 2M\/¥QV% !W#<$ &'&( &(*J#[S[U7MI;QR%S[U7Mè¥QR%S[U7MÎQR%S[U7MI;aQV3*'?1TN!(D$tÒÒTGK Ó~M\K/ *'D Q/ 1K ÒÒ1/?)¥$Ó~M\K/ *'D5]K5 !QX>+&(?&(*-,
õ"?TD5$ &<?15$-*8A-&'&($-*'> 1KL!(7:H.$ &")/35$-*8#+J,<MO6Q©_5/4W$=/*Ùà?T35&($[IR6535!©H8?C!(D3è7?15* !($:/Kõ #I=&($-$-)/1!©#9$-/ !(35&($ *-,