Professional Documents
Culture Documents
Tieuluan Neural Vutruc
Tieuluan Neural Vutruc
Trong :
Cc Soma l thn ca noron.
Cc dendrites l cc dy mnh, di, gn lin vi soma, chng truyn d liu (di
dng xung in th) n cho soma x l. Bn trong soma cc d liu c tng
hp li. C th xem gn ng s tng hp y nh l mt php ly tng tt c cc d
liu m nron nhn c.
Mt loi dy dn tn hiu khc cng gn vi soma l cc axon. Khc vi dendrites,
axons c kh nng pht cc xung in th, chng l cc dy dn tn hiu t nron i
cc ni khc. Ch khi no in th trong soma vt qu mt gi tr ngng no
(threshold) th axon mi pht mt xung in th, cn nu khng th n trng thi
ngh.
Axon ni vi cc dendrites ca cc nron khc thng qua nhng mi ni c bit gi
l synapse. Khi in th ca synapse tng ln do cc xung pht ra t axon th synapse
s nh ra mt s cht ho hc (neurotransmitters); cc cht ny m "ca" trn
dendrites cho cc ions truyn qua. Chnh dng ions ny lm thay i in th trn
dendrites, to ra cc xung d liu lan truyn ti cc nron khc.
C th tm tt hot ng ca mt nron nh sau: nron ly tng tt c cc in th
vo m n nhn c, v pht ra mt xung in th nu tng y ln hn mt ngng
no . Cc nron ni vi nhau cc synapses. Synapse c gi l mnh khi n cho
php truyn dn d dng tn hiu qua cc nron khc. Ngc li, mt synapse yu s
truyn dn tn hiu rt kh khn.
Cc synapses ng vai tr rt quan trng trong s hc tp. Khi chng ta hc tp th
hot ng ca cc synapses c tng cng, to nn nhiu lin kt mnh gia cc
nron.
C th ni rng ngi no hc cng gii th cng c nhiu synapses v cc synapses
y cng mnh m, hay ni cch khc, th lin kt gia cc nron cng nhiu, cng nhy
bn.
2.Mng Neural Nhn To
-Noron nhn to l mt n v tnh ton c nhiu u vo v mt u ra.
Trong f l hm Heaviside:
W=
wS ,1 wS , 2 ...wS , R
pS
a = f(Wp+b)
Hy bt u bng cch cho cc weights nhng gi tr ngu nhin, lc ny nron cha bit
g ht. By gi hy input ch A. Nron s ly tng c trng s ca cc inputs v so snh
kt qu vi 0. Nu kt qu dng th output l 1, m th output l 0. Kh nng nron on
ng l 50%, v cc weights ang c gi tr hon ton ngu nhin. Nu nron on ng
th chng ta khng cn lm g c, nhng khi nron on sai (output bng 0), th chng ta
phi tng cc weights ca cc inputs ang hot ng (cc inputs khc khng) ln,
sao cho ln ti tng c trng s s vt qu threshold v to nn output l 1.
Ngc li, khi a ch B vo v nron on sai (output bng 1), th ta phi gim cc
weights ca cc inputs ang hot ng xung, sao cho ln ti tng c trng s s
nh hn threshold v buc nron phi cho output bng 0.
Nh vy, khi dy ch B thnh cng ri th nron c qun i ch hc trc l A
khng ? Khng, v khi input l cc ch khc nhau th nhm cc ng inputs ang hot
ng cng khc nhau hoc l khng hon ton trng nhau. Nh l chng ta ch bin i
weights ca cc inputs ang hot ng thi. Chng ta ch vic lp i lp li qu trnh dy
nh trn cho ti khi nron hc thuc bi mi thi.
ABCDEFGHIJKMNOPQRSTUVWXYZ
abcdefghijklmnopqrstuvwxyz
0123456789
+-\?*^@&:<>
-Qua kim nghim, v da trn nhiu ti liu, nhn thy gi tr 150 noron u vo l kh
ph hp nhn dng vi kiu k t nh c font ch trung bnh, v ph bin.Cc k t
nh ny c chiu cao trung bnh l 70 pixel v chiu rng khong 54 pixel.
-S noron lp n : 500 noron.Vic la chn gi tr ny da trn thc nghim ca cc ti
liu chuyn v nhn dng k t quang hc.S noron ny c quyt nh t nhng kt
qu ti u v gi tr li c s trong qu trnh hun luyn.
-S noron u ra : 16 noron tng ng vi 16 bit nh phn ca m Unicode.T 16 noron
ny ta tng hp v chuyn thnh 16 bit nh phn, sau cng chuyn thnh 1 k t Unicode.
w x
ij
j 0
yi= f (
-bi)
f=
2
1
1 e t
: h s gc ca hm chuyn
t: bin net-input
bi: h s ngng hay lch
p dng i vi m hnh mng ca chng trnh :
-Cng thc cho u ra ca mt noron th i (1250) ti lp n
n
w x
ai= f (
j 1
ij
-bi)
wij
Vi
: trng s ti noron th i ca lp n kt ni vi u vo th j ca lp vo
xj
: gi tr u vo ca noron th j ti lp vo
wkj a j bk
yk= f(
j 1
wkj (
)=f [
j 1
w x
f(
j 1
ij
)]
E=
1 p
2 k 1
( ti- yi) 2
P: s phn t u ra
Nu E< v l+1<epochs th :
Thng tin sai s s c lan truyn ngc qua mng iu chnh li
trng s ti vng lp l.
-Cng thc iu chnh trng s vi lin kt gia noron th j trong lp n v
noron th i trong lp ra ti ln lp l+1: (l+1<s ln dy( epochs) )
wij
wij
(l+1) =
(l)+ .ei(l).yj.f(yi(l))
Vi : h s hc
ei(l) : gi tr sai lch ca noron th i trong lp ra , trong ln dy (lp )
th l .
1 x2
2
wij
wij
(l+1) =
(l)+ .xj.f(yi).
k 1
ki
(l 1).ek (l ). f ' ( yk (l ))
Vi :
: h s hc
xj : gi tr u ra ca noron th j trong lp vo.
yi : gi tr u ra ca noron th i trong lp n
wki(l+1) : trng s lin kt gia noron th k trong lp ra v noron th i
trong lp n trong ln lp th l+1 .
yk (l) : gi tr u ra ca noron th k trong lp ra.
Cc tham s s dng trong chng trnh
Tc hc = 150.
H s gc Sigmoid= 0.014.
Gi tr ngng hay lch : 30
S ln dy 300-600 ty phc tp ca tng loi font.
Ngng ca li = 0.0002.
-Qu trnh phn tch nh thc cht l phn tch chui vn bn nh thnh tng k t mt.
Vic phn tch ny da trn vic nhn dng cc pixel mu ca k t nh vi d liu u
vo c x l v chuyn thnh nh dng *.bmp ch c 2 pixel im en RGB(0,0,0)
v im trng RGB(255, 255, 255).
Qu trnh phn tch nh c thc hin tun t nh sau :
-Phn tch vn bn thnh tng dng vn bn .
-Phn tch tng dng vn bn thnh tng k t nh mt.
1.1.Tch dng k t
- Vic tch dng k t chnh l c s tin hnh tch tng k t mt cch d dng v
nhanh chng.
Thut ton :
-Bt u t im nh (x, y) u tin ca file nh (0,0) , gn s dng ang xt lines =0;
a.-Xc nh gii hn trn ca dng : Qut ht chiu rng ca nh, trn cng mt gi tr
y ( chy x<=chiu rng nh, gi nguyn y )
+ Nu gp mt pixel en th ghi nhn y chnh l ta gii hn trn ca
dng(top_line).Dng duyt x.
+Nu khng , tip tc duyt
+Nu khi qut ht chiu rng ca nh, vn khng tm thy gi tr im mu en th
reset li x=0, v tip tc duyt n dng tip theo (tng y=y+1)
b.-Xc nh gii hn di ca dng :
+ Bt u duyt t gii hn trn (nh ) va tm thy ca dng (0,top_line)
+ Tng t nh xc nh gii hn trn , ta duyt ht chiu rng ca nh trn cng mt
gi tr y.
+Nu duyt ht dng m khng tm thy k t pixel en no th ghi nhn y-1 l gii
hn di ca dng (bottom_line).Dng duyt.Tng s dng ln (lines++).
+Nu cha tm thy bottom_line, tip tc duyt n dng tip theo (tng y, reset x=0).
Gii hn di
Gii hn trn
1.2.Tch tng k t
Thut ton :
Xt ln lt tng dng
1.-Bt u xt t gi tr gii hn trn y ca dng (top_line) v gi tr x u tin (x=0)
2.Xc nh gii hn trn ca k t : Qut ht chiu rng ca nh, trn cng gi tr y.
+ Nu pht hin pixel en th nh du y l gi tr nh ca k t
(top_character).Dng qut.
+Nu qut ht chiu rng, m vn khng tm thy pixel en no th tng y v reset li
x, tip tc thc hin li bc 2.
3. Xc nh gii hn di ca k t :Bt u duyt t gii hn trn (nh ) va tm
thy ca k t (0,top_character)
Xc nh gii hn
Gii hn di
1.4.nh X K T nh Vo Ma Trn Gi Tr
Sau khi tch, k t nh s c nh x vo ma trn 2 chiu, c kch thc 15 x 10.
V cc k t nh d chun ha, chn lc nhng sau khi tch u c kch thc kh ln
so vi ma trn ( khong 58x 74), nn cc k t nh ny u phi qua 1 bc chuyn i t
l trc khi chuyn gi tr vo ma trn nh phn 15 x10.
yMT[ 0]=0;
yMT[5]=height /3.
xMT[10]=height x 2/3.
xMT[15]=height.
...
-Ly cc gi tr pixel trong file nh tuyn tnh ha vo trong ma trn pixel bng cch kt
hp ta chiu cao v chiu rng.
Vd:MT[i,j]=img[xMT[i],yMT[j] ]
(0,0)
0
15
(10,15)
Hnh :
10
nh x li k t.
BT U
Xy dng mng
Tnh u ra ca mng
Tnh li
Phn tch nh
c u ra mong mun
Li <Ngng
S ln
? lp =max epochs ?
Cc k t sn sng ?
KT THC
Dng u tin
nh x k t ti vector
Tnh ton u ra
Ht k t trn dng ?
K t tip theo
S
Ht Cc dng ?
Dng tip theo
S
KT THC
Ch Thch
1.Load Networks : load cc trng s c hun luyn ln phc v cho vic nhn
dng k t.
2.Save Networks : save network c hun luyn li s dng cho nhng ln c
d liu sau.
3.Load Training Set : load tp d liu mu mun hun luyn ln.Tp d liu mu ny
gm 2 file cng tn khc nh dng (*.ts) v (*.nn).
4.Close : ng chng trnh.
5.Load Image : a nh u vo vo phn tch.
Tng Kt
Sai S Trong Nhn Dng K T
Vic nhn dng k t i khi b sai hoc thiu chnh xc , l do nhiu vn lin
quan nh : s phc tp ca d liu u vo, cc gi tr chn la nh lch, li ngng,
s neuron mi lp,. cha c chn la chnh xc.
Sai s trong nhn dng k t ln hay nh l ph thuc vo nhiu yu t : chun
ca nh a vo, size font ch , phc tp ca font ch.
Vic chn m hnh mng ph hp, gi tr ngng li, lch , tc hc.. u
nh hng n tnh chnh xc trong nhn dng k t
Nhng hn ch
+ Chng trnh ch mc nhn dng ch khng du , tnh chnh xc vn cha hon ton
tuyt i.
+Vi nhng kiu ch st nhau, vic phn tch gii hn k t cha chnh xc, dn n c
k t sai.
Vd :