Chng 3

MNG THN KINH

3.1 GII THIU
B no con ngi ( H. 3.1) l h thng x l thng tin phc hp, phi tuyn
v song song c kh nng hc, ghi nh, tng qut ha v x l li. B no con
ngi gm khong 1011 t bo thn kinh lin kt vi nhau thnh mng (H.3.2a). T
bo thn kinh sinh hc c cu to nh hnh 3.2b, mi t bo thn kinh sinh hc
gm ba thnh phn chnh l thn t bo ( soma), mt h thng hnh cy cc u
dy thn kinh vo ( dendrite) v mt trc ( axon ) dn n u dy thn kinh ra,
Ti u ca cc dy thn kinh c cc khp thn kinh ( synapse ) kt ni vi cc
t bo thn kinh khc. Mi t bo thn kinh trong b no con ngi c khang 104
khp thn kinh . C hai lai khp ni: khp ni kch thch ( excitatory ) hc khp
ni c ch (inhinbitory )
Tn hiu truyn trong cc dy thn kinh vo v dy thn kinh ra ca cc t
bo thn kinh l tn hiu in pht sinh thng qua cc qu trnh phn ng v gii
phng cc cht hu c. Cc cht ny c pht ra t cc khp ni dn n cc dy
thn kinh vo s lm tng hay gim in th ca nhn t bo. Khi in th ny t
n mt ngng no , s to ra mt xung in dn n trc dy thn kinh ra.
Xung ny c truyn theo trc, ti cc nhnh r khi chm ti cc khp ni vi
cc t bo thn kinh khc s gii phng cc cht truyn in. Qu trnh lan truyn
tn hiu c tip tc nh vy cho n khi n u ra cui cng.
Mng thn kinh nhn to l m hnh tan hc n gin ca b no con
ngi, bn cht mng thn kinh l mng tnh tan phn b song song. Tri vi cc
m hnh tnh tan thng thng, hu ht cc mng thn kinh phi c hun luyn
trc khi s dng. Cc nghin cu v mng thn kinh nhn to bt u t thp
nin 1940. Nm 1944, McCulloch v Pitts cng b cng trnh nghin cu v lin
kt ca cc t bo thn kinh. Nm 1949, Hebb cng b nghin cu v tnh thch
nghi ca mng thn kinh. Cui nhng nm 1950, Rosenblatt a ra mng
Perceptron. Nghin cc v mng thn kinhch pht trin mnh t sau nhng nm
1980 sau giai an thai tro t nm 1969, khi Minsky v Papert ch ra mt s
khuyt im ca mng Perceptron. Nm 1985, mng Hopfield ra i v sau
mt nm l mng lan truyn ngc. n nay c rt nhiu cu hnh mng v cc
thut ton hun luyn tng ng c cng b gii quyt cc bi ton khc
nhau.
Chng ny s trnh by c bn v t bo thn kinh, cu trc v thut ton
hun luyn cc loi mng thn kinh s dng ph bin trong lnh vc iu khin
thng minh [76]. Cc dng mng thn kinh khc c th tham kho[39]. Cc ng
dng c th ca mng thn kinh trong lnh vc iu khin s c trnh by cc
chng tip theo.
Hnh v
3.2 T BO THN KINH V MNG THN KINH NHN TO
3.2.1 T bo thn kinh

Mng thn kinh nhn to ( gi ngn gn l mng thn kinh)c th xem nh

m hnh ton hc n gin ca b no con ngi. Mng thn kinh gm cc t bo
thn kinh ( n v x l) kt ni vi nhau bi cc lin kt. Mi lin kt km theo
mt trng s, c trng cho c tnh kch thch hay c ch gia cc t bo thn
kinh.
Hnh v
Mi t bo thn kinh c ni vi cc t bo thn kinh khc v nhn cc tn
hiu xj t chng vi cc trng s wj
t x = [ x1. x2.xm ] T : vector tn hiu vo t bo thn kinh
(3.1)
T
w = [ w1 w2...wm] : vector trng s ca t bo thn kinh
(3.2)
Qu trnh x l thng tin ca t bo thn kinh c th chia thnh hai phn:
x l ng vo v x l ng ra. Hm x l ng vo l hm tng c dng nh
sau.
Hm tuyn tnh ( linear function):

w x

f = net =

j 1

(3.3)

Hm tan phng( quadratic function):

f = net =

w x
j

j 1

Hm cu( spherical function):

f = net =

x j w j
2 m

j 1

(3.4)

x w

x w (3.5)

Trong cc biu thc trn, l mc ngng ca t bo thn kinh. Thng

hm tng ng vo c s dng nhiu nht l hm tuyn tnh (3.3). Ng ra ca
mi t bo thn kinh c cho bi biu thc :
y = a( f )
(3.6)
Hm a( . ) gi l hm tc ng ( activation function ) hay hm truyn (
transfer function ). Cc dng hm tc ng thng dng l:
Hm nc ( H.3.4a):
1 if f 0
a (f )
(3.7)
0 if f 0
Hm du (H.3.4b):
1 if f 0
1 if f 0

a (f )

Hm tuyn tnh:
a(f)=f
Hm dc bo ha (H.3.4c):

(3.8)
( 3.9)

a (f ) f
0

if f 1
if 0 f 1
if f 0

(3.10)

Hm tuyn tnh bo ha ( H.3.4d):

a (f )

1
f
1

if f 1
if 0 f 1
if f 1

Hm dng S n cc: ( H.3.4e):

1
a(f)=
f
1 e

( 3.12)
Hm dng S lng cc ( H.3.4f ):
2
1
a(f)=
f
1 e
( 3.13)

Ch rng, t bo thn kinh c m tn hiu vo vi mc ngng c th bin i

tng ng thnh t bo thn kinh c m+1 tn hiu vo vi mc ngng = 0
nh sau:

Tng c trng s ca cc tn hiu vo ca t bo thn kinh hnh 3.5 l:

Hnh 3.4:Cc dng hm tz1c ng thng dng
a)Hm nc; b)Hm du; c)Hm dc; d)Hm tuyn tnh bo ha

e)Hm dng S n cc;

f)Hm dng S lng cc.

Ch rng,t bo thn kinh c m tn hiu vi mc ngng c th bin i tng

ng thnh t bo thn kinh c m+1tn hiu vo vi mc ngng =0 nh sau :
Hnh 3.5: Bin i tong ng t bo thn kinh v dng c mc ngng bng 0
Tng c trng s ca cc tn hiu vo ca t bo thn kinh hnh 3.5 l :

w j x j 0
wj x j
j 1
j 0

f = net =

( 3.14)
R rng biu thc (3.3) v (3.14) l tng ng nhau. V vy cho n gin
( v cng khng mt tnh tng qut ), t y v sau chng ta ch xt cc t bo thn
kinh c mc ngng =0.
3.2.2 Mng thn kinh nhn to

Hnh 3.6 Cc lai thn kinh nhn to thng gp

a)Mng thn kinh truyn thng mt lp
b) Mng thn kinh truyn thng nhiu lp
c)Mng thn kinh hi quy mt lp
d)Mng thn kinh hi quy nhiu lp
Mng thn kinh nhn to gm nhiu t bo thn kinh lin kt cht ch vi nhau.
Ty theo cu trc mng ngi ta chia ra cc loi mng sau:
- Mng mt lp( H.3.6a, H.3.6c) l mng ch gm mt lp t bo thn
kinh x l.
- Mng nhiu lp ( H.3.6b, H.3.6d) l mng gn nhiu lp t bo thn
kinh x l.
- Mng truyn thng ( H.3.6a, H.3.6c) l mng m trong tn hiu
truyn ch theo mt chiu t ng vo n ng ra

Mng hi quy ( H.3.6c, H.3.6d) l mng m trong c tn hiu hi tip

t ng ra tr v ng vo.
3.3 CC PHNG PHP HUN LUYN MNG THN KINH NHN
TO
Mng thn kinh nhn to phi c hun luyn trc khi s dng. C hai
kiu hc:
- Hc thng s ( parameter Learning): cp nht cc trng s lin kt
gia cc t bo thn kinh trong mng
- Hc cu trc ( Structure Learning ): thay i cu trc mng, bao
gm s t bo thn kinh v cch lin kt gia chng
Hai kiu hc trn c th s dng ng thi hay ring l. Quyn sch ny ch
tp trung vo kiu hc thng s. C ba phng php hc thng s.
3.3.1 Hc c gim st ( Supervised Learning )
Trong phng php hc c gim st, d liu hun luyn mng thn kinh l
tp cc mu ( d liu vo- d liu ra) mong mun. Gi s c K mu d liu hun
luyn mng {( x(1), d(1); x(2),d(2);..;(x(K),d(K))}
Ban u cc trng s ca mng c khi ng gi tr bt k. Ln lt tng
d liu vo x( k) c a vo cc ng ca mng, mng thn kinh tnh c d
liu ng ra l y(k). D liu ra y( k) c so snh vi d liu ra mong mun d(k).
Sai s e(k)=d(k)-y(k) c s dng cp nht trng s ca mng (H.3.7)

3.3.2 Hc cng c ( Reinforcement Learning)

Trong phng php hc c gim st, chng ta bit d liu ng ra ca
mng tng ng vi mi mu tn hiu vo. Tuy nhin trong thc t, khng phi lc
no chng ta cng c c thng tin y nh vy. V d, trong mt s trng
hp chng ta ch bit ng ra thc ca mng l ng hay sai so vi ng ra
mong mun. Phng php hc da trn thng tin nh gi nh trn gi l hc
cng c. Thng tin nh gi ch cho bit mc ng hay sai ca ma trn
trng s m khng ch dn c phi thay i ma trn trng s nh th no i
n kt qu ng ( H.3.8).

3.3.3 Hc khng c gim st ( Unsupervised Learning )

Trong phng php hc khng c gim st, khng c thng tin phn hi
cho bit ng ra ca mng l ng hay sai. Mng thn kinh phi t pht hin ra cc
c im, cc mi tng quan, hay cc nhm ca tp mu d liu vo v m ha
chng thnh d liu ra ca mng.Trong khi pht hin ra cc c im ny, mng
thn kinh thay i thng s ca n, qu trnh ny gi l qu trnh t t chc
(H.3.9).

C th so snh ba phng php hc ca mng thn kinh nhn to vi ba

cch hc ca b no con ngi ( bng 3.1)
Bng 3.1 So snh cc phng php hc ca mng thn kinh nhn to
B no con ngi
Mng thn kinh nhn to
Hc c s hng dn ca gio vin
Hc c gim st
Hc c s nh gi ca gio vin
Hc cng c
T hc
Hc khng c gim st
Chng ta va xt ba phng php hun luyn mng thn kinh nhn to. D
hun luyn mng thn kinh nhn to theo phng php no th s tng qut
hun luyn mt t bo thn kinh cng c dng nh sau:
Trong hnh 3.10, tn hiu vo xj ( j=1,2,,m) c th l tn hiu ra t mt
t bo thn kinh khc hoc c th l tn hiu vo t bn ngoi. Ch rng mc
ngng ca t bo thn kinh cng bao gm trong qu trnh hc nh l mt trng
s ca ng vo xo c gi tr c nh bng -1. Tn hiu ra mong mun di ch tn ti
trong phng php hc c gim st, hoc trong phng php hc cng c, di l tn
hiu nh gi. Tng qut vector trng s ca t bo thn kinh thay i theo quy
lut sau:
wi (k+1)= wi (k ) + wi ( k)

(3.15)

trong wi ( k) l bin thin ca vector trng s ti bc lp th k

wi ( k) = rx(k)

(3.16)

l mt s dng quyt nh tc hc, gi l hng s hc; r l tn hiu hc,

tng qut l hm ca wi , x v tn hiu mong mun di (nu tn ti)

r = fr (wi (k),x(k),di )

(3.17)

Kt hp (3.15) v (3.16) ta c:
wi ( k+1) = wi (k)+ rx(k)

(3.18)

Trong cc mc sau chng ta s xt thut ton hc c th cho tng loi mng thn
kinh nhn to nh thut ton hc perceptron, thut ton hc Widrow- Hoff, thut
ton hc delta, thut ton lan truyn ngc.
3.4 MNG TRUYN THNG MT LP
Mng truyn thng mt lp, hay cn gi l mng perceptron n gin ( simple
perceptron), c cu trc nh hnh 3.11a. Hm tng ng vo ca Perceptron l
hm tuyn tnh, hm tc ng ng ra c th l hm du, hm tuyn tnh hay hm
dng S. Ty theo tng loi hm tc ng m ta c cc thut ton khc nhau
hun luyn perceptron.
3.4.1 Thut ton hc Perceptron
Mng thn kinh nhn to n gin nht l Perceptron c hm tc ng l
hm gii hn cng,mng ny thng c gi tt l Perceptron. Thut ton hun
luyn mng gi l thut ton hc Perceptron. Perceptron c quan tm nghin
cu rt nhiu v n c kh nng tng qut ha t nhng vector mu hun luyn v
kh nng hc t cc trng s v mc ngng ngu nhin bt k. Perceptron c
bit thch hp vi nhng phn loi mu n gin. Mng Perceptron c u im l
mng nhanh v tin cy. Ngoi ra, vic hiu hot ng ca Perceptron cung cp
kin thc c bn tt hiu cc mng phc tp hn.
Xt mng Perceptron c m ng vo v n ng ra(H3.11). Tng trng s ca cc ng
vo Perceptron th i:
m

neti =

w x
j 1

ij

( i= 1, n)

(3.19)
Ng ra ca Perceptron th i ( gi s hm tc ng l hm nc):

 1 if
0 if

y i a (net i ) step(net i )

net i 0
net i 0

(i= 1, n)

(3.20)

Cho K mu d liu vo- ra:

{(x(1),d(1); ( x(2),d(2);..; (x(K),d(K))}
Trong x=[ x1 , x2 ,.., xm ]T v d= [d1 ,d2 ,.,dm ]T , ( m l s ng vo, n
l s ng ra). Thut ton hc Perceptron l mt trng hp c bit ca thut ton
hc tng qut ( 3.18), trong tn hiu hc ri cp nht trng s ca Perceptron
th i bc lp th k c xc nh bi:
ri (k) = di (k)- yi (k)

( i=

1, n)

(3.21)

V ri (k) chnh l sai s gia ng ra mong mun v ng ra thc ca mng nn ta

cn s dng k hiu i ( k)= ri (k), do thut tan hc Perceptron cn c gi
l thut ton hc sa sai ( Error Correction Learning Rule). Thut ton hc
Perceptron c tm tt nh sau:
Thut ton 3.1: Lut hc Perceptron
Bc 1: Chn tc hc >0
Bc 2: Khi ng:
-

Gn sai s E=0.

Gn bin chy k = 1.

Gn cc vector trng s wi (k) ( i= 1, n) bng gi tr ngu nhin nh

bt k.

Bc 3: Qu trnh hun luyn bt u, tnh:

yi (k)= step( wi ( k ) x(k )) step

T

w
j 1

ij

(k ) x j ( k )

(i= 1, n)

Bc 4: Cp nht cc vector trng s:

wi (k+1)=wi (k)+ (di (k)-yi (k))x(k)

(i= 1, n)

Bc 5: Tnh sai s tch ly:

E=E+

1
d ( k ) y (k )
2

Bc 6: Nu k < K th gn k = k+1 v tr li bc 3. Nu k = K th tip tc bc

7.
Bc 7: Kt thc mt chu k hun luyn (epoch).
-

Nu E = 0 th kt thc qu trnh hc.

Nu E 0 th gn E = 0 , k = 1 v tr li bc 3 bt u mt chu k
hun luyn mi.

Vn t ra l thut ton hc Perceptron c hi t hay khng. nh l hi t

perceptron cho php nh gi tnh hi t ca thut ton hc Perceptron. Trc khi
trnh by nh l ny chng ta cn tm hiu khi nim kh phn tuyn tnh.
1-Khi nim kh phn tuyn tnh ( linearly separable)
n gin, trc tin chng ta xt trng hp mng ch c mt
Perceptron. Gi tp hp mu vector vo hun luyn Perceptron l:
S = {x(1),x(2),..,x(K)}
Gi S0 l tp hp mu vector vo c ng ra mong mun l 0:
S0 = {x(k) S d ( k ) 0 }
Gi S1 l tp hp cc vector vo c ng ra mong mun l 1:
S1 = {x(k) S

d (k ) 1 }

Nu tn ti mt ng thng ( trng hp mng c hai ng vo), mt mt

phng( trng hp mng c ba ng vo) hay mt mt siu phng(hyper-plane,
trng hp mng c nhiu hn ba ng vo) phn chia khng gian vector thnh hai
min ring bit: mt min cha S0 , mt min cha S1 th bi ton c gi l kh
phn tuyn tnh.

M rng khi nim kh phn tuyn tnh cho trng hp mng c nhiu
Perceptron. Tp vector vo dng hun luyn mng c nhiu Perceptron c
gi l kh phn tuyn tnh nu tp vector vo c kh nng tuyn tnh i vi tng
Perceptron trong mng.
hiu r hn khi nim kh phn tuyn tnh, ta xt hai v d sau y.
V d 3.1 Gi s ta cn hun luyn mt Perceptron c hai ng vo, mt ng ra
thc hin php ton logic OR. D liu hun luyn mng c hco bng 3.2.
Bng 3.2 Quan h vo ra ca php OR

X1

X2

X3

Ta c: S = {(0,0);(0,1);(1,0);(1,1)}; S0 ={(0,0)}; S1 ={(0,1);(1,0);(1,1)}

Biu din hai tp hp trn trong mt mt phng. D thy rng tn ti mt ng
thng chia hai mt phng thnh hai min: mt min cha S0 , mt min cha S1 nn
bi ton OR l bi ton kh phn tuyn tnh.

Hnh 3.12 Tp mu vector vo ca bi tan OR kh phn tuyn tnh

V d 3.2 Gi s ta cn hun luyn mt Perceptron c hai ng vo, mt ng ra
thc hin php ton logic XOR. D liu hun luyn mng cho bng 3.3
Bng 3.3 Quan h vo ra ca php ton logic XOR

X1

X2

Ta c: S = {(0,0);(0,1);(1,0);(1,1)}; S0 = {(0,0);(1,1)}; S1 = {(0,1);(1,0)}.

Biu din hai tp hp trn trong mt mt phng, ta thy rng khng th v
mt ng thng chia hai mt phng thnh hai min , mt min cha S0 , mt min
cha S1 nn bi ton XOR khng kh phn tuyn tnh.

Hnh 3.13 Tp mu vector vo ca bi tan XOR khng kh phn tuyn tnh

nh l 3.1: nh l hi t Perceptron
Nu bi ton kh phn tuyn tnh th thut ton 3.1 s lp li bc 3 mt s
hu hn ln.
2. ng dng mng Perceptron
Mng Perceptron thch hp gii cc bi ton phn loi n gin. Sau y
l mt v d:
V d 3.3: Trong dy chuyn sn xut gch men, ngi ta dng mt mng
Perceptron pht hin cc vin gch b km cht lng, Ngi ta dng ba g
nh vo cc vin gch v dng micro thu tn hiu m thanh t cc vin gch
pht ra. Tn hiu thu c qua mch lc nhiu phn tch ph, ngi ta thu c s
liu bng 3.4.
Bng 3.4 D liu bin m thanh theo cht lng vin gch
Bin tn hiu 475Hz

Bin tn hiu 555Hz

0.958

0.003

1.043

0.001

Cht lng vin gch

t
t

1.907

0.003

0.780

0.002

0.579

0.001

0.003

0.105

0.001

1.748

0.014

1.839

0.007

1.021

0.004

0.214

t
t
t
Khng t
Khng t
Khng t
Khng t
Khng t

Dng tp d liu trn hun luyn mng Perceptron hai ng vo mt ng ra. Sau
khi hun luyn xong, mng c kh nng pht hin cc vin gch km cht lng.
3.4.2 Adaline v mng tuyn tnh
Mng tuyn tnh ( Linear Network) l mng truyn thng mt lp gm cc
phn t thch nghi tuyn tnh Adaline ( Adaptive Linear Element). Adaline tng
t nh Perceptron, ch khc ch hm tc ng ca Adaline lm hm tuyn tnh
ch khng phi hm gii hn cng. iu ny cho php ng ra ca Adaline c th
nhn mt gi tr bt k.Trong mc ny chng ta xt thut ton hc Widrow- Hoff,
bn cht l thut ton trung bnh bnh phng ti thiu ( LMS- Least Mean
Squares) nn hiu qu hn thut ton hc perceptron v di chuyn gii hn phn
loi ra xa nht c th c so vi cc mu phn loi. V ng ra ca Adaline c th
nhn mt gi tr bt k nn c th s dng Adaline trong cc bi ton iu khin.

Xt mng tuyn tnh c m ng vo v n ng ra( H.3.14). Tng trng s ca

cc ng vo Adaline th I l:
m

neti = wij x j
j 1

Ng ra ca Adaline th i:

(3.22)

w x

yi = a(neti ) = neti =

j 1

ij

(3.23)

Cho K mu d liu vo- ra:

{x(1),d(1);x(2),d(2);.;(x(K),d(K))}.
Trong x = [x1 ,x2 ,.,xm ]T v d =[d1 , d2 ,,dn ]T , ( m l s ng vo, n l s
ng ra), ta cn tm cc vector trng s wi sao cho:
m

w x
j 1

ij

(k )

(k ) ,

( k =1,.K)

(3.24)

D thy rng (3.24) l h gm K phng trnh tuyn tnh. Li gii wi ca h

phng trnh trn ch tn ti nu cc mu d liu hun luyn x(1), x(2),
..,x( K) c lp tuyn tnh, iu ny xy ra ch khi K m. Do chng ta ch
c th lu tr ti a m quan h bt k trong mt Adaline.
Nu cc mu d liu hun luyn mng khng tha mn iu kin c lp
tuyn tnh, ta tm vector trng s wi sao cho ti thiu tng bnh phng sai s gia
ng ra mong mun v ng ra ca mng:

d
n

E(w) =

i 1

y 2 min

(3.25)

C th tm c li gii ca bi ton tm cc tr (3.25) bng thut ton suy

gim dc:

w (k 1) w (k 1)
ij

ij

E ( k )
wij

(3.26)

Ta c:

E (k ) E (k )

wij y
i

net
i
i

d i(k )
net i wij

y (k ).1. x (k )
i

(3.27)
Thay biu thc (3.27) vo biu thc (3.26) ta c:

ij

(k 1)

ij

(k )

d ( k ) y (k ) x
i

(k )

(3.28)

Thut ton (3.28) c gi l thut ton hc Adaline hay thut ton hc

Widrow_Hoff. i vi thut ton hc Widrow-Hoff trng s ban u c th khi
ng gi tr bt k. Thut ton hc Widrow-Hoff c tm tt nh sau:
Thut ton 3.2 Thut ton hc Widrow-Hoff
Bc 1: Chn tc hc > 0, chn sai s cc i Emax
Bc 2: Khi ng:
- Gn sai s E = 0
- Gn bin chy k = 1
-

Gn cc trng s

ij

(k ) (i = 1, n; j = 1, m ) bng gi tr bt k.

Bc 3: Qa trnh hun luyn bt u, tnh:

(k )

w (k ) x
ij

(k )

1, n

( i=
)
Bc 4: Cp nht cc trng s theo biu thc:
j 1

w (k 1) w (k ) d (k ) y (k ) x (k )
ij

ij

(i= 1, n ;j= 1, m )

Bc 5: Tnh sai s tch ly:

E=E+

1
2

d (k ) y (k ) 2
n

i 1

Bc 6: Nu k < K th gn k = k + 1 v tr li bc 3
Nu k = K th tip tc bc 7
Bc 7: Kt thc mt chu k hun luyn.
- Nu E < E max th kt thc qu trnh hc.
- Nu E Emax th gn E = 0, k = 1 v tr li bc 3 bt u mt chu k
hun luyn mi.
Ch : Thot nhn ta tng rng hai thut ton 3.1 v 3.2 l nh nhau v
biu thc cp nht trng s bc 4 nh nhau. Tuy nhin, v bn cht hai thut
ton trn khc nhau: thut ton 3.1 khng phi l thut ton ti u, trong khi thut
ton 3.2 l thut ton ti u, qu trnh hc theo thut tan 3.2 lm cc tiu ha sai
s, ngha l lm cho mt siu phng phn chia cc nhm nm cch xa cc nhm
nht. Adaline ch c th hc mi quan h tuyn tnh gia vector vo v vector ra.
V vy Adaline khng th tm ra li gii cho mt s bi tan. Tuy nhin, mc d
li gii han chnh khng tn ti, Adaline cng ti thiu tng ca bnh phng sai
s nu tc hc c chn d nh.
3.4.3 Perceptron vi hm tc ng bn tuyn tnh
Ta bit Perceptron n gin s dng hm tc ng l hm gii hn cng
( hm nc hay hm du), m hm gii hn cng li khng kh vi ti mi im nn
ta khng th p dng thut ton hc ti u. khc phc khuyt im trn, ta c
th thay hm gii hn cng bng hm gii hn mm.
Xt mng thn kinh truyn thng vi hm tc ng bn tuyn tnh:

a net i a

Sai s ca mng:

d
n

E(w) =

i 1

w x
j 1

ij

y 2

(3.29)

(3.30)

p dng thut ton suy gim dc, trng s ca mng c cp nht bi

cng thc:

w (k 1) w (k )
ij

D dng thy rng:

ij

E (k )
wij

(3.31)

E (k ) E (k )

wij y
i

net
i
i

(d i (k )
net i wij

y (k )a (net (k )) x (k )
,

(3.32)

E (k )
E (k )

t: i (k )
net i (k )
y
i

net i

d (k ) y (k ) a (net (k ))
,

(3.33)

(k ) gi l tn hiu sai s. Kt hp (3.31),(3.32) v (3.33) ta c:

w (k 1) w (k )
ij

ij

(k ) x j (k )

(3.34)

Biu thc ( 3.34) gi l thut ton hc Delta. Thut ton hc Delta c

tm tt nh sau:
Thut ton 3.3: Thut ton hc Delta
Bc 1: Chn tc hc > 0, chn sai s cc i Emax
Bc 2: Khi ng:
- Gn sai s E = 0
- Gn bin chy k = 1
Gn cc trng s

ij

(k ) bng gi tr ngu nhin nh bt k.

Bc 3: Qu trnh hun luyn bt u, tnh:

net i (k )

w (k ) x
ij

j 1

(k )

(i= 1, n )

y (k ) a(net (k ))

(i= 1, n )

Bc 4: Cp nht cc trng s theo biu thc:

i (k )

d (k ) y (k ) a net (k )
,

w (k 1) w (k )
ij

ij

(k ) x j (k )

Bc 5: Tnh sai s tch ly:

E=E+

1 n

2 i 1

d ( k ) y ( k )
i

Bc 6 :Nu k < K th gn k = k+1 v tr li bc 3

Nu k = K th tip tc bc 7
Bc 7: Kt thc mt chu k hun luyn.

Nu E < Emax th kt thc qu trnh hc

Nu E E max th gn E = 0, k = 1 v tr li bc 3 bt u mt chu k
hun luyn mi.
Ch rng tng t nh mng tuyn tnh, iu kin tm c li gii E
(w) = 0 cho mng Perceptron vi hm tc ng dng S l cc mu hun luyn phi
tha mn iu kin c lp tuyn tnh. Khc vi mng tuyn tnh, thut ton hc
Delta cho mng perceptron vi hm tc ng dng S c th tm c cc li gii
cc b. Do , c kh nng tm c li gii ton cc trng s ban u ca
mng phi c chn l gi tr ngu nhin nh bt k.
V d 3.5 Xt mng thn kinh vi hm tc ng l hm dng S lng cc:
2
a(f)=
(3.38)
f - 1
1 e

2e
a( f )
1
2

(f)
Do:
a
f 2
f
2
1 e

(3.39)

Nn tn hiu sai s trong trng hp hm tc ng dng S lng cc l:

(k )

d (k ) y (k ) a net (k )
,

d (k ) y (k ) 12 1 a net (k )
1
= d (k ) y (k ) 1 y (k )

2
=

(3.40)

3.5 MNG TRUYN THNG NHIU LP

3.5.1 Cu trc mng
Mng truyn thng nhiu lp l mng truyn thng c t hai lp t bo thn
kinh x l tr ln. Lp t bo thn kinh ni vi ng vo gi l lp vo (thng lp
vo khng thc hin cc php ton x l), lp t bo thn kinh ni vi ng ra gi
l lp ra, lp t bo thn kinh khng ni trc tip vi ng vo v ng ra gi l lp
n. Kt ni gia cc t bo thn kinh cc lp c th y hoc khng y .
Khc vi mng truyn thng mt lp, mng truyn thng nhiu lp c th gii bi
ton khng kh phn tuyn tnh. Thut ton hun luyn mng truyn thng nhiu
lp l thut ton lan truyn ngc. Thut ton lan truyn ngc thc hin hai bc
truyn thng tin. Th nht, mu d liu vo x(k) c truyn t ng vo n ng
ra, kt qu ca vic truyn d liu theo hng thun l to ra tn hiu y(k) ng ra
ca mng. Sau sai s l sai lch gia d(k) v y(k) c truyn ngc t lp ra
tr v lp trc cp nht trng s ca mng. Do thut ton hun luyn mng
truyn thng l thut ton lan truyn ngc nn mng ny cn c gi l mng
lan truyn ngc.
3.5.2 Thut ton lan truyn ngc ( Back Propagation- BP)

Xt mng thn kinh truyn thng ba lp c m t bo thn kinh lp vo, l

t bo thn kinh lp n v n t bo thn kinh lp ra (H.3.17). K hiu trng s
ca t bo thn kinh th q ca lp n l vq , trng s ca t bo thn kinh th I
lp ra l wi . Gi hm tc ng ca cc t bo lp n l ah (.) ca lp ra l ao (.).
Quan h gia cc tnhiu truyn trong mng nh sau:
Tng c trng s ca cc tn hiu vo t bo thn kinh th q lp n l:

net

v x

qj

j 1

(3.41)

Tn hiu ra ca t bo thn kinh th q lp n l:

z a net a v x

qj

j 1

(3.42)

Tng trng c s ca cc tn hiu vo v t bo thn kinh th i lp ra l:

net w z w a net w a v x

(3.43)

q 1

iq

iq

q 1

iq

q 1

j 1

qj

Tn hiu ra ca t bo thn kinh th i lp ra l:

y a net a w z

iq

q 1

w a net a w a v x

ao

(3.44)
iq
h
q
o
iq
h
qj
j
q 1
j 1
q 1
Gi s ta c tp d liu hun luyn mng gm K mu ( x (k) , d (k)) k=
1..K . Tiu chun hun luyn mng l lm ti thiu sai s:
2
1 n
1 n
2
E(w,v) = d i yi d i ao net i
2 i 1
2 i 1

1 n
=
2 i 1

q 1

d a w z
i

iq

d a w a net

1 n

2 i 1

q 1

iq

(3.45)
p dng thut ton suy gim dc, trng s ca lp ra c cp nht:

(k 1) wiq (k )
iq

E (k ) E (k )

wiq y
i

(3.47)

E (k )
wiq

net
i
i

net i wiq

(3.46)

d (k ) y (k )a
i

,
o

net (k )
i

E (k ) E (k )

t oi (k )
net i y
i

net i

d (k ) y (k )a
i

,
o

net (k )
i

(3.48)
Thay (3.47) v (3.48) vo (3.46) ta c:

iq

(k 1) wiq (k ) oi (k ) z q (k )

(3.49)

Tng t, trng s ca lp n c cp nht bi cng thc:

qj

(k 1) vqj (k 1)

=
i 1

(3.50)

z q net q

net q vqj

E (k ) E (k )

viq z q

E (k )
vqj

d (k ) y (k ) a net (k ) w
,

iq

a net (k ) x (k )

(k )

(3.51)

zq

E (k )
E (k )

t: hq (k )
net q z q

i 1

(k )

net q

y (k ) a net (k ) w
,

iq

a net (k )

( k )

(3.52)
Thay (3.48) vo (3.52) ta c:
n

,
(
k
)

hq
oi ( k ) wiq ( k ) a n
i 1

Kt hp (3.50), (3.51) v (3.53) ta c:

qj

net

(k )

(k 1) vqj (k ) hq (k ) x j (k )

(3.53)

(3.54)

Do trng s ca mng c cp nht da vo tn hiu sai s

oi

(k ), hq (k ) v c th m rng c cho mng c nhiu lp t bo thn

kinh tnh ton hn nn thut ton lan truyn ngc cn c gi l thut ton hc
Delta tng qut. Thut ton lan truyn ngc hun luyn mng truyn thng ba
lp c tm tt nh sau:
Thut ton 3.4:Thut ton hc lan truyn ngc sai s ( BP )
Bc 1: Chn tc hc >0, chn sai s cc i Emax
Bc 2: Khi ng:
- Gn sai s E = 0.

Gn bin chy k = 1.

Gn cc trng s

iq

(k ) ,

qj

(k ) ( i = 1, n , j = 1, m , q = 1, l )

bng gi tr ngu nhin nh bt k.

Bc 3: ( truyn thun d liu) Tnh ng ra ca mng vi tn hiu vo l x k :
m

net q (k )

Lp n:

qj

z (k ) a net
q

net i (k )

Lp ra:

j 1

(k ) x j (k )

(q = 1, l )

(k )

(q = 1, l )

iq

q 1

(k ) z q (k )

( i = 1, n )

y (k ) a net (k )
o

( i = 1, n )

Bc 4: ( Lan truyn ngc sai s) Cp nht trng s ca mng:

oi (k )

Lp ra:

iq

d (k ) y (k )a
i

(k 1)

iq

iq

Lp n:

i 1

net (k )

oi

(i = 1, n ; q = 1, l

a net
,

( k ) wiq ( k )

(k 1) viq (k ) hq (k ) x j (k )

)
1 n
Bc 5: Tnh sai s tch ly: E = E +
2 i 1

d (k ) y ( k )
i

( i = 1, n )

(k ) oi (k ) z q (k )

hq (k )

(k )

(q = 1, l )

( j = 1, m , q = 1, l
2

Bc 6: Nu k < K th gn k = k+1 v tr li bc 3 .
Nu k = K th tip tc bc 7.
Bc 7: Kt thc mt chu k hun luyn
- Nu E < Emax th kt thc qu trnh hc.
- Nu E E max th gn E = 0, k = 1 v tr li bc 3 bt u mt chu k
hun luyn mi.
V d 3.6 Xt mng thn kinh ba lp vi hm tc ng lp n l hm dng S
lng cc v hm tc ng lp ra l hm tuyn tnh.

ah ( f )

a (f) f
o

Do:

,
h

(f)

1 e

(3.55)
(3.56)

1
2
1 a ( f )
2

(3.57)

,
o

( f ) 1

(3.58)

Nn tn hiu sai s lp ra l:

oi (k )

d ( k ) y ( k ) a
i

,
o

net (k ) d (k ) y (k )
i

V tn hiu sai s lp n l:
n

,
(
k
)

hq
oi (k ) wiq (k ) an net q (k )
i 1

n
1
1 a h net q ( k )
= oi (k ) wiq (k )
i 1
2

(3.59)

1 n

2
= oi (k ) wiq (k ) 1 z q (k )
(3.60)
2 i 1

Thut ton hun luyn mng l thut ton lan truyn ngc vi tn
hiu sai s xc nh bi biu thc (3.59) v (3.60)
Tng t, c th rt ra c tn hiu hc cho mng thn kinh ba lp
c hm tc ng lp n v lp ra u l hm S lng cc nh sau:

(k )
oi

hq (k )

1
2

d (k ) y (k ) 1 y (k )
2

1
2

i 1

oi

z (k )

(k ) wiq (k ) 1

nh ngha 3.1
Hm tc ng a(f) :R[0,1] ( hoc [-1,1]) oc gi l hm tc ng dng
nn nu a(f) khng gim,

lim a(f) = 1 v lim a(f) = 0 ( hc -1).

f

R rng hm tc ng dng S n cc v lng cc l hm tc ng dng

nn.
nh l 3.2
Mng truyn thng c t nht mt lp n vi hm tc ng dng nn
( squashing activation function) v hm tng dng tuyn tnh hoc a thc c th
xp x mt hm bt k vi chnh xc mong mun nu s t bo thn kinh lp
n ln.
nh l 3.2 khng nh mng truyn thng nhiu lp l b xp x tng qut.
Do , nu trong mt ng dng no m thut ton lan truyn ngc hun luyn
mng khng hi t th nguyn nhn c th do thng s hun luyn mng khng
thch hp, s lng t bo thn kinh lp n khng ln hoc c li trong tp
mu d liu hun luyn mng.
Mc d nh l 3.2 khng nh mng truyn thng ba lp( mt lp n) c
th xp x mt hm bt k nhng thc t i khi ngi ta s dng mng truyn
thng nhiu lp hn. L do l trong nhiu lp ng dng, nu dng mng ba lp th

s t bo thn kinh lp n qu ln, trong khi nu dng mng nhiu hn ba lp

th s lng t bo thn kinh cc lp n s t hn.
V d 3.7 Gi s chng ta cn xp x hm phi tuyn:
y=

sin (10x) ,

0 x 2

(3.61)

Cu hnh mng thn kinh xp x hm phi tuyn (3.61) nh sau:

- Mt ng vo l x, mt ng ra l y .
- S t bo thn kinh lp n l N. V d ny kho st kh nng xp x
ca mng trong bn trng hp N bng 6,8,10,12.
- Hm kch hot lp n l tansig, lp ra l tuyn tnh.
Hnh 3.18 l tp d liu ngu nhin gm 300 mu dng hun luyn mng. Theo
biu thc (3.61) v th hnh 3.18 ta thy hm cn xp x c tnh phi tuyn cao.
Hnh 3.19 l sai s hun luyn mng trong cc trng hp s t bo thn
kinh lp n l 6,8,10,12. R rng khi s t bo thn kinh lp n cng tng th
sai s cng gim. Hnh 3.20 l ng ra ca mng trong bn trng hp nu trn, d
thy rng khi s t bo thn kinh lp n ln sai lch gia ng ra ca mng v
gi tr hm s (3.61) khng ng k.
V d 3.8 Tnh ton ng hc cnh tay my
Trong v d ny mt mng thn kinh lan truyn ngc n gin c s
dng gii bi ton ng hc thun ca mt cnh tay my (H.3.21). Tn hiu vo

, ), tn hiu ra ca mng l
ta - cc ( x,y ). Quan h phi tuyn gia ( , ) v (x,y) nh sau:
x = l cos + l cos 1 2
( 3.62)
y = l sin + l sin 1 2
ca mng l ta gc gia cc khp ni (

Cu trc mng thn kinh dng xp x quan h (3.62) nh sau:

-

Hai ng vo l

- Hai ng ra l x v y .
- S t bo thn kinh lp n l 10.
- Hm kch hot lp n l tansig, lp ra l tuyn tnh
Tp d liu gm 200 mu c s dng hun luyn mng, cho thy sai
s ca mng gim dn trong qua trnh hun luyn n khi t c sai s
mong mun. Sau khi hun luyn xong, ch cn t vo ng vo ca
mng gi tr (

) bt k qua mng s tnh ta ( x,y) tng ng.

3.5.3 Cc yu t nh hng n qu trnh hun luyn mng

1- Trng s khi ng
Trng s ban u ca mng truyn thng nhiu lp nh hng rt nhiu n
li gii ca thut ton lan truyn ngc. Thng trng s ban u c khi ng
l gia tr ngu nhin nh. Nu khi ng trng s ban u bng nhau th khng th

hun luyn c mng trong trng hp li gii ng l cc trng s khc nhau.

Trng s ban u phi nh v nu trng s ln s lm cho hm tc ng dng S
bo ha ngay t u v thut ton s ri vo cc tr cc b. Nn chn cc trng s

ij

ban u ngu nhin nm trong on [-3/

, 3/

], trong ki l s tn

hiu vo ca t bo thn kinh th i.

2- H s hc
Mt yu t quan trng khc nh hng mnh n tc hc v tnh hi t
ca thut ton lan truyn ngc l h s hc . Khng c cch chn thch hp
cho cc trng hp khc nhau, thng c chn da vo kinh nghim cho
mi bi ton. Gi tr ln lm tng tc hc, nhng nu ln qu th c th lm
cho thut ton khng hi t, ngc li gi tr nh bo m thut ton lun hi
t nhng tc hc li rt chm. Thc nghim cho thy gi tr nm trong
khang 0,001 n 10 l thch hp trong nhiu trng hp hun luyn mng.
Phng php hiu qu nht m bo thut ton lan truyn ngc va hi
t va hun luyn mng nhanh l dng h s hc thch nghi. tng c bn ca
phng php hc thch nghi nh sau: mi bc lp ta kim tra xem trng s va
c cp nht c lm gim tiu chun hun luyn mng khng, nu khng c
ngha l xy ra vt l, trong trng hp ny nn gim ; ngc li nu trong
vi bc lp lin tip tiu chun hun luyn mng u gim th qu nh, trong
trng hp ny nn tng .
C th thut ton hc thch nghi c m t bi cc biu thc:
(k 1) ( k )
(3.63)
a
b (k )

(3.64)

3- Tiu chun hun luyn mng

Tiu chun hun luyn mng thng dng l chun ton phng L2 (tng
bnh phng ca sai s, xem (3.44)), tng qut ta c th s dng chun Lp .
1 n
E=
p i 1

hc

y
i

(1 p + )

(3.65)

D thy rng khi thay i tiu chun hun luyn mng th ch c tn hiu
oi

ca lp ra l thay i, cc biu thc khc ca thut ton lan truyn

ngc vn gi nguyn.
4- Xung lng
Phng php lm suy gim dc c th rt chm nu h s hc qu nh
v c th dao ng mnh nu h s hc qu ln. Hin tng ny thng xy ra
nu im cc tiu c dng thung lng c dc ln sn v dc nh y.
Mt phng php hiu qu thng dng cho php s hc ln m khng xy ra dao
ng phn k l cng thm mt xung lng vo phng php suy gim dc
thng thng.

w (k 1) w (k ) w (k )
ij

ij

(3.66)

ij

E (k )
wij (k 1)
(3.67)
wij
Trong cng thc (3.66), gi l h s xung lng ( 0 1 ), gi tr
wij (k )

thng dng l 0,9. Nh xung lng cng vo m mi trng s s thay i theo

hng dc trung bnh, do thut ton khng b dao ng.
5- Lut cp nht trng s
Phng php suy gim dc l mt trong nhng phng php ti u ha
n gin nht nhng khng phi l phng php hiu qu nht. Phng php hiu
qu hn cp nht trng s ca mng thn kinh l phng php Newton;

wij (k 1) wij (k )

2 E (k )

w 2
ij

E ( k )

wij

(3.68)

Phng php Newton hi t nhanh chng nhng d ri vo im cc tr cc

b. Mt khc tnh ton o hm bc hai rt kh khn nn thc t phng php ny
t c s dng.
6-D liu hun luyn mng
D liu hun luyn mng cn v ng. Khng c quy tc chung no ch
r cch chn d liu hun luyn thch hp trong mi trng hp. Thc nghim
cho thy d liu hun luyn mng cn chn ngu nhin v bao hm ton b khng
gian ca tn hiu vo. Gi K l s mu d liu hun luyn mng, hun luyn
mng thn kinh phn lai mu tn hiu vo cn chn K >>M, vi M l s nhm d
liu cn phn loi.
7- S nt n
S lng t bo thn kinh lp n nh hng rt ln n tnh hi t ca
thut ton lan truyn ngc v cht lng ca mng. Thng s lng t bo thn
kinh lp n c chn da vo kinh nghim. Nn bt u vi mng c t t bo
lp n, nu thut ton khng hi t th tng dn s t bo n khi thut ton hi
t.
Mng truyn thng vi thut ton hun luyn lan truyn ngc c ng
dng gii nhiu bi ton. Tuy nhin, bn cnh nhng thnh cng thc t, thut
ton lan truyn ngc c khuyt im l kh hun luyn, chm hi t. Mc d vic
ti u ha h s hc v h s moment ci thin c cht lng ca mng lan
truyn ngc nhng n vn cn km hiu qu v tn nhiu thi gian, do khng
ph hp gii mt s bi ton thi gian thc.
3.6 MNG HM C S XUYN TM
3.6.1 Cu trc mng hm c s xuyn tm
(Radial Basis Function Networks RBF)
Mng RBF l mt trng hp c bit ca mng truyn thng hai lp
( H.3.23), trong :
- Hm tng ng vo ca t bo thn kinh lp n l hm cu (3.5).

Hm kch hat ca t bo thn kinh lp n l hm m:

ao (f) =

(3.69)

- Hm tng ng vo ca t bo thn kinh lp ra l hm tuyn tnh (3.3)

- Hm kch hot ca t bo thn kinh lp ra l tuyn tnh (3.9)
- Mc ngng ca cc t bo thn kinh bng 0.
Do p dng cng thc tnh quan h vo ra ca mng truyn thng, ng ra
ca t bo thn kinh th I ca mng RBF c m ng vo, n ng ra v l t bo
thn kinh lp n c tnh theo nh sau:

y
Trong

w z
iq

q 1

x q x q

w e
q 1

iq

x q

(3.70)

2q

x q

(3.71)

R l tm ca hm c s th q ( trng s ca lp n)

R l phn tn ca hm c s th k

w R
i

l trng s lp ra ( ca ng ra th I ).

Hnh 3.24 l ng ra ca t bo thn kinh lp n ca mng RBF, ta thy

vector tn hiu vo cng gn tm ca hm c s th ng ra ca t bo thn kinh
lp n cng ln v ngc li. Do ng ra ca mng l tng c trng s ca cc ng
ra ca cc t bo thn kinh lp n nn ch nhng vector tn hiu vo nm trong
ln cn quanh tm ca hm c s mi nh hng n ng ra ca mng. Ni cch
khc, hm c s xuyn tm c tnh cc b.
3.6.2 Thut ton hun luyn mng RBF
Do mng RBF l mt trng hp c bit ca mng truyn thng nn han
ton c th p dng thut ton lan truyn ngc hun luyn mng RBF. Tuy
nhin, do c im hm c s xuyn tm c tnh cc b nn thng thng mng
RBF c hun luyn qua hai bc:
Bc 1: Xc nh tm v phn tn ca cc hm c s
-

Xc nh tm

(q = 1..l ) ca cc hm c s: cch ph bin nht l

phn cc vector tn hiu vo trong tp d liu hun luyn mng thnh q

nhm, sau tnh tm
-

Xc nh phn tn
tn

chnh l tm ca mi nhm.

( q = 1..l ) ca cc hm c s: gi tr phn

c nh hng rt ln n cht lng ca mng. C nhiu cch

khc nhau xc nh gi tr ny, cch ph bin nht l da trn s

tng ng gia cc nhm d liu vo. i vi mi t bo thn kinh
lp n, khang cch t tm ca n n t bo thn kinh khc gn nht
chnh l phn tn

Bc 2: Hun luyn trng s lp ra ca mng.

Do tn hiu ra ca mng RBF tuyn tnh theo trng s ca lp ra nn trng
s ca lp ra c th tnh c d dng bng cch s dng thut ton bnh phng
ti thiu tuyn tnh.

z z

k 1

(k )

k 1

(k ) d i (k )

z(k) = [ z1 (k) z2 (k) ..zl(k)]T

Trong :

(3.72)

(3.73)

x ( k ) q

z q (k ) e 2 q

(3.74)

(K l s mu d liu hun luyn mng)

Ngai ra, cng c th hun luyn trng s ca cc t bo thn kinh lp ra
dng thut ton lp nh sau:
Thut ton 3.5: Thut ton hun luyn trng s lp ra ca mng RBF
Bc 1: Chn tc hc > 0, chn sai s cc i Emax
Bc 2: Khi ng:
- Gn sai s E = 0.
- Gn bin chy k = 1.
-

Gn cc trng s

iq

(k ) , (i = 1, n ; q = 1, l ) bng gi tr ngu nhin

bt k.
Bc 3: Tnh ng ra ca mng vi tn hiu vo l x (k) :

x ( k ) q

(k ) e 2 q
(k )

iq

q 1

(k ) z q (k )

(i = 1, n )

Bc 4: Cp nht trng s ca lp ra ca mng:

iq

(k 1) wiq (k ) d i (k ) y (k )
i

z (k )
q

(i = 1, n ; q = 1, l )

Bc 5: Tnh sai s tch ly:

1 n
E=E+
2 i 1

d (k ) y (k )
i

Bc 6: Nu k < K th gn k = k+1 v tr li bc 3
Nu k = K th tip tc bc 7
Bc 7: Kt thc mt chu k hun luyn.
- Nu E < Emax th kt thc qu trnh hc.
- Nu E Emax th gn E = 0, k =1 v tr li bc 3 bt u mt chu k
hun luyn mi.
Nhn xt: Mc d mng RBF v mng BP u c cu trc l mng truyn thng
nhng cht lng ca mng RBF tt hn mng BP do hai loi mng ny c mt s

khc bit. Khc bit th nht l gi tr khi ng ca cc trng s. i vi mng

BP trng s thng c khi ng ngu nhin, trong khi trng s ban u ca t
bo thn kinh lp n ca mng RBF ( tm ca hm c s) c th c chn da
trn s phn nhm ca d liu vo. Khc bit th hai l thut ton hun luyn
mng. Qu trnh hun luyn mng BP chnh nh tt c cc trng s lp n v
lp ra, trong khi qu trnh hun luyn mng RBF ch yu chnh nh trng s
tuyn tnh lp ra.
Mng RBF c kh nng xp x hm rt tt v c th hun luyn d dng,
nhanh chng. Ngai ra, mng RBF khng gp vn lin quan n cc tr cc b
khi hun luyn nh mng BP. Mt trong nhng im u tin ca mng RBF l cc
trng s tuyn tnh lp ra c th xem nh c lp vi cc t bo thn kinh lp
n. Sau khi trng s lp n c hun luyn dng k thut ton ti u ha phi
tuyn, trng s ca lp ra c hun luyn dng thut ton ti u ha tuyn tnh.
Kh nng xp x chnh xc v tc ca mng RBF cn c th ci thin hn na
bng vic chn tm v phn tn ph hp cho cc hm c s lp n. Tuy
nhin, RBF thng p ng chm trong giai an nh do lng ln t bo thn
kinh lp n.
3.7 MNG THN KINH SUY DIN M THCH NGHI
3.7.1 Cu trc mng thn kinh suy din m thch nghi
(Adaptive Neuro Fuzzy Inference System- ANFIS)
ANFIS l mt m rng ca m hnh m Takagi- Sugeno cho php h m c
th hc thng s dng k thut ton hc lan truyn ngc thch nghi. Tng qut
ANFIS phc tp hn nhiu so vi h suy din m. n gin, ta xt h m c
hai ng vo l x1 v x2 v mt ng ra y. Gi s h m Takagi_Sugeno gm hai quy
tc:
~
~
Nu x1 l A11 v x2 l A21 th y = f1 = b01 + b11 x1 + b21 x2
~
~
Nu x1 l A12 v x2 l A22 th y = f2 = b02 +b12 x1 + b22x2
(3.75)
thc thi h m Takagi_ Sugeno trn ta c th s dng cu trc mng
ANFIS nh hnh 3.25. Mng ANFIS gm nm lp, chc nng ca cc nt trong
mi lp nh sau:
Lp 1: Mi nt l mt hm lin thuc ca tp m biu din gi tr ngn ng lin
quan n cc bin vo. Bt c dng hm lin thuc no lin tc v kh vi tng
an u c th s dng c nh dng tam gic, hnh thang, gauss, sigmoid,
chung..( xem biu thc cc hm lin thuc chng 2). Cc hm lin thc
lp 1 c thng s thay i c, cc thng s ny gi l thng s mnh iu
kin.
1
(3.76)
oi ~ ( x)
A

Hnh 3.25 Mng ANFIS thc thi h m Takagi-Sugeno

Lp 2: Mi nt lp 2 c k hiu l mt hnh trn c du ( tch), ng ra ca
nt lp 2 l tch ca tt c cc ng vo, v d hnh 3.25.

w
i

~
A1i

( x1) ~ ( x2)

(i=1,2)

A2 i

(3.77)
Ng ra ca mi nt chnh l ng ca mnh iu kin ca mi quy
tc.
Lp 3: Mi nt lp 3 c k hiu l mt hnh trn c du N ( Normalizechun ha), ng ra ca mt nt lp 3 ng chun ha ca mi quy tc:
3

wi

w w
1

(i=1,2)

(3.78)

Lp 4: Chc nng ca nt lp 4 l tnh ng ra ca mi quy tc:

o w f
4

Trong

wi ( b0i + b1i x1 + b2ix2 )

(3.79)

l ng ra ca lp 3. Cc thng s ca hm fi c th chnh nh v

c gi l thng s mnh kt lun.

Lp 5: Ng ra ca nt lp 5 l tng ca cc ng vo nt (ng ra ca lp 4):
5

y i wi fi

(3.80)

R rng cng thc (3.80) ng nht vi cng thc tnh ng ra ca h m

Takagi- Sugeno trnh by chng 2.
Hnh 3.26 a)Mng ANFIS chn qui tc ; b)Khng gian con m tng ng
Trn y ta xy dng c cu trc ANFIS thc thi mt h suy din
m Takagi- Sugeno n gin. Cc h m Takagi-Sugeno khc phc tp hn cng
u c th thc thi dng cu trc ANFIS tng t nh trnh by. Hnh 3.26 l
mng ANFIS thc thi h m hai ng vo ,chn qui tc .C ba hm lin thuc lin
quan n mi bin vo nn khng gian tn hiu vo chia lm chn khng gian m
con , mi khng gian m con chu s chi phi ca mt qui tc m .Mnh iu
kin ca cc qui tc xx nh cc khng gian m con ,trong khi mnh kt lun
xc nh ng ra trong khng gian m con tng ng .
3.7.2 Thut Ton lai hun luyn ANFIS
C th p dng thut ton suy gim dc hun luyn mng ANFIS ,tuy nhin thut ton suy
gim dc c khuyt im l chm hi t v li gii c th ri vo cc tr cc b.Mt thut
ton khc hiu qu hn hun luyn mng ANFIS l thut ton hc lai nh trnh by di y.

Trc tin rng ng ra ca mng ANFIS tuyn tnh theo thng s mnh kt lun v phi
tuyn theo thng s mnh iu kin.V d,ng ra ca mng ANFIS hnh 3.25 c tnh
bi biu thc :
y w 1b 01 w 1b 11 x 1 w 1b 2 x 2 w 2 b 02 w 2 b 12 x 2 w 2 b 22 x 2 (3.81)
1
R rng y tuyn tnh theo cc thng s (b01,b11,b21,b02,b12,b22) mnh kt lun.Gi L,N
l ln lt hai vector ct cha tt c cc thng s tuyn tnh v phi tuyn,tng qut ng ra ca
mng ANFIS c th vit di dng
y=F(x ,N,L)=H(x ,N)L
Thut ton lai hun luyn mng ANFIS l s kt hp thut ton suy gim dc cp nht cc
thng s phi tuyn N v thut ton bnh phng ti thiu tuyn tnh c lng thng s
tuyn tnh L .
Thut ton lai hun luyn mng ANFIS c tm tt nh sau :
Thut ton 3.6 : Thut ton lai hun luyn mng ANFIS
Cho tp d liu vo-ra dng hun luyn gm K mu
({x(1),d(1)),(x(2),d(2)),(x(K),d(K)).
(3.83)

Bc 1: Chn tc hc >0, chn sai s cc i Emax

Bc 2: Khi ng:
- Gn sai s E = 0.
- Gn bin chy k = 1.
- Gn cc gi tr ban u cho thng s phi tuyn N(0)
Bc 3: c lng thng s tuyn tnh dng thut tan bnh phng ti thiu

d ( k ) H( x ( k ), N (0)) L (0)

k 1

min

L H ( x (k ), N (0)).H ( x (k ), N (0))
k 1

k 1

T
H ( x (k ), N (0)).d (k )

Bc 4: Cp nht trng s phi tuyndng thut tan suy gim dc:

Vi k =1 : K
- Tnh sai s :
E(k )

1
[d ( k ) H( x ( k ), N ) L ]2
2

- Cp nht thng s :
N (k ) N (k 1)

E ( k )
N

- Tnh sai s tch ly :

E = E + E(k)
Bc 5: Kt thc mt chu k hun luyn
- Nu E < Emax th kt thc qu trnh hc.
- Nu E E max th gn E = 0, k = 1 v tr li bc 3 bt u mt chu k
hun luyn mi.

3.8 Tm tt
Chng 3 trnh by m hnh ton hc n gin ca t bo thn
kinh v cc cu hnh mng. Mng truyn thng nhiu lp MLP, mng hm
c s xuyn tm RBF, mng suy din m thch nghi ANFIS vi cc thut
ton hun luyn tng ng u l c tnh cht xp x tng qut, c kh nng
xp x hm phi tuyn bt k vi sai s b ty .Nh tnh cht ny m mng
thn kinh c th s dng rt hiu qu trong cc thut tan nhn dng h
thng , iu khin da vo m hnh hoc iu khin thch nghi .ng dng
mng thn kinh trong lnh vc iu khin s c trnh by trong cc
chng sau .