Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

Mng n-ron nhn to

1. Gii thiu mng n-ron
Mng neural nhn to (Artificial Neural Networks : ANN) ra i xut pht
t tng m phng hot ng ca b no con ngi.

Hnh 1.1. M hnh mng n-ron sinh hc

Mng noron nhn to l s ti to bng k thut nhng chc nng ca h

thn kinh con ngi vi v s cc neural c lin kt truyn thng vi nhau qua
mng. Ging nh con ngi, ANN c hc bi kinh nghim, lu nhng kinh
nghim v s dng trong nhng tnh hung ph hp.

Mng neural trong mt vi nm tr li y c nhiu ngi quan tm v

p dng thnh cng trong nhiu lnh vc khc nhau, nh ti chnh, y t, a cht,
vt l v cng ngh thng tin .Tht vy, bt c u c vn v d bo, phn
loi v iu khin, mng neural u c th ng dng c. V d nh kh nng
nhn dng mt ngi trong cc h thng qun l thng tin lin quan n con ngi
(qun l nhn s cc cng s, doanh nghip; qun l hc sinh, sinh vin trong cc
trng trung hc, i hc v cao ng; ); cc ngnh khoa hc hnh s, ti phm;
khoa hc tng s, t vi; hoc cc tr chi cng nh pht trin th h robot thng
minh bit suy ngh nh con ngi.

Mng n-ron nhn to da trn vic m phng cp thp h thng neural sinh
hc. Trong tng lai vi s pht trin m phng n-ron sinh hc, chng ta c th c
loi my tnh thng minh tht s. Nu so snh my tnh v b no con ngi th
chng ta c th thy mng n-ron nhn to mnh hn rt nhiu so vi chng ta.
My tnh c th cha 109 transitor vi thi gian chuyn mch l 10-9 (s), trong khi
b no con ngi c 1011 n-ron v thi gian chuyn mch ca con ngi l
10-3 (s).

Tuy nhin, s so snh ny rt khp khing v n gin chng ta cn cha

khm ph ht kh nng ca no b con ngi. Mc d vy chng ta c th thy, nu

1
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

tr tu nhn to thc s t c mc pht trin cao v tim cn vi tr tu con

ngi th c l khi n s c rt nhiu ng dng v thc y s pht trin ca loi
ngi. Chng th m ng hong vt l Stephen Hawking cnh bo, robot c
th pht trin nhanh hn so vi con ngi v mc tiu ca chng s khng th on
trc c. Gio s chia s: Ti khng cho rng nhng tin b trong tr tu nhn
to l mt s an ton trong tng lai, v chng c th s e da tng lai ca loi
ngi chng ta. Mt khi t n mc no , chng ta s khng th d on
c mc tiu cng nh kh lng c th kim sot c chng.

ng ni thm: Tr thng minh nhn to c tim nng pht trin nhanh

hn so vi cc chng tc ca con ngi. Do , ta cn m bo AI c thit k c
o c v c bin php bo v, kim sot nghim ngt ti ch.

Hnh 1.2. Mt hnh nh v tr tu nhn to bc cao trong b phim gi tng Siu

tr tu

2. M hnh ca mt n-ron nhn to

2.1. Cu to ca n-ron sinh hc

Sau y l nhng thnh phn chnh trong cu trc ca mt n-ron trong b
no con ngi

2
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

Hnh 2.1. M hnh n-ron sinh hc

Trong :

Cc Soma l thn ca noron.

Cc dendrites l cc dy mnh, di, gn lin vi soma, chng truyn d liu
(di dng xung in th) n cho soma x l. Bn trong soma cc d liu
c tng hp li. C th xem gn ng s tng hp y nh l mt php ly
tng tt c cc d liu m nron nhn c.
Mt loi dy dn tn hiu khc cng gn vi soma l cc axon. Khc vi
dendrites, axons c kh nng pht cc xung in th, chng l cc dy dn tn
hiu t nron i cc ni khc. Ch khi no in th trong soma vt qu mt gi
tr ngng no (threshold) th axon mi pht mt xung in th, cn nu
khng th n trng thi ngh.
Axon ni vi cc dendrites ca cc nron khc thng qua nhng mi ni c
bit gi l synapse. Khi in th ca synapse tng ln do cc xung pht ra t
axon th synapse s nh ra mt s cht ho hc (neurotransmitters); cc cht ny
m "ca" trn dendrites cho cc ions truyn qua. Chnh dng ions ny lm
thay i in th trn dendrites, to ra cc xung d liu lan truyn ti cc nron
khc.
C th tm tt hot ng ca mt nron nh sau: nron ly tng tt c cc in
th vo m n nhn c, v pht ra mt xung in th nu tng y ln hn mt
ngng no . Cc nron ni vi nhau cc synapses. Synapse c gi l
mnh khi n cho php truyn dn d dng tn hiu qua cc nron khc. Ngc
li, mt synapse yu s truyn dn tn hiu rt kh khn.

Cc synapses ng vai tr rt quan trng trong s hc tp. Khi chng ta hc tp

th hot ng ca cc synapses c tng cng, to nn nhiu lin kt mnh gia
cc nron.

3
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

C th ni rng ngi no hc cng gii th cng c nhiu synapses v cc

synapses y cng mnh m, hay ni cch khc, th lin kt gia cc nron cng
nhiu, cng nhy bn.

2.2. Cu to ca n-ron nhn to

m phng cc t bo thn kinh v cc khp ni thn kinh ca b no con ngi,
trong mng n-ron nhn to cng c cc thnh phn c vai tr tng t l cc n-ron nhn
to v kt ni gia chng( kt ni ny gi l weights).

N-ron l mt n v tnh ton c nhiu u vo v mt u ra, mi u vo n t

mt syanpse. c trng ca neuron l mt hm kch hot phi tuyn chuyn i mt t hp
tuyn tnh ca tt c cc tn hiu u vo thnh tn hiu u ra.
Mt n-ron nhn to l mt n v tnh ton hay n v x l thng tin c s cho hot ng
ca mt mng n-ron . S khi ca hnh 1.1 ch ra m hnh ca mt n-ron nhn to.

Hnh 2.2. M hnh ca mt n-ron nhn to

y, chng ta xc nh ba thnh phn c bn ca mt neuron :

- Mt tp hp cc weights hay cc kt ni, m mi mt trong chng c c trng
bi mt trng s ca ring n. Tc l mt tn hiu xj ti u vo ca weights j ni vi
neuron k s c nhn vi trng s weights wkj. k l ch s ca neuron ti u ra ca
weights ang xt, cn j ch im u vo ca weights. Cc trng s weights cu mt
neuron nhn to c th nhn c cc gi tr m v cc gi tr dng.
- Mt b cng tnh tng cc tn hiu u vo ca neuron, c nhn vi cc
trng s weights tng ng; php ton c m t y to nn mt b t hp tuyn tnh.
Mt hm kch hot (activation function) gii hn bin u ra ca neuron. Hm kch
hot cng c xem xt nh l mt hm nn; n nn (gii hn) phm vi bin cho php
ca tn hiu u ra trong mt khong gi tr hu hn. M hnh mt neuron trong hnh 2.2
cn bao gm mt h s hiu chnh tc ng t bn ngoi, bk. H s hiu chnh bk c tc
dng tng ln hoc gim i u vo thc ca hm kch hot, tu theo n dng hay m. C
nhiu loi hm kch hot.

4
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

- Di dng cng thc ton hc, chng ta c th m t mt neuron k bng cp cng

thc sau:
m
uk w
j0
x
kj j (2.1)

v
yk=f(uk+bk) (2.2)
trong x1,x2,...,xm l cc tn hiu u vo; wk1,wk2,...,wkm l cc trng s weights
ca neuron k; uk l u ra b t hp tuyn tnh tng ng; bk l h s hiu chnh.
H s hiu chnh bk l mt tham s ngoi ca neuron nhn to k. Chng ta c
th thy c s c mt ca n trong cng thc (2.2). Mt cch tng ng,
chng ta c th t hp cc cng thc (2.1) v (2.2) nh sau:
m
e k wkj x j (2.3)
j 0

v
y k f (v k ) (2.4)
Trong cng thc (2.3), chng ta thm mt weights mi. u vo ca n l:
x0=+1 (2.5)
v trng s ca n l
wk0=bk (2.6)
Nh vy chng ta v li m hnh ca neuron k nh trong hnh 2.3. Trong hnh
ny, nhim v ca h s hiu chnh l thc hin hai vic: (1) thm mt tn hiu
u vo c nh l 1, v (2) thm mt trng s weights mi bng gi tr ca h
s bk. Mc du cc m hnh trong hnh 2.2 v 2.3 l khc nhau v hnh thc
nhng tng t v bn cht ton hc.

Hnh 2.3. M hnh phi tuyn th hai ca mt neuron

5
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

3. Cc kiu hm kch hot

Hm kch hot, k hiu bi f(v), xc nh u ra ca neuron. Di y l cc kiu
hm kch hot c bn:

3.1. Hm ngng
i vi loi hm ny (m t trong hnh 2.4.a), chng ta c

(3.1)
Trong cc ti liu k thut, dng hm ngng ny thng c gi l hm Heaviside. u
ra ca neuron k s dng hm ngng s nh sau
1 nu v k 0
yk (3.2)
0 nu v k 0
vk l u ra ca b t hp tuyn tnh, c ngha l
m
vk wkj x j bk (3.3)
j 1

Mt n-ron nh vy thng c gi l m hnh McCulloch-Pitts.

Hnh 3.1. (a) Hm ngng, (b) Hm vng tuyn tnh

(c) Hm sigma vi tham s dc a thay i

6
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

3.2. Hm vng tuyn tnh

i vi loi hm ny (m t trong hnh 3.1.b), chng ta c

(3.4)
Dng hm ny c th c xem nh mt xp x ca mt b khuch i phi tuyn.

3.3. Hm sigma
Hm sigma l dng chung nht ca hm kch hot c s dng trong cu trc
mng neuron nhn to. N l mt hm tng v n th hin mt s trung gian gia tuyn
tnh v phi tuyn. Mt v d ca hm ny l hm logistics, xc nh nh sau:

(3.5)
a l tham s dc ca hm sigma. Bng vic bin i tham s a, chng ta thu c
cc hm sigma vi cc dc khc nhau, nh c minh ho trong hnh 3.1.c. Thc t, h
s gc ti v=0 l a/4. Khi tham s h s gc tin ti khng xc nh, hm sigma tr thnh
mt hm ngng n gin. Trong khi mt hm ngng ch c gi tr l 0 hoc 1, th mt
hm sigma nhn cc gi tr t 0 ti 1. Cng phi ghi nhn rng hm sigma l hm phn
bit, trong khi hm ngng th khng (tnh phn bit ca hm l mt c tnh quan trng
trong l thuyt mng neuron).
Cc hm kch hot c nh ngha trong cc cng thc (3.1), (3.4), (3.5) u trong
phm vi t 0 n 1. i khi c nhng yu cu xy dng hm kch hot trong phm vi t -1
n 1, trong trng hp ny hm kch hot c gi nh c dng i xng qua gc to
(hay c th gi l dng phn i xng); ngha l hm kch hot l mt hm l. V d, hm
ngng trong cng thc (3.1) by gi c xc nh nh sau
1 v0

f (v ) 0 v0 (3.6)
1 v0

Hm ny thng c gi l hm signum.

4.Cc loi mng n-ron

C hai loi mng n-ron chnh l cc mng tin (feedforward) v cc mng
phn hi (trong ti liu ny khng ni ti mng phn hi) ch ni n cc mng tin
(feedforward). Trong mng tin, cc n-ron to thnh nhm trong cc lp, tn hiu truyn

7
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

t lp input n lp ouput. Cc n-ron khng cng lp th ni vi nhau nhng cc n-ron

cng lp th khng ni vi nhau. Trong mng tin c hai loi mng l mng tin a
mc (multilayer) v mng tin n mc (singlelayer).

Hnh 4.1. Mng n-ron n mc

Hnh 4.2. Mng n-ron a mc

8
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

5. M phng trong Matlab

Chng trnh 1. M phng mt n-rong trong Matlab

close all, clear all, clc, format compact

% Trng s
w = [4 -2]
% Bias
b = -3
% Activation function
func = 'tansig'
% func = 'purelin'
% func = 'hardlim'
% func = 'logsig'
p = [2 3]
activation_potential = p*w'+b
neuron_output = feval(func, activation_potential)

Chng trnh 2. Quan st u ra ca mng n-ron vi cc gi tr u vo khc nhau

[p1,p2] = meshgrid(-10:.25:10);
z = feval(func, [p1(:) p2(:)]*w'+b );
z = reshape(z,length(p1),length(p2));
plot3(p1,p2,z)
grid on
xlabel('Input 1')
ylabel('Input 2')
zlabel('Neuron output')

Hnh 5.1. th ca u ra

9
Ti liu Mng N-ron nhn to Bn quyn Matlabthayhai.info Kin thc l ca chung Hy chia s!

Cn tip..
Ghi ch
Ti liu c tham kho t nhiu ngun khc nhau v t kin thc ca chnh tc
gi. Mong cc bn s c nhng kin thc b ch v ti liu h tr qu trnh hc tp cng
nh nghin cu. Cm sao chp di mi hnh thc !

Website : Matlabthayhai.info

Email : Matlabthayhai@gmail.com

Kin thc l ca chung Hy chia s !

10