Mng n-ron

Mng n-ron
Bi:
Wiki Pedia
Theo ngha sinh hc, mng n-ron l mt tp hp cc dy thn kinh kt ni vi nhau.
Ngy nay, thut ng ny cn dng ch mng n-ron nhn to, cu thnh t cc n-ron
nhn to. Do thut ng 'mng n-ron' xc nh hai khi nim phn bit:
1. Mng n-ron sinh hc l mt mng li (plexus) cc n-ron c kt ni hoc c
lin quan v mt chc nng trc thuc h thn kinh ngoi bin (peripheral
nervous system) hay h thn kinh trung ng (central nervous system). Trong
ngnh thn kinh hc (neuroscience), n thng c dng ch mt nhm nron thuc h thn kinh l i tng ca mt nghin cu khoa hc nht nh.
2. Mng n-ron nhn to c thit k m hnh mt s tnh cht ca mng nron sinh hc, tuy nhin, khc vi cc m hnh nhn thc, phn ln cc ng
dng li c bn cht k thut, .

S n gin v mt mng n-ron nhn to

Xin xem cc bi tng ng c c thng tin chi tit v mng n-ron thn kinh hay
mng n-ron nhn to. Bi ny ch tp trung vo mi quan h gia hai khi nim ny.

c im
Thng thng, mt mng n-ron bao gm mt hoc nhiu nhm cc n-ron c kt
ni vt l vi nhau hoc c lin quan vi nhau v chc nng. Mt n-ron n c th
c ni vi nhiu n-ron khc v tng s n-ron v kt ni trong mt mng c th
l mt gi tr cc k ln. Cc kt ni, gi l cc khp thn kinh (synapses), thng
ni t cc axon ti cc t bo tua gai thn kinh (dendrite), tuy c th c cc vi mch
dendrodentritic [Arbib, tr.666] v cc kt ni khc. Ngoi tn hiu in, cn c cc dng
tn hiu khc pht sinh t vic khuych tn cc cht dn truyn xung ng thn kinh
(neurotransmitter). Chng c nh hng i vi tn hiu in. Do vy, cng nh cc
mng sinh hc khc, mng n-ron v cng phc tp. Trong khi hin nay, d cha t

1/7

Mng n-ron

c mt m t chi tit no v h thn kinh , ngi ta vn ngy cng hiu r hn v cc

c ch c bn.
Tr tu nhn to v M hnh nhn thc (cognitive modelling) c gng gi lp mt s tnh
cht ca mng n-ron. Tuy cc k thut ca hai ngnh l tng t, Tr tu nhn to c
mc tiu gii quyt cc bi ton c th, trong khi ngnh kia hng ti vic xy dng cc
m hnh ton hc ca cc h thn kinh sinh hc.
Trong ngnh Tr tu nhn to, mng n-ron c p dng thnh cng trong cc lnh
vc nhn dng ting ni, x l nh v iu khin thch nghi, xy dng cc agent phn
mm (software agent) (trong tr chi in t v my tnh) hoc robot t hnh. Hu ht
cc mng n-ron nhn to hin c dng cho tr tu nhn to u da trn l thuyt
iu khin, ti u ha, v c lng thng k.
Ngnh M hnh nhn thc nghin cu m hnh ton hc hoc vt l ca hot ng ca
h thn kinh; t mc n-ron (v d, m hnh cung phn x thn kinh ty sng i
vi kch thch), ti mc m n-ron (v d, m hnh s gii phng v tc dng ca
dopamine trong cc hch thn kinh cn bn), ri ti mc c th sng hon chnh (v d,
m hnh hnh vi phn x ca c th sng i vi kch thch).

B no, mng n-ron v my tnh

Trong lch s, b no tng c xem l mt dng my tnh, v ngc li. Tuy nhin,
iu ny ch ng theo ngha rng nht. My tnh khng phi l m hnh ca b no
(mc d c th m t mt qu trnh suy lun logic nh l mt chng trnh my tnh,
hoc c th kch thch no bng mt ci my tnh) do chng khng c ch to vi
mc ch ny.
Tuy nhin, t xa, cc mng n-ron dng trong tr tu nhn to c xem l cc m
hnh n gin ca hot ng thn kinh trong no. Mt ch ca cc nghin cu hin
nay trong ngnh thn kinh hc l thuyt l cu hi: mng n-ron cn phc tp n u
v cn c nhng tnh cht g c th ti to ci g ging nh tr thng minh ng
vt.

Mng n-ron v Tr tu nhn to

Nn tng
Cc m hnh mng n-ron trong tr tu nhn to thng c gi l cc mng n-ron
nhn to; chng thc cht l cc m hnh ton hc n gin nh ngha mt hm f : X
->Y. T mng c s dng v hm ny phn r c thnh cc thnh phn n gin
hn kt ni vi nhau.

2/7

Mng n-ron

Mt loi m hnh mng n-ron c th tng ng vi mt lp hm nh vy. Kh nng

hc l iu thu ht nhiu quan tm nht ti mng n-ron.
Cho trc mt bi ton c th gii quyt, v mt lp cc hm F, vic hc c ngha l
s dng mt tp cc quan st tm hm f^* \in F gii c bi ton mt cch tt nht.
Vic i hi nh ngha mt hm chi ph C : F ->{R} sao cho, vi li gii ti u f * ,

Hm chi ph C l mt khi nim quan trng trong hc my, do n l mt php o khong

cch ti li gii ti u cho bi ton cn gii quyt. Cc thut ton hc tm kim trong
khng gian li gii c mt hm c chi ph nh nht c th.
Cc loi hc
C ba kiu hc chnh, mi kiu mu tng ng vi mt nhim v hc tru tng. l
hc c gim st, hc khng c gim st v hc tng cng. Thng thng, loi kin trc
mng no cng c th dng c cho cc nhim v trn.
Hc c gim st
Trong hc c gim st, ta c cho trc mt tp v d gm cc cp

v mc tiu l tm mt hm f (trong lp cc hm c php) khp vi cc v d. Ni

cch khc, ta mun tm nh x m d liu u vo hm , vi hm chi ph o
khng khp gia nh x ca ta v d liu.
Hc khng c gim st
Trong hc khng c gim st, ta c cho trc mt s d liu x, v hm chi ph cn
c cc tiu ha c th l mt hm bt k ca d liu x v u ra ca mng, f. Hm
chi ph c quyt nh bi pht biu ca bi ton. Phn ln ng dng nm trong vng
cc bi ton c lng nh m hnh ha thng k, nn, lc (filtering), blind source
seperation v phn mnh (clustering).
Hc tng cng
Trong hc tng cng, d liu x thng khng c cho trc m c to ra trong
qu trnh mt agent tng tc vi mi trng. Ti mi thi im t, agent thc hin hnh
ng yt v mi trng to mt quan st xt v mt chi ph tc thi ct, theo mt quy trnh

3/7

Mng n-ron

ng no (thng l khng c bit). Mc tiu l tm mt sch lc la chn hnh

ng cc tiu ha mt chi ph di hn no , ngha l chi ph tch ly mong i. Quy
trnh ng ca mi trng v chi ph di hn cho mi sch lc thng khng c bit,
nhng c th c lng c. Mng n-ron nhn to thng c dng trong hc tng
cng nh l mt phn ca thut ton ton cc. Cc bi ton thng c gii quyt
bng hc tng cng l cc bi ton iu khin, tr chi, v cc nhim v quyt nh
tun t (sequential decision making) khc.
Cc thut ton hc
C nhiu thut ton c th dng cho vic hun luyn cc m hnh mng n-ron; hu ht
c th c xem l p dng trc tip ca l thuyt ti u ha v c lng thng k
Phn ln cc thut ton hun luyn mng n-ron s dng mt kiu xung dc (gradient
descent - tin dn ti cc tiu a phng) no . iu ny c thc hin bng cch
ly o hm ca hm chi ph theo cc tham s ca mng v thay i cc tham s theo
mt hng c tnh ton theo dc (gradient-related direction) tin dn ti cc
tiu a phng ca hm chi ph.
Cc phng php thng dng cho hun luyn mng n-ron l: phng php tin ha,
gii thut luyn kim (simulated annealing), expectation maximisation (cc i ha k
vng) v cc phng php khng tham s (non-parametric methods). Xem thm bi Hc
my.
Cc tnh cht l thuyt
Nng lc
Mt s m hnh l thuyt ca mng n-ron c phn tch tnh ton mt s tnh
cht, chng hn kh nng lu tr ti a, c lp vi cc thut ton hc. Nhiu k thut
ban u c pht trin nghin cu cc h t trng nhiu (disordered magnetic
systems (spin glasses)) c p dng thnh cng cho cc kin trc mng n-ron
n gin, chng hn mng perceptron. Cng trnh nghin cu c nh hng ln ca E.
Gardner v B. Derrida cho thy nhiu tnh cht th v v cc perceptron vi cc trng
s c gi tr l s thc, trong khi nghin cu sau ny ca W. Krauth v M. Mezard
m rng cc nguyn l ny cho cc trng s c gi tr 0 hoc 1.
Cc loi mng n-ron nhn to
Perceptron mt lp
Perceptron nhiu lp
Mng bn knh-tm
4/7

Mng n-ron

Support vector machines

Committee machines
Bn t iu chnh
My thng k
Xem bi mng n-ron nhn to c thng tin v nhiu dng mng n-ron.

Mng n-ron v ngnh thn kinh hc

Thn kinh hc l thuyt v tnh ton quan tm n cc phn tch l thuyt v m hnh
tnh ton ca cc h thn kinh sinh hc. Do cc h thn kinh c lin quan mt thit ti
cc qu trnh nhn thc v ng x, ngnh ny cn lin quan cht ch ti m hnh ha
hnh vi v nhn thc.
Mc tiu ca ngnh l xy dng m hnh ca cc h thn kinh sinh hc tm hiu c
ch hot ng ca cc h thng sinh hc. t c hiu bit ny, cc nh thn kinh
hc c gng xy dng mt mi lin h gia d liu v cc qu trnh sinh hc quan st
c, cc c ch sinh hc cho x l thn kinh vi vic hc (cc m hnh mng n-ron
sinh hc) v l thuyt (l thuyt hc bng thng k v l thuyt thng tin).
Cc loi m hnh
Ngnh thn kinh hc s dng nhiu m hnh ti nhiu mc tru tng khc nhau v
m hnh cc kha cnh khc nhau ca cc h thn kinh. T cc m hnh hnh vi ngn
hn ca tng n-ron, qua cc m hnh pht sinh ng lc cho cc mch n-ron t tng
tc gia cc n-ron c th, ti cc m hnh pht sinh ng x t cc m un thn kinh
tru tng i din cho cc h thng con hon chnh. Cc m hnh ny cn bao gm cc
m hnh v plasticity ngn hn v di hn ca cc h thn kinh v mi lin quan ca n
ti vic hc v ghi nh, t mc mt n-ron ti mc h thng.
Cc nghin cu hin nay
Trong khi hu ht cc nghin cu ban u quan tm n cc tnh cht v in ca cc
n-ron, mt phn c bit quan trng trong cc nghin cu gn y l s tm hiu vai tr
ca cc neuromodulators chng hn dopamine, acetylcholine, v serotonin i vi hnh
vi v hc tp.

5/7

Mng n-ron

Tham kho
Peter Dayan, L.F. Abbott ({{{Year}}}). Theoretical Neuroscience. MIT Press.
{{{ID}}}.
Wulfram Gerstner, Werner Kistler ({{{Year}}}). Spiking Neuron
Models:Single Neurons, Populations, Plasticity. Cambridge University Press.
{{{ID}}}.

Lch s khi nim mng n-ron

Khi nim mng n-ron c bt u vo cui thp k 1800 khi ngi ta c gng m
t hot ng ca tr tu con ngi. tng ny bt u c p dng cho cc m hnh
tnh ton t mng Perceptron.
u thp k 1950 Friedrich Hayek l ngi u tin khng nh tng v trt t t
pht trong no xut pht t cc mng phn tn gm cc n v n gin (n-ron). Cui
thp k 1940, Donnald Hebb a ra gi thuyt u tin v mt c ch thn kinh mm
do (neural plasticity), Hebbian learning (???). Hebbian learning c coi l mt quy
tc 'in hnh' ca hc khng c gim st. N (v cc bin th) l m hnh thi k u
ca long term potentiation (to tim lc di hn).
Perceptron l mt b phn loi tuyn tnh dnh cho vic phn loi d liu x \in R^n xc
nh bng cc tham s w \in R^n, b \in R v mt hm u ra f = w'x + b. Cc tham s
ca n c thch nghi vi mt quy tc ty bin (ad-hoc) tng t vi xung dc ngu
nhin (stochastic steepest gradient descent). Perceptron ch c th phn loi hon ho
mt tp d liu m cc lp khc nhau l phn tch tuyn tnh (linearly separable) trong
khng gian u vo. N thng tht bi hon ton i vi d liu khng chia tch c.
S pht trin ca thut ton ny ban u to ra mt s hng khi, phn v mi quan
h ca n i vi cc c ch sinh hc. Sau ny, pht hin v im yu ny lm cho
cc m hnh Perceptron b b mc cho n khi cc m hnh phi tuyn c a ra.
Cognitron (1975) l mt mng n-ron a tng thi k u vi mt thut ton hun luyn.
Cc chin lc thn kinh khc nhau s khc nhau v cu trc thc s ca mng v cc
phng php thit lp trng s cho cc kt ni. Mi dng c cc u im v nhc im
ring. Mng c th lan truyn thng tin ch theo mt hng, hoc thng tin c th c
y i y li cho n khi ti mt nt xut hin s t kch hot v mng s dng ti mt
trng thi kt thc. Kh nng truyn d liu hai chiu gia cc n-ron/nt cn c s
dng trong mng Hopfield (1982), v s chuyn ha cc tng nt ny cho cc mc ch
c th c a ra trong mng n-ron lai (hybrid neural network) u tin.
Gia thp k 1980, x l phn tn song song (parallel distributed processing) tr nn
mt ch thu ht c nhiu quan tm di ci tn connectionism.

6/7

Mng n-ron

Mng truyn ngc (backpropagation) c l l nguyn nhn chnh ca s ti xut ca

mng n-ron t khi cng trnh "Learning Internal Representations by Error Propagation"
(hc cc biu din bn trong bng cch lan truyn li) c xut bn nm 1986. Mng
truyn ngc ban u s dng nhiu tng, mi tng gm cc n v tng-trng-s c
dng f = g(w'x + b), trong g l mt hm sigmoid. Hun luyn c thc hin theo
kiu xung dc ngu nhin. Vic s dng quy tc tnh nguyn hm cho hm hp (chain
rule) khi tnh ton cc thay i thch hp cho cc tham s dn n mt thut ton c v
'truyn ngc li'. l ngun gc ca thut ng truyn ngc. Tuy nhin, v bn cht,
y ch l mt dng xung dc. Vic xc nh cc tham s ti u cho mt m hnh thuc
dng ny khng n gin, khng th da vo cc phng php xung dc c c
li gii tt m khng cn mt xut pht im tt. Ngy nay, cc mng c cng kin trc
vi mng truyn ngc c gi l cc mng Perceptron a tng. Thut ng ny khng
hm bt c gii hn no i vi loi thut ton dng cho vic hc.
Mng truyn ngc to ra nhiu hng khi v c nhiu tranh ci v chuyn quy
trnh hc c th c thc hin trong b no hay khng. Mt phn v khi cha tm
ra c ch truyn tn hiu ngc. Nhng l do quan trng nht l cha c mt ngun tn
hiu 'dy' hay tn hiu 'ch' ng tin cy.
Ngy nay, cc nh thn kinh hc thnh cng trong vic tm ra mi lin h gia hc
tng cng v h thng hng thng dopamine (dopamine system of reward). Tuy
nhin, vai tr ca n v cc neuromodulator khc vn ang c nghin cu.

7/7