MANG NRON

Bai 5: Quy tc hoc lin kt

B mn Khoa hoc may tinh Bin soan: TS Nguyn Vit Hung

Mang Nron - Quy tc hoc lin kt

Ni dung bai hoc

1. Mang lin kt n gin. 2. Quy tc Hebb khng gim st. 3. Mang nhn dang n gin. 4. Cc quy tc hnh sao. 5. Mang ti hin n gin

Mang Nron - Quy tc hoc lin kt

Mang lin kt n gin

p = 1 c kch thch a = 1 c ap ng p = 0 khng kch thch a = 0 khng ap ng w > b => mang ap ng kch thch
Mang Nron - Quy tc hoc lin kt 3

Mang lin kt: Nhn dang chui

Mi v Hnh dng chui

Hnh dng

Chui ?

Mi chui

p0 = 1 kch thch c iu kin p = 1 c mi chui p0 = 0 kch thch khng iu kin p = 0 khng c mi w0 = 1, w = 0 => mang lun nhn dang c chui d c mi hay khng Mang Nron - Quy tc hoc lin kt 4

Lut Hebb khng gim st

V d nh Heeb: Nu kch thch mi qu chui xut hin ng thi vi mt ap ng khi nim chui (kch hoat bi mt s kch thch khc nh nhn thy hnh dang), mang nn tng cng kt ni gia chng sao cho sau ny n c th kch hoat khi nim chui ch ap ng ring mi mi v chui Lut Hebb khng gim st ch tng trong s wij gia u vo ca nron pj v u ra ai mt phn tch ca chng:

Dang vector: Vi cc lut khng gim st, lut hoc c thc hin theo ap ng cho mt chui cc u vo th hin theo thi gian (dy hun luyn):

Mang Nron - Quy tc hoc lin kt

V d: Nhn dang chui

- B giao tip c bt u vi cc gi tr trong s xc nh sao cho n ap ng khi u l nhn thy m cha ngi thy qu chui:

- Dy hun luyn s gm 2 tp u vo sau lp lai nhiu ln:

-Chon h s hoc 1:
-Bc 1: (Hnh dng sai - nhn dang sai)

Mang Nron - Quy tc hoc lin kt

V d: Nhn dang chui

-Bc 2: (hnh dng ng - nhn dang ng)

-Bc 3: (Hnh dng sai, nhn dang ng)

=> Mang nhn dang ng k c khi sensor hnh dng khng lm vic
Mang Nron - Quy tc hoc lin kt 7

Lut Hebb khng gim st Cc vn

1. Trong s tng khng ngng 2. Khng c k thut gim trong s

Mang Nron - Quy tc hoc lin kt

Lut Hebb c b tr
Mt cch ci thin lut Hebb l thm s hang b tr trong s:

iu ny gi cho ma trn trong s tng khng qu mc (b chn)

Mang Nron - Quy tc hoc lin kt

Lut Hebb c b tr - V d chui

Khi tao: Bc 1:

Bc 2:

Mang Nron - Quy tc hoc lin kt

10

Lut Hebb c b tr - V d chui

Bc 3:

Lut Hebb

Lut Hebb c b tr

Mang Nron - Quy tc hoc lin kt

11

Lut Hebb c b tr Cc vn
Trong s s b mai mt nu khng c kch thch!
Nu ai=0

Nu = 0.1 phng trnh tr thnh

wij s gim 10% tai mi th hin m c ai = 0. Bt c giao tip no hoc c trc y cui cng b (qun) mt
Mang Nron - Quy tc hoc lin kt 12

Mang nhn dang n gin INSTAR

Mang Nron - Quy tc hoc lin kt

13

Mang nhn dang n gin INSTAR

Biu thc vo/ra ca Instar l:

Tc l mang c kch hoat nu,

hay trong l gc gia 2 vc t

=> INSTAR c kch hoat khi p " gn " 1w

Mang Nron - Quy tc hoc lin kt

14

Mang nhn dang n gin INSTAR

Bng cch t bias b thch hp, ta c th chon c gn cn thit ca vector u vo vi vc t trong s kch hoat INSTAR.

Nu t:
th INSTAR s ch kch hoat khi p tr v cng hng nh 1w ( = 0). Do , ta s c mt nron nhn dang ch c mu 1w. Nu t: Th INSTAR s kch hoat khi p nm trong 1 gc sai s:

Mang Nron - Quy tc hoc lin kt

15

Lut hoc ca mang INSTAR

Xt lai lut Hebb c b tr:

c c li ch ca b tr trong s, trong khi han ch vn qun lng, s dng lut INSTAR:

Cho = :
Dang vector:

Mang Nron - Quy tc hoc lin kt

16

Lut hoc ca mang INSTAR

Xt lai lut Hebb c b tr:

c c li ch ca b tr trong s, trong khi han ch vn qun lng, s dng lut INSTAR:

Cho = :
Dang vector:

Mang Nron - Quy tc hoc lin kt

17

Lut hoc ca mang INSTAR

Nu ai = 1 hay:

Nu ai = 0:
Mang Nron - Quy tc hoc lin kt 18

Lut hoc ca mang INSTAR-V D

Mang Nron - Quy tc hoc lin kt

19

Lut hoc ca mang INSTAR-V D

Khi tao:

Bc 1:

Mang Nron - Quy tc hoc lin kt

20

Lut hoc ca mang INSTAR-V D

Khi tao:

Bc 1:

Mang Nron - Quy tc hoc lin kt

21

Lut hoc ca mang INSTAR-V D

Bc 2,3:

Mang Nron - Quy tc hoc lin kt

22

Mang ti hin n gin OUTSTAR

Input
Mang Nron - Quy tc hoc lin kt 23

Mang ti hin n gin OUTSTAR

Biu thc vo/ra ca Outstar l:

Hm iu ho i xng satlims c chon bi v mang ny s c s dng goi lai mt vc t cha cc gi tr -1 hoc 1.

Nu ta mun mang lin kt mt kch thch (l mt u vo) vi mt vc t u ra c th a*, ta c th n gin t W (ch cha mt vc t ct) bng a*. Khi , nu p =1, u ra s l a*.

=> Ma trn trong s c xy dng ti hin lai vector mong mun

Mang Nron - Quy tc hoc lin kt

24

Lut hoc mang OUTSTAR

K tha lut hoc INSTAR, lut OUTSTAR cng dng quy tc hoc Hebb c b tr han ch vic qun ca mang:

(Ch : lng b tr t l vi u vo pj(q) INSTAR) Cho h s b tr bng h s hoc :

ch khng phi u ra nh

Vic hoc xut hin mi khi pj 0 (thay v ai). Khi vic hoc xy ra, ct wj dch chuyn hng v vc t u ra. Dang vc t

Mang Nron - Quy tc hoc lin kt

25

Lut hoc mang OUTSTAR V D

Hnh dng Hnh dng B mt Trong lng B mt

Trong lng Da/Khng da

Mang Nron - Quy tc hoc lin kt

26

Lut hoc mang OUTSTAR V D

S o

Cc s o

Nu l da, Khng l da

Mang Nron - Quy tc hoc lin kt

27

Lut hoc mang OUTSTAR V D

Mang Nron - Quy tc hoc lin kt

28

Lut hoc mang OUTSTAR V D

Mang Nron - Quy tc hoc lin kt

29

CM N CH THEO DI!

Mang Nron - Quy tc hoc lin kt

30