TTNT4

1
Chng 4: My hc
Gii thiu v my hc
My hc v vai tr ca my hc.
Cc thut ton my hc.
Mng n ron nhn to.
Cc phng php tin ha.
Tr tu nhn to Lu hnh ni b
2
Gii thiu
Mt s phng php my hc tip thu tri thc
hay to ra tri thc
Hc vt
Hc cch xut
Hc bng cch thu thp cc trng hp
Hc bng cch xy dng cy nh danh
Hc khng gim gim st v bi tm gom
nhm d liu
Hc gim st v bi ton phn lp d liu
3
Gii thiu (tt)
Hc vt
- H thng tip nhn cc khng nh ca cc quyt nh ng.
Khi h thng to ra mt quyt nh khng ng, h thng s
a ra cc lut hay quan h ng m h thng s dng.
- Hnh thc hc vt nhm cho php chuyn gia cung cp tri thc
theo kiu tng tc.
Hc bng cch ch dn
- Thay v a ra mt lut c th cn p dng vo tnh hung cho
trc, h thng s c cung cp bng cc ch dn tng qut.
V d: Gas hu nh b thot ra t van thay v thot ra t ng
dn.
- H thng phi t mnh ra cch bin i t tru tng n
cc lut kh dng.
4
Gii thiu(tt)
Hc bng qui np
- H thng c cung cp mt tp cc v d v kt
lun c rt ra t tng v d.
- H thng lin tc lc cc lut v quan h nhm x l
tng v d mi.
Hc bng tng t
- H thng c cung cp p ng ng cho cc tc
v tng t nhng khng ging nhau.
- H thng cn lm thch ng p ng trc nhm
to ra mt lut mi c kh nng p dng cho tnh
hung mi.
5
Gii thiu (tt)
Hc da trn gii thch
- H thng phn tch tp cc li gii v d (v kt qu) nhm n
nh kh nng ng hoc sai v to ra cc gii thch dng
hng dn cch gii bi ton trong tng lai.
Hc da trn tnh hung
- By k tnh hung no c h thng lp lun u c lu
tr cng vi kt qu cho d ng hay sai. Khi gp tnh hung
mi, h thng s lm thch nghi hnh vi lu tr vi tnh
hung .
Khm ph hay hc khng gim st
- Thay v c mc tiu tng minh, h thng khm ph lin tc tm
kim cc mu v quan h trong d liu nhp. Cc v d v hc
khng gim st bao gm gom cm d liu, hc nhn dng
cc c tnh c bn nh cnh t cc im nh.
6
Mt s v d
Hc qua logic:
Bongard (1970) l ngi u tin ng dng
cc ton t logic hc v nhn dng cc
i tng hnh nh.
tng: Tm quan h n gin nht trong s
cc quan h c th s dng hc v nhn
dng cc hnh nh.
7
2. Mt s v d (tt)
Chng ta c th quan st thy cc hnh v thuc lp A c 3
vng trng lun lun nm trn mt ng thng.
Lp A Lp B
8
2. Mt s v d (tt)
Vn t ra: Tm quan h n gin nht c th phn bit c
cc hnh nh.
Bongard dng bng logic m t quan h dn
xut ra cc mnh logic:

| c th dng phn bit 2 lp E v E nu |(E) v |(E)
i ngu nhau.
) ...
2 1
(
n
. . . v =
9
Mt s v d (tt)

P
1
P
2
P
3
P
4
P
5
10
Mt s v d (tt)
Cc i tng trong mu:
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
5 4 3 2 1
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
P P P P P
0 0 0 1 1 10
0 1 0 0 0 9
0 1 0 0 1 8
0 0 0 1 1 7
0 1 0 1 1 6
0 1 0 1 0 5
1 0 0 1 0 4
1 0 0 1 0 3
0 1 0 0 1 2
0 1 1 1 1 1
P P P P P
11
Mt s v d (tt)
Sau khi tnh tng v rt gn li c:
) P . P P . P .( P P . P
3 2 3 2 1 2 1
+ +
e
3 2 1
3 2 1
2 1
P . P . P
P . P . P
P . P
) A ( x
12
HC BNG CCH XY DNG
CY NH DANH
Cy nh danh: L mt dng ca cy quyt nh, trong
mi tp cc kt lun c th xy ra c thit lp mt cch
ngm nh bi mt danh sch cc mu m chng c
phn vo mt lp bit.

Bang dlieu Cay nh danh Luat
Th Xay dng
13
V d c bng d liu quan st
Tn Tc Ch.Cao Cn Nng Dng kem? Kt qu
Sarah Vng T.Bnh Nh Khng Chy
Dana Vng Cao T.Bnh C Khng
Alex Nu Thp T.Bnh C Khng
Annie Vng Thp T.Bnh Khng Chy
Emilie T.Bnh Nng Khng Chy
Peter Nu Cao Nng Khng Khng
John Nu T.Bnh Nng Khng Khng
Kartie Vng Thp Nh C Khng
HC BNG CCH XY DNG
CY NH DANH (tt)
14
Ta gi tnh cht chy nng hay khng chy nng l
thuc tnh quan tm (thuc tnh mc tiu).
Nh vy, trong trng hp ny, tp R ca chng ta ch
gm c hai phn t {"chy nng", "bnh thng"}. Cn tp P
l tt c nhng ngi c lit k trong bng di (8 ngi).
Chng ta quan st hin tng chy nng da trn 4
thuc tnh sau : chiu cao (cao, trung bnh, thp), mu tc
(vng, nu, ) cn nng (nh, TB, nng), dng kem (c,
khng). Ta gi cc thuc tnh ny gi l thuc tnh dn xut.
HC BNG CCH XY DNG
CY NH DANH (tt)
15
m chi
16
m chi (tt)
17
Phng n chn
thuc tnh phn hoch
Vn m chng ta gp phi cng tng t
nh bi ton tm kim : "ng trc mt ng r,
ta cn phi i vo hng no?".
Hai phng php nh gi di y s gip
ta chn c thuc tnh phn hoch ti mi
bc xy dng cy nh danh.
18
Thut ton Quinlan
Quinlan quyt nh thuc tnh phn hoch bng cch xy
dng cc vector c trng cho mi gi tr ca tng thuc
tnh dn xut v thuc tnh mc tiu.
Cho mt bng quan st l tp hp cc mu vi cc thuc
tnh nht nh ca cc i tng no .
S dng mt o nh lng v ra mt tiu chun
nhm chn la mt thuc tnh mang tnh cht phn loi
phn bng ny thnh cc bng con nh hn sao cho t
mi bng con ny d dng phn tch tm ra quy lut chung .
19
Thut ton Quinlan
vang toc co sat quan so Tong
vang toc co nang chay sat quan so Tong
vang toc co sat quan so Tong
vang toc co nang chay g sat khon quan so Tong
Khng chy nng =
Chy nng =
20
VTc (vng) = (chy nng, khng chy nng)
S ngi tc vng l : 4
S ngi tc vng v chy nng l : 2
S ngi tc vng v khng chy nng l : 2
Do
VTc(vng) = (2/4 , 2/4) = (0.5, 0.5)
Tng t
VTc(nu) = (0/3, 3/3) = (0,1) (vector n v)
VTc() = (1/1, 0/1) = (1,0) (vector n v)
Tng s vector n v ca thuc tnh tc l 2
Thut ton Quinlan(tt)
21
Thut ton Quinlan (tt)
Cc thuc tnh khc c tnh tng t, kt qu nh sau :
VC.Cao(Cao) = (0/2,2/2) = (0,1)
VC.Cao(T.B) = (2/3,1/3)
VC.Cao(Thp) = (1/3,2/3)

VC.Nng (Nh) = (1/2,1/2)
VC.Nng (T.B) = (1/3,2/3)
VC.Nng (Nng) = (1/3,2/3)

VKem (C) = (3/3,0/3) = (1,0)
VKem (Khng) = (3/5,2/5)
Nh vy thuc tnh mu tc c s vector n v nhiu nht nn s c
chn phn hoch.
22
Sau khi phn hoch theo mu tc xong, ch c phn hoch theo tc vng
(Pvng) l cn cha nhng ngi chy nng v khng chy nng nn ta s tip tc
phn hoch tp ny. Ta s thc hin thao tc tnh vector c trng tng t i
vi cc thuc tnh cn li (chiu cao, cn nng, dng kem). Trong phn hoch
Pvng, tp d liu ca chng ta cn li l :
Tn Ch.Cao Cn Nng Dng kem? Kt qu
Sarah T.Bnh Nh Khng Chy
Dana Cao T.Bnh C Khng
Annie Thp T.Bnh Khng Chy
Kartie Thp Nh C Khng
23
Kt qu Cy nh danh cui cng :
24
Phng php o hn lon
Thay v phi xy dng cc vector c trng nh phng
php ca Quinlan, ng vi mi thuc tnh dn xut ta ch cn tnh
ra o hn lon v la chn thuc tnh no c o hn lon l
thp nht. Cng thc tnh nh sau :
trong :
b
t
l tng s phn t c trong phn hoch
b
j
l tng s phn t c thuc tnh dn xut A c gi tr j.
b
ri
: tng s phn t c thuc tnh dn xut A c gi tr j v thuc tnh mc
tiu c gi tr i.
2
( * ( *log ( )))
j
ri ri
j i t
j j
b
b b
b b b

25
V d:
STT Kch c Mu sc Hnh dng Quyt nh
1 Trung bnh Cu Mua
2 Ln Vng Hp Mua
3 Trung bnh Xanh Tr Khng mua
4 Nh Xanh Cu Mua
5 Trung bnh Xanh Nn Khng mua
6 Nh Xanh Nn Khng mua
7 Trung bnh Tr Mua
26
V d (tt)
Nh
Trung bnh
Ln
4
6
1
3
5
7
2
Kch c Mu sc
Vng
Xanh

2

1
7
3
4
5
6
Hnh dng
Cu
1
4
Hp
2
3
7
Tr
5
6
Nn
27
V d (tt)
46 . 0
4
3
log
4
3
4
1
log
4
1
7
4
0 0
2 2
~
|
.
|
\
|
+ + =
7
6
7
4
7
2
0
1
1
log
1
1
7
1
4
2
log
4
2
4
2
log
4
2
7
4
2
1
log
2
1
2
1
log
2
1
7
2
2 2 2 2 2
= + =
|
.
|
\
|
+
|
.
|
\
|
+
|
.
|
\
|
=
hn lon TB kch c:
7
2
0
2
1
log
2
1
2
1
log
2
1
7
2
0 0
2 2
= +
|
.
|
\
|
+ + =
hn lon TB mu sc:

hn lon TB hnh dng:
28
V d (tt)
Chn thuc tnh hnh dng
v c hn lon TB nh nht:
Hnh dng
Cu
Nn
Hp
Tr
Mua
Mua ?
Khng mua
29
V d (tt)
STT Kch c Mu sc Quyt nh
3 Trung bnh Xanh Khng mua
7 Trung bnh Mua
Sau khi test ln 1 xong, ta loi ra 5 mu n nh => c 1 bng nh hn:
Kch c
3
7
Trung bnh
Mu sc
Xanh
3 7
- hn lon trung bnh kch c:=1
- hn lon trung bnh mu sc:=0
30
V d (tt)
Chn thuc tnh mu sc v c hn lon TB nh nht:
Mu sc
Xanh
Mua
Khng mua
Cu
Nn
Hp
Tr
Hnh dng
Mua Mua Khng mua
Mu sc
Xanh
Mua Khng mua
Cy quyt nh:
V d: S dng cy nh danh tm cc lut phn lp
t bng quyt nh sau y:
ac iem
Ngi
Dang Chieu cao Gii tnh Thuoc chau
1 To Trung bnh Nam Chau A
2 Nho Thap Nam Chau A
3 Nho Trung bnh Nam Chau A
4 To Cao Nam Chau Au
5 Nho Trung bnh N Chau Au
6 Nho Cao Nam Chau Au
7 Nho Cao N Chau Au
8 To Trung bnh N Chau Au
Khng bnh X Khng Nhanh Khng Thng
Khng bnh X Khng Khng C Tun
Mc bnh X C Nhanh C Hoa
Mc bnh X C Khng C Lan
Khng bnh X C Khng Khng Dung
Mc bnh X C t C Chu
Mc bnh X Khng Nhanh C Bnh
Mc bnh X C Nhanh Khng An
Kt qu St v
chiu
Gim
cn
Ht
thuc l
Tn
33
Ngy Quang cnh Nhit m Gi Chi Tennis
D1 Nng Nng Cao nh Khng
D2 Nng Nng Cao Mnh Khng
D3 m u Nng Cao Nh C
D4 Ma m p Cao nh C
D5 Ma Mt TB nh C
D6 Ma Mt TB Mnh Khng
D7 m u Mt TB Mnh C
D8 Nng m p Cao nh Khng
D9 Nng Mt TB nh C
D10 Ma m p TB nh C
D11 Nng m p TB Mnh C
D12 m u m p Cao Mnh C
D13 m u Nng TB nh C
D14 Ma m p Cao Mnh khng
34
Neural Networks
Ngc li vi cc m hnh da trn k hiu: Khng ch trng
vic s dng cc k hiu mt cch tng minh gii quyt vn
.
tng da trn cc h no: Xem tr tu l s pht sinh t cc
h thng gm nhng thnh phn n gin (neuron), tng tc
vi nhau thng qua mt qu trnh hc hoc thch nghi m
cc kt ni gia cc thnh phn c iu chnh.
Gt hi rt nhiu thnh cng trong nhng nm gn y.
T ng ngha:
Tnh ton neural (neural computing)
Cc mng neural (neural networks)
Cc h kt ni (connectionist system)
Cc h x l phn tn song song (parallel distributed
processing)
35
Neuron nhn to
Thnh phn c bn ca mng neuron l mt neuron nhn to.
Cc thnh phn ca mt neuron nhn to:
Cc tn hiu vo x
i
{0,1} {1,-1} real
Cc trng s w
i
real
Mt mc kch hot
i
w
i
x
i

Mt hm ngng f :
i
w
i
x
i
tn hiu ra

36
Neural Networks
Cc thuc tnh tng qut ca mt mng l:
Hnh thi mng: mu kt ni gia (cc tng ca) cc neuron.
Gii thut hc: cch iu chnh cc trng s trong qu trnh x l
tp d liu rn luyn
C ch m ha: s thng dch ca cc tn hiu vo v tn hiu ra
I
1
I
2
I
3
H
1
H
2
O
1
w
ij
w
11
w
12
I
1
I
2
H
1 O
1
w
11
w
12
37
V d: Neuron McCulloch-Pitts
Cc neurron dng tnh cc hm logic and v or
38
Hc Perceptron
Mng neuron n tng
Cc gi tr vo 1 hoc -1
Cc trng s kiu thc
Mc kch hot
i
w
i
x
i

Hm ngng gii hn cng f : 1 if
i
w
i
x
i
>= t
-1 if
i
w
i
x
i
< t
iu chnh trng s: w
i
= c(d-f(
i
w
i
x
i
)) x
i

c: hng s ch tc hc
d: u ra mong mun
Nu kt qu thc v mong mun ging nhau, khng lm g
Nu kt qu thc l -1 v kt qu mong mun l 1 th
tng trng s ca ng th i ln 2cx
i
Nu kt qu thc l 1 v kt qu mong mun l -1
gim trng s ca ng th i xung 2cx
i
t
net =
i
w
i
x
i

f(net)
39
Phn loi ca cc h thng Hc
Hc c s hng dn (Supervised learning)
Cho h thng mt tp cc v d v mt cu tr li cho mi
v d.
Rn luyn h thng cho n khi n c th a ra cu tr
li ng cho cc v d ny.
Hc khng c s hng dn (Unsupervised learning)
Cho h thng mt tp hp cc v d v cho n t khm
ph cc mu thch hp trong cc v d.
Mng neuron s dng mt hnh thc hc
c s hng dn
40
S dng perceptron
trong bi ton phn loi
Mt h thng phn loi y
41
V d Perceptron
Cho trc: mt tp cc d liu vo
Yu cu: rn luyn perceptron sao cho n phn loi cc u vo mt
cch ng n
42
V d Perceptron: gii php
2 tn hiu vo x
1
x
2

Mt tn hiu vo th ba c s dng nh mt
thin v v c gi tr c nh bng 1,
cho php dch chuyn ng phn cch
Mc kch hot: w
1
x
1
+ w
2
x
2
+ w
3

Hm ngng: hm du, >0 = +1, <0 = -1
y l ngng gii hn cng tuyn tnh hai cc
Cc trng s: c khi to ngu nhin,
cp nht 10 ln, vi tc hc l 0.2
Kt qu: -1.3x
1
+ -1.1x
2
+ 10.9 = 0
43
Tnh tch ri tuyn tnh
(linearly seperatable)
Trong mt khng gian n chiu,
mt s phn loi mang tnh
tuyn tnh nu cc lp ca n
c th c tch ri bi mt
mt n-1 chiu.
Perceptron khng th gii
quyt cc bi ton phn loi
khng tch ri tuyn tnh.
V d: bi ton X-OR
44
Lut Delta
Tng qut ha perceptron bng cch:
1. Thay th hm ngng gii hn cng bng cc hm
kch hot khc c kh nng ly vi phn
V d: mt hm kch hot sigmoidal
f(net) = 1/(1 + e
-*net
) vi net =
i
w
i
x
i

f (net) = f(net) * (1- f(net))
2. S dng lut delta iu chnh trng s trn u
vo th k ca nt th i
w = c(d
i
O
i
) f(net
i
)x
k

= c(d
i
O
i
) O
i
(1 O
i
) x
k

f: o hm bc nht
c: tc hc
d
i
: u ra mong mun
O
i
: u ra tht s
45
Lan truyn ngc (backpropagation)
Ti cc nt ca cc mng a tng, li m mt nt phi chu
trch nhim cng phi c chia phn cho cc nt tng n
v cc trng s phi c iu chnh mt cch ph hp.
Gii thut lan truyn ngc bt u ti tng ra v truyn cc
li ngc v xuyn qua cc tng n.
Lut delta tng qut iu chnh trng s ca u vo th k
ca nt th i:
w
k
= c(d
i
O
i
) O
i
(1 O
i
) x
k
cho nt tng ra

w
k
= c
j
(delta
j
w
ij
) O
i
(1 O
i
) x
k
cho nt tng n
vi delta
j
= (d
j
O
j
) O
j
(1 O
j
)
j chy trn cc nt ca tng k tip m ti nt i truyn
cc u ra ca n.

46
47
V d mng Neuron: NETtalk
Vn : pht m vn
bn ting Anh ng
u vo: mt chui
u ra: m v v trng
m km theo cho mi
k t
Gii php:
Kt qu thc nghim:
ng 60% sau khi rn
luyn vi 500 v d (100
lt)
cng nhiu v d rn
luyn => kt qu cng
tt
48
A backpropagation net to solve the exclusive-or problem.
The W
ij
are the weights and H is the hidden node.
S dng 4 mu v d luyn tp:
(0,0) -> 0; (1,0) ->1; (0,1) -> 1; (1,1) ->0
Sau 1400 lt: W
H1
= -7.0 W
HB
= 2.6 W
O1
= -5.0
W
H2
= -7.0 W
OB
= 7.0 W
O2
= -4.0
W
HO
= -11.0
49
Cc vn lin quan khi
s dng Neural Networks
Cc mng a tng l y v mt tnh ton,
tuy nhin:
Lm sao chn s nt n v s tng n
Khi no s dng cc nt thin lch
Cch chn mt tp rn luyn
iu chnh cc trng s hay tc hc nn n.t.n?

50
Gii thut Genetic
Nm bt tng t thuyt tin ha
Hc c xem nh l s cnh tranh gia cc qun th cc gii
php kh d ang tin ha ca bi ton
Thnh phn:
Qun th cc gii php kh d
Hm nh gi
Cc php ton to con mi:
giao nhau (crossover)
t bin (mutation)
Gii thut:
iu kin kt thc: #vnglp,
Trung bnh tt ca qun th
Khi to qun th
K tha
Gi hm nh gi
Chn cc thnh vin tt
To con mi
Thay th thnh vin km bng
cc con mi
Chn gii php t qun th
N
Y
51
52
HT

TTNT4

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

TTNT4

Uploaded by

Copyright:

Available Formats

1

You might also like