You are on page 1of 47

XC THC NGI NI KHNG

PH THUC VO T KHA
(TEXT-INDEPENDENT SPEAKER VERIFICATION )
Trn Cao Trng
2
TNH CP THIT TI
Lnh vc nhn dng ngi ni c nhiu ng dng
iu khin truy nhp my tnh, thit b..
Nhn dng ti phm
Nhn thng tin phn hi...
Trn th gii c nhiu cng trnh nghin cu vn ny
nhng Vit Nam mi c rt t cng trnh nghin cu v
lnh vc ny
L hng c th m rng nghin cu

3
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

4
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

5
TRCH CHN THNG TIN T TING NI
Speech
Recognition
Language
Recognition
Speaker
Recognition
Ni dung ni
Tn ngn ng
Tn ngi ni
Bn c khe khng?
Ting Vit
Anh Trng
Tn hiu ting
ni
6
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

7
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

8
C S L THUYT
Ting ni ngoi thng tin ng ngha cn cha
cc thng tin nh trng thi tnh cm khi ni hay
nhng thng tin ring ca ging ni.
Cc thng tin ny khng bt bin t lc ngi
bit ni n lc gi, nhng c tnh kh n nh
trong giai on di ca cuc i.
Khi con ngi trng thnh, nhng thi tt
khi ni, nhng c trng khu bit trong cu m
s hnh thnh v mang tnh n nh cao.
9
PHN LOI THEO CHC NNG
Speaker Identification: Kim tra xem ging ni cn kim
tra l ca ai trong h thng
?
?
?
Tr li cu hi y l ai?
10
PHN LOI THEO CHC NNG(tip)
Speaker Verification: Xc thc xem ID ngi cn kim
tra c chnh xc l ngi hay l khng?
y c phi l ging ni ca anh Trng khng?
11
PHN LOI THEO PHNG PHP
Nhn dng ph thuc vo t kha(text-dependent)
H thng nhn bit ni dung ni ca ngi ni (mt khu)
Khng mt thi gian hun luyn
chnh xc cao. Nhng bo mt khng cao do k gi mo ghi m
t kha
Nhn dng khng ph thuc vo t kha(text-independent)
H thng khng quan tm n ni dung ni m ch quan tm n
ging ni
D liu hun liu cng nhiu chnh xc cng cao.
12
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

13
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

14
MC CH
Xc minh liu ngi ang ni c ng l ngi m my
tnh c bit trc hay khng (tnh xc tht ca
ging ni) nhng khng ph thuc vo ni dung ngi
ni.
y c phi l ging ni ca anh Trng khng?
15
HAI GIAI ON CA H THNG
Trch chn
c trng
Model
training
Ghi m ging ni ca
mi ngi
Trng
Qu
c trng ca mi
ngi ni
Quy
Truong
Hun luyn
M hnh hun
luyn
Chp nhn?
Trch chn
c trng
Verification
decision
ID: truong
Xc thc
Quyt nh
xc thc
16
CC THNH PHN CA H THNG
Trch chn
c trng
C s d
liu ngi
ni
M hnh
ngi ni
So khp
mu
iu kin
quyt nh
Hun luyn
Xc thc
Quyt nh
ID ngi ni
Tn hiu u vo
1. Trch chn c trng: Bin i t ging ni th thnh nhng c trng ca
ngi ni.
2. M hinh ngi ni: Hun luyn ngi ni da vo mt phng php c th.
3. So khp mu: Tnh ton lm hp ting ni a vo v mt c trng ngi
ni trong c s d liu c hun luyn.
4. iu kin quyt nh: Vic a ra quyt nh da vo vic lm hp trn.
17
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

18
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

19
TRCH CHN C TRNG NGI NI
M hnh
ngi ni
Trch chn
c trng
C s d
liu m
hnh
ngi ni
So khp
mu
iu kin
quyt nh
Hun luyn
Xc thc
Quyt nh
ID ngi ni
Tn hiu u vo
20
MONG MUN
Xut hin mt cch t nhin v lin tc trong khi ni.
n nh i vi mi ngi nhng phi khc nhau t ngi
ny sang ngi khc.
t b thay i theo thi gian, sc khe hay trng thi ca
ngi ni
t b nh hng bi mi trng xung quanh (c lp mi
trng).
D dng tnh ton.
21
CC PHNG PHP TRCH CHN
C TRNG
Cc c trng mang thng tin v ting ni:
Cc tn s formant
Tn s m c bn
Nng lng
Cc c trng mang thng tin v ng bao
ph:
H s d on tuyn tnh(LPC)
Cc h s cepstrum
Cc h s cepstrum d on tuyn tnh(LPCC)
Cc h s cepstrum tn s Mel(MFCC)
22
CC BC TRCH CHN C
TRNG MFCC
Bao gm 5 bc c bn:
Bc 1: Phn khung (Frame
Blocking)
Bc 2:Ly ca s (Windowing)
Bc 3: Bin i FFT (Fast Fourier
Transform)
Bc 4: Bin i sang thang o
Mel (Mel-frequency Wrapping)
Bc 5: H s Cepstrum (Cepstral
Coefficients)
Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
23
CC BC TRCH CHN C
TRNG MFCC(tip)
Bc 1: Phn Khung
Chia tn hiu u vo thnh cc
on nh khong 20ms-30ms.
Phn khung tn hiu mi khung N
mu, hai khung k nhau lch nhau
M mu:
M=1/2 N

Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
24
CC BC TRCH CHN C
TRNG MFCC(tip)
Bc 2: Ly ca s
Ly ca s nhm gim s gin
on ca tn hiu u v cui
mi khung va c chia.
Dng ca s Hamming (Vi =
0.54), cng thc:
Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
25
CC BC TRCH CHN C TRNG
MFCC(tip)
Bc 3: Tnh FFT
Chuyn i mi khung
vi N mu t min thi
gian sang min tn s.
Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
26
CC BC TRCH CHN C
TRNG MFCC(tip)
Bc 4: Bin i sang thang o Mel
Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
27
CC BC TRCH CHN C
TRNG MFCC(tip)
Bc 5: H s Cesptral
Kt qu ca bc ny l ta tnh
c h s MFCC theo cng thc:
Tn hiu ting ni
Phn khung
Ly ca s
Tnh FFT
Bin i sang
thang Mel
H s cepstral
MFCC
28
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

29
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

30
M HNH HA NGI NI
Trch chn
c trng
C s d
liu m
hnh
ngi ni
So khp
mu
iu kin
quyt nh
Hun luyn
Xc thc
Quyt nh
ID ngi ni
Tn hiu u vo
M hnh
ngi ni
31
MT S M HNH NGI NI
M hnh lng t ho vector (VQ: Vector Quantization)
M hnh hn hp Gauss (GMM: Gaussian Mixture Model)
M hnh mng Nron nhn to
M hnh SVM

32
M HNH VQ
Tp hun luyn gc X l tp cc vector MFCC
Tm cch thay X bi tp vect C nh hn c trng cho X gi l
codebook







C c to ra bng cch s dng cc thut ton gom cm(K-means,
Split, PNN, SOM, GA, )
Kch thc gom cm cho bi ton nhn dng ngi ni: 32..512
33
M HNH GM
Cho mt tp c N im trong khng gian D chiu v mt h cc hm
cc hm mt xc sut trn R
D
Hy tm hm mt xc sut thch hp nht c th sinh ra cc
im trn.
C th chn l cc hm hn hp Gauss:

S dng thut ton vng s cc i (EM_ Expectation Maximization)
tnh cc tham s trong hm Gauss. Mi hm hn hp Gauss s
c biu th bi:

=
=
K
k
k
k k
x g x f
1
) , ; ( ) ; ( =
34
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

35
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

36
SO KHP MU
M hnh
ngi ni
Trch chn
c trng
C s d
liu m
hnh
ngi ni
So khp
mu
iu kin
quyt nh
Hun luyn
Xc thc
Quyt nh
ID ngi ni
Tn hiu u vo
37
SO KHP MU -VQ
Gi s ta c:
X={x
1
,x
2
,, x
N
} l cc vector c trng ca ngi cha bit
C={c
1
,c
2
,,c
K
} l codebook
Cng thc tnh mo lng t trung bnh:



D(X,C) cng nh thi X cng gn C
38
SO KHP MU - GMM
{ }
N
x x X ,....,
1
= L vector c trng cn kim tra
Vi
{ }
K
,....,
1
=
{ }

=
j
j j
j , , e l cc bin c tnh
trong hm hn hp Gauss
{ } ) ( ) ( 2 / 1 exp ) 2 ( ) | (
1
2 / 1
4 /
j i
j
T
j i
j
d
j i
x x x N t =


Hm phn b xc sut:

=
=
K
j
j i j i
x N x p
1
) | ( ) | ( e
Trong N(xi |j) c tnh theo cng thc:
39
Tnh log hp gia tn hiu u vo X vi mu trong
h thng

=
=
N
i
i
x p X P
1
) | ( log ) | (
Gi tr P(X| ) cng ln th hp ca X vi cng
cao
SO KHP MU GMM(tip)
40
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

41
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

42
TO QUYT NH
Gi score(X, Si) l im hp gia tp vect c trng X
v m hnh ca ngi ni Si
Gi s im ln hn ngha l hp hn
Cho S = {S1,,SN} l csdl ca cc ngi ni bit
Khi :
Accept, score(X, S
i
) > O
i

Reject, score(X, S
i
) < O
i

Decide O
i
= verification threshold

Decide O
i
= verification threshold

43
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

44
NI DUNG
Trch chn thng tin t ting ni
Tng quan v bi ton nhn dng ngi ni
Bi ton xc thc ngi ni khng ph thuc vo t kha
Trch chn c trng ngi ni
M hnh ha ngi ni
So khp mu
To quyt nh
Ci t v kt qu th nghim

45
KT LUN
Nhng ni dung chnh c gii quyt:
Nghin cu tng quan bi ton nhn dng ting ni
Nghin cu cc phng php trch chn c trng ngi ni, chi
tit phng php trch chn c trng MFCC
Nghin cu m hnh VQ v m hnh GMM ng dng trong xc
thc ngi ni khng ph ph vo t kha
Ci t cc m hnh, thut ton v tin hnh th nghim trn c
s d liu ting Vit
46
KT LUN
Nhng ng gp khoa hc v tnh thc tin :
Phng php trch chn c trng MFCC vi c s d liu ting
Vit
ng dng m hnh VQ v GMM xy dng h thng xc thc
ngi ni khng ph thuc vo t kha vi c s d liu ting
Vit
ti c tnh thc tin cao trong vic xy dng cc h thng
thanh ton th tn dng qua in thoi; ng nhp vo cc h
thng an ninh, my tnh bng ting ni; gim nh t php ting
ni
47
KIN NGH
Thu thp s lng ln d liu m ting ni tin hnh
kim th, iu chnh cc tham s ca h thng cho chnh
xc.
Tip tc nghin cu cc m hnh thut ton nh mng
nron nhn to, SVM, GM.. ng dng cho bi ton xc
thc ngi ni.
Kt hp cc m hnh, thut ton c vi hi vng s to
ra c m hnh tt hn.
Nghin cu bi ton xc thc ngi ni ph thuc t
kha, kt hp vi bi ton khng ph thuc t kha
nhm lm tng tnh chnh xc ca cc h thng xc thc
ngi ni.