Audio-Video Engineering

Audio-Video Engineering
Jun, 2004
AUDIO-VIDEO AUDIO-VIDEO
AUDIO-VIDEO







Audio-Video Engineering
Audio-Video Engineering
TI LI!U THAM KH"O
TI LI!U THAM KH"O
CMPT 365 Course Contents, Spring 2000,
http://www.cs.sfu.ca/CourseCentral/365/li/index.html
Pri nci pl es of Di gi tal Audi o, Ken C.Pohmanm
Fourth Edition McGraw-Hill.
Di gi tal Vi deo processi ng, A. Murat Tekalp,
University of Rochester, Prentice Hall PTR.
Mul ti medi a processi ng, Andrew Calway,
COMS72200.
Fundamental s of Di gi tal I mage Processi ng.,
Anil.K.Jan, Prentice Hall, 1996.
MPEG Home Page, http://www.cselt.it/mpeg/







Audio-Video Engineering
Audio-Video Engineering
N#I DUNG
N#I DUNG
T!NG QUAN
K" THU#T AUDIO
K" THU#T VIDEO







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN
T$NG QUAN
CH$%NG1
AUDIO-VIDEO
AUDIO-VIDEO







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN
T$NG QUAN
T!NG QUAN V& MULTIMEDIA
KHI NI'M CHUNG V& AUDIO V
VIDEO
H' TH(NG AUDIO-VIDEO
M)T S( V*N +& V& TN HI'U







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
L&ch s' pht tri(n c)a h* th+ng ,a mi tr-.ng
! Cu,c s-ng hi.n /0i, nhu c1u trao /2i thng tin ngy cng t3ng.
! H. th-ng /a mi tr45ng /1u tin l bo, t0p ch v6i mi tr45ng l v3n b7n,
/8 ho0 v hnh 7nh.
! N3m 1895, Guglemo Marconi pht minh ra my radio 9 Pontechio .
N3m 1901, tn hi.u v tuy:n /4;c ng truy<n qua +0i Ty D4=ng v pht
minh ra my /i.n tn, radio l mi tr45ng chuy>n t7i tn hi.u audio qu7ng b
hi.n nay.
! Truy<n hnh, mi tr45ng truy<n thng c?a th: k@ 20, truy<n hnh 7nh v
m thanh /:n mAi n=i trn th: gi6i, mang thng tin c1n thi:t cho cu,c s-ng
c?a con ng45i.
! Cc h. th-ng my tnh tch h;p nhi<u d0ng mi tr45ng s- khc nhau v6i
kh7 n3ng bi>u diBn, t4=ng tc v6i cc d0ng thng tin, l m,t ti<m n3ng l6n
phCc vC nhu c1u trao /2i thng tin v6i chDt l4;ng cao c?a x h,i.







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
Siu ph-/ng ti*n v ,a ph-/ng ti*n (hypermedia
multimedia)
! Siu v3n b7n (hypertext) l v3n b7n c chEa cc lin k:t /:n m,t v3n b7n khc.
ThuFt ngG ny /4;c pht minh b9i Ted Nelson (H965). Siu v3n b7n l m,t v3n b7n
khng tuy:n tnh.
! Siu v3n b7n l m,t ti li.u khng tuy:n tnh, bIng cch kch vo m,t /i>m nng no
/ trn v3n b7n, n c th> chuy>n /:n m,t ti li.u hay m,t v3n b7n khc, r8i c th> quay
v<, thuFn ti.n cho ng45i /Ac trong vi.c duy.t v3n b7n hoJc mu-n t2ng quan m,t v3n
b7n tK ph1n mCc lCc.
! Hypermedia: Siu ph4=ng ti.n khng bL rng bu,c nh4 hypertext. N c th> bao
g8m nhi<u ph4=ng ti.n truy<n thng khc nhau nh4 /8 thL, hnh 7nh, m thanh, ho0t
hnh v 7nh /,ng. ThuFt ngG ny cMng /4;c Ted Nelson pht minh.
! Multimedia: +a ph4=ng ti.n l thng tin my tnh c th> /4;c m t7 bIng audio,
viedo hay ho0t hnh ngoi nhGng ph4=ng ti.n truy<n th-ng.
! Siu ph4=ng ti.n c th> /4;c xem l m,t trong nhGng Eng dCng c?a /a ph4=ng ti.n.







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
V3n b7n th45ng
(tuy:n tnh)
Siu v3n b7n
m
thanh
Video
+8 ho0
Siu mi tr45ng
Hnh 1-1 Hypertext, Hypermedia







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
V d0 m1t s+ 2ng d0ng multimedia:
! H. th-ng xy dNng v so0n th7o video s-.
! T0p ch /i.n tO.
! Tr ch=i.
! Th4=ng m0i /i.n tO.
! Truy<n hnh t4=ng tc iTV.
! Truy<n hnh h,i nghL.
! Truy<n hnh theo yu c1u.
! ThNc t: 7o.
!







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
Cc d3ng mi tr-.ng v tn hi*u:
! Cc d0ng mi tr45ng /4;c phn lo0i thnh mi tr45ng lin tCc, r5i r0c.
audio video animation
graphic text images
d0ng mi tr45ng
g-c tn hi.u
t2ng h;p thu nhFn
r5i r0c
ln tCc
Hnh 1-2 D!ng mi tr"#ng







Audio-Video Engineering
Audio-Video Engineering
T$NG QUAN V%
MULTIMEDIA
T$NG QUAN V%
MULTIMEDIA
Hnh 1-3 Thu nh$n v t%ng h&p







Audio-Video Engineering
Audio-Video Engineering
KHI NI!M CHUNG V%
AUDIO V VIDEO
KHI NI!M CHUNG V%
AUDIO V VIDEO
m thanh (audio)
! m thanh:
! L dao /,ng sng m gy ra p lNc lm dLch chuy>n cc h0t vFt chDt trong mi tr45ng /n h8i
lm tai ng45i c7m nhFn /4;c cc dao /,ng ny.
! Tai ng45i c th> nghe /4;c trong kho7ng t1n s- tK 20Hz /:n 20kHz.
! m thanh t4 nhin:
! L sN k:t h;p phEc giGa cc sng m c t1n s- v d0ng sng khc nhau.
! D5i ,1ng c)a tai:
! Gi6i h0n b9i ng45ng nghe thDy (0dB) /:n ng4Png /au (H20dB) c?a ng45i.
! Ng-6ng nghe t+i thi(u:
! L mEc thDp nhDt m tai ng45i c th> c7m nhFn /4;c m thanh tuQ thu,c vo tKng ng45i,
mEc p lNc v t1n s- c?a m thanh.
! Hi*u 2ng che khu7t m thanh:
! L hi.n t4;ng m thanh m t0i / ng4Png nghe thDy c?a m,t m thanh ny /4;c t3ng ln
trong khi c mJt c?a m,t m thanh khc (kh nghe h=n). +4;c sO dCng trong kR thuFt nn.







Audio-Video Engineering
Audio-Video Engineering
KHI NI!M CHUNG V%
AUDIO V VIDEO
KHI NI!M CHUNG V%
AUDIO V VIDEO
! H-8ng m thanh:
! Tai v no c th> gip ta xc /Lnh h46ng m thanh, /i<u ny c th> Eng dCng /> t0o cc hi.u
Eng m thanh nh4 stereo, surround.
! Vang v tr9:
! Vang l hi.n t4;ng kp di m thanh sau khi ngu8n m / tSt.
! TrB l th5i gian m thanh ph7n x0 /:n /ch so v6i m thanh trNc ti:p. N:u >50ms th trB /
gAi l ti:ng vAng. Bin /, c?a m thanh cE sau H l1n ph7n x0 th bL suy gi7m.
! m nh3c:
! L m thanh c chu kQ 9 nhGng t1n s- m tai ng45i c7m nhFn m,t cch dB chLu, m i, /4;c
k:t h;p m,t cch ph h;p.
! m nh0c g8m cao /,, m sSc v nhLp /i.u.
! Video
! Tn hi*u video:
! L sN ti t0o 7nh tN nhin v6i nhGng kho7ng cch v< khng gian, th5i gian hoJc c7 hai. Tnh tN
nhin /4;c t0o nn tK cc ngu8n sng mJt tr5i hay nh sng nhn t0o ph7n x0 ln cc vFt th> m ta
c th> nhn thDy /4;c.







Audio-Video Engineering
Audio-Video Engineering
KHI NI!M CHUNG V%
AUDIO V VIDEO
KHI NI!M CHUNG V%
AUDIO V VIDEO
! "nh:
! L m,t ma trFn cc /i>m 7nh mang thng tin v< /, chi v mu sSc.
! S4 l-u 5nh:
! Kh7 n3ng l4u hnh c?a mSt trong m,t giy. MSt c th> l4u /4;c 24 hnh trong m,t
giy. DNa vo /Jc tnh ny m ng45i ta chAn s- hnh trong m,t giy c?a 7nh /,ng
khng qu l6n, m cMng khng /4;c nhU h=n /, l4u 7nh c?a mSt /> khng thDy hnh
7nh nhDp nhy hay khng lin tCc.
! :1 chi:
! L bin /, c?a thnh ph1n trong 7nh (pixel).
! V dC tn hi.u chi Y /4;c t2ng h;p b9i cc tn hi.u RGB theo cng thEc:
E
Y
=0,299E
R
+0,587E
G
+0,114E
B
(1-2)
! Thng tin mu /4;c xc /Lnh:
E
B
-E
Y
=0,587E
G
+0,889E
B
+0,229E
R
E
R
-E
Y
=0,587E
G
+0,114E
B
+0,701E
R
(1-3)
! :1 t-/ng ph5n:
! T@ s- c?a /, chi thnh ph1n sng nhDt so v6i /, chi c?a thnh ph1n t-i nhDt.







Audio-Video Engineering
Audio-Video Engineering
H! TH;NG AUDIO-VIDEO
H! TH;NG AUDIO-VIDEO
H* th+ng audio t-/ng t4
H* th+ng video t-/ng t4
Ngu8n m
Ti<n khu:ch
/0i
XO l
XuDt
Khu:ch /0i
L4u trG
Hnh 1-4 H' th(ng audio t")ng t*
Chuy>n
/2i 7nh-
tn hi.u
XO l tn
hi.u
T0o
xung
/8ng b,
L4u trG
hoJc
truy<n dVn
XO l tn
hi.u
Chuy>n
/2i tn
hi.u- 7nh
Tch
xung
/8ng b,
C7nh tN nhin
(ng knh
Tnh ti t0o
MSt
ng45i
Hnh 1-5 H' th(ng Video t")ng t*







Audio-Video Engineering
Audio-Video Engineering
H! TH;NG AUDIO-VIDEO
H! TH;NG AUDIO-VIDEO
H* th+ng audio-video s+:




Cc thnh ph<n c)a h* th+ng:
B! ph"n thu: Qu trnh thu tn hi.u audio hoJc video tK m thanh hay c7nh tN nhin vo mi
tr45ng l4u trG /4;c gAi l qu trnh thu. +i<u ny c th> thNc hi.n b9i micro thu m hay camera
thu hnh. Micro v Camera l cc thi:t bL thu tn hi.u v chuy>n tn hi.u (m thanh hoJc 7nh) sang
tn hi.u /i.n t4=ng tN. +-i v6i cc h. th-ng s- ph7i thNc hi.n vi.c chuy>n /2i t4=ng tN sang s-.
L#u tr$: Thi:t bL l4u trG l b3ng tK hoJc /Wa tK. C th> l cc thi:t bL ring bi.t sO dCng v6i muc
/ch thuFn ti.n v yu c1u m,t chDt l4;ng no /.
X% l tn hi&u: +i<u chXnh /Jc tuy:n t1n s-, mu sSc, t0o hi.u Eng..
Truy'n d(n: Truy<n tn hi.u tK vL tr ny sang vL tr khc v6i m,t kho7ng cch khng gian no /
qua m,t mi tr45ng truy<n dVn no /.
Ngu8n tn
hi.u analog ADC
XO l
L4u trG
Truy<n dVn
B, hi>n thL,
xuDt t4=ng tN DAC
Hnh 1-6 H' th(ng audio-video s(







Audio-Video Engineering
Audio-Video Engineering
M#T S; V=N :% V% TN HI!U
M#T S; V=N :% V% TN HI!U
Tn hi*u v hm
! Tn hi.u t4=ng tN l hm theo th5i gian.
! Bin /, m thanh /4;c bi>u diBn bIng mEc
/, m thanh t0i th5i /i>m / cho.
! Tn hi.u /4;c bi>u diBn bIng hm f(t).
Tn hi*u c chu k>
! SN lJp l0i trong m,t kho7ng th5i gian ngSn nhDt
khng /2i gAi l chu kQ T.
! T1n s- l nghLch /7o c?a chu kQ: u=1/T.
Phn tch Fourier
! Trong thNc t:, rDt t khi ta c /4;c m,t tn hi.u /=n t1n, m thng th45ng
l cc tn hi.u phEc t0p, k:t h;p b9i nhi<u t1n s- v cc hi c?a n. Tuy nhin,
ta c th> phn tch chng thnh t2ng h;p c?a cc tn hi.u /=n t1n. + l phn
tch Fourier.
! Vi.c phn tch Fourier cho k:t qu7 l t2ng c?a cc hm sin v cosin c?a
cc t1n s- khc nhau.
Bin /,
Th5i
gian t
f(t
0
)
t
0
Hnh 1-7 Bi+u di,n bin -.-th#i
gian







Audio-Video Engineering
Audio-Video Engineering
M#T S; V=N :% V% TN HI!U
M#T S; V=N :% V% TN HI!U
Phn tch Fourier m,t chi<u:
(1-4)
(1-5)
Bin ,1 v pha
Trong thNc t:, F(u) l m,t s- phEc:
(1-6)
Trong /, F
R-
(u) v F
I
(u) l ph1n thNc v ph1n phEc.
Bin /, /4;c xc /Lnh nh4 sau:
(1-7)
Pha /4;c xc /Lnh nh4 sau:
(1-8)
Khi / v6i th:
(1-9)
Nh4 vFy, v6i tn hi.u thNc:
(1-10)
2
( ) ( )
j ut
F u f t e dt

2
( ) ( )
j ut
f t F u e du

R I
F(u)=F -(u) + jF (u)
2 2
( ) ( ) ( )
R I
F u F u F u = +
)
) (
) (
arctan( ) (
u F
u F
u
R
I
=
t j t e
jt
sin cos + =
) (
) ( ) ( ) ( ) (
u j
I R
e u F u jF u F u F

= + =

+ =
0
)] ( 2 cos[ ) ( 2 ) ( du u u F t f

+ =
0
)] ( 2 cos[ ) ( 2 ) ( du u u F t f







Audio-Video Engineering
Audio-Video Engineering
M#T S; V=N :% V% TN HI!U
M#T S; V=N :% V% TN HI!U
Ph? t<n s+
! SN phn b- c?a |F(u)| gAi l ph% t/n c?a tn hi.u.
! Tn hi.u bi:n thin chFm th ph2 t1n tFp trung 9 t1n s- thDp v ng4;c l0i. TK /
hnh thnh tn hi.u t1n s- thDp v t1n s- cao.
Tn hi*u Audio v Video
!Tn hi.u m thanh th45ng l tn hi.u m,t chi<u.
!Tn hi.u 7nh l tn hi.u hai chi<u.
!Tn hi.u Video l tn hi.u 3 chi<u.
!V6i cc chi<u khc nhau, ta sY c s- bi:n khc nhau t4=ng Eng.
!Chuy(n ,?i Fourier 2 chi@u
(1-11)
!V6i cc bi:n u, v trong m<n t1n s-.
!Chuy>n /2i ng4;c:
(1-12)
!V6i :
(1-13)

+
= dxdy e y x f v u F
vy ux j ) ( 2
) , ( ) , (

+
= dudv e v u F y x f
vy ux j ) ( 2
) , ( ) , (

vy j ux j vy ux j
e e e
2 2 ) ( 2 +
=







Audio-Video Engineering
Audio-Video Engineering
M#T S; V=N :% V% TN HI!U
M#T S; V=N :% V% TN HI!U
!Do /, phn tch Fourier 2 chi<u theo hai bi:n x, y l:
(1-14)
!+-i v6i tn hi.u thNc f(x,y):
(1-15)
Mu sAc:

=
=
dy e y u F v u F
dx e y x f y u F
vy j
x
ux j
x

2
2
) , ( ) , (
) , ( ) , (
( ) [ ]


+ + =
0 0
) , ( 2 cos | ) , ( | 2 ) , ( dudv v u vy ux v u F y x f
Hnh 1-8 L thuy0t 3 mu RGB
Vi.c k:t h;p cc mu khc nhau t0o
nn m,t mu m6i. Thng th45ng,
chAn cc mu c= b7n /> k:t h;p, v dC
RGB