ERROR RESILIENT CODING (ERC) OPTIONS of H.

264/ MPEG-4 PART 10 or AVC (ADVANCED VIDEO CODING) VERSUS MULTIPLE DESCRIPTION CODING (MDC)
[1]

Imran Ullah Khan, [2] M.A.Ansari Research Scholar Mewar University,Chittorgarh[2] ro!essor "e#t. $lectronics % Comm. $ngg, &'U, &reater (oi)a, In)ia
$mail* [1]imran+,-./gmail.com, , [2] mahma)iitr/gmail.com

[1]

Abstract -

Mo !"# P!$%&r' E()'r% Gro&) (MPEG-4) !* +" ISO/IEC !,'o $o,!"# *%+",+r, -.!$. *&))or%* .!#./0 !"%'r+$%! ' 1&/%!1',!+ +))/!$+%!o"* +* -'// +* %r+,!%!o"+/ +))/!$+%!o"*. I% !"$/&,'* 1+"0 +, +"$', f&"$%!o"+/!%!'* *&$. +* !"%'r+$%! !%!'*2 *$+/+3!/!%!'* +", Error r'*!/!'"$'. M&/%!)/' ,'*$r!)%!o" $o,!"# !* *o&r$' $o,!"# !" -.!$. *' 'r+/ ,'*$r!)%!o"* of %.' *o&r$' +r' )ro,&$', *&$. %.+% +r!o&* r'$o"*%r&$%!o" 4&+/!%!'* +r' o3%+!"', fro1 ,!ff'r'"% *&3*'%* of %.' ,'*$r!)%!o"*. M&/%!)/' ,'*$r!)%!o" $o,!"# (MDC) !* +" 'ff'$%! ' Error r'*!/!'"$' %'$."!4&' for !,'o $o,!"#. I" $+*' of fr+1' /o**2 'rror $o"$'+/1'"% (EC) %'$."!4&'* $+" 3' &*', !" MDC %o r'$o"*%r&$% %.' /o*% fr+1'2 -!%. 'rror2 fro1 -.!$. *&3*'4&'"% fr+1'* $+" 3' ,'$o,', ,!r'$%/0. T.!* )+)'r !" '*%!#+%'* %.' 'ff'$% of ERC o" H.264/MPEG-4 P+r% 10 or AVC (A, +"$', V!,'o Co,!"#) +", 1&/%!)/' ,'*$r!)%!o" $o,!"# (MDC). 5' +/*o )ro)o*' + A/#or!%.1 for Error $o"$'+/1'"% (EC) %o !1)ro ' %.' 'rror r'$o 'r0 r+%' of +"0 EC !" %.' %'1)or+/ *&3*+1)/!"# MDC.6o%. *&37'$%! ' +", o37'$%! ' r'*&/%* *.o- %.+% %.'r' !* *!#"!f!$+"% !1)ro '1'"% !" !,'o 4&+/!%0 %.+" ,!r'$% ,'$o,!"#. Key words Scalability, Error concealment, multiple description coding, Error resilience.

Resiliency can 1e ma)e targeting )i!!erent ty#e o! #ro1lems !o+n) in heterogeneo+s environments. II.ERROR RESILIENC8 SCHEME 0he 8.29:;A<C vi)eo co)ing stan)ar) e=#licitly )e!ines all the synta= elements, s+ch as motion vectors, 1loc, coe!!icients, #ict+re n+m1ers, an) the or)er they a##ear in the vi)eo 1itstream. Synta= act+ally is the most im#ortant tool !or ens+ring com#liance an) error )etection. >i,e other vi)eo co)ing stan)ar)s, 8.29:;A<C [1] only )e!ines the synta= o! the )eco)er in or)er to allow !le=i1ility in s#eci!ic im#lementations at the enco)er. 8owever ?it #rovi)es no g+arantees o! en)2to2en) re#ro2 )+ction 3+ality, as it allows even cr+)e enco)ing techni3+es to 1e consi)ere) con!orming@ [2]. 'asically a vi)eo 1itstream corr+#te) 1y errorAsB will inc+r synta=;semantics errorAsB. "+e to the +se o! <>C, errors o!ten #ro#agate in the 1itstream +ntil they are )etecte). 0he synta=;semantics errors may incl+)e [C] iB. Illegal val+e o! synta= elements. iiB. Illegal sync hea)er. iiiB. More than 19 coe!!icients are )eco)e) in a :=: 1loc,. ivB. An incorrect n+m1er o! st+!!ing 1its are !o+n). 0his co+l) also occ+r when e=tra 1its remain a!ter "eco2 )ing all e=#ecte) coe!!icients o! the last co)e) 1loc, in a vi)eo #ac,et. vB. Some o! the co)e) 1loc,s in a vi)eo #ac,et cannot 1e )eco)e). De have the !ollowing error resiliency schemeE 1.B Fle=i1le Macro1loc, 7r)ering AFM7B 2.B Intra2'loc, re!reshing 1y Rate "istortion AR2"B Control C.B Ar1itrary Slice 7r)ering AAS7B :.B Re)+n)ant Slices G.B "ata artitioning

I.INTRODUCTION 0o ena1le the com#resse) 1it2stream to 1etter resist channel errors or $rror resilience techni3+e ena1le the com#resse) 1it2stream to resist channel errors so that the im#act on the reconstr+cte) image 3+ality is minimal. Some #art o! the in!ormation is inevita1ly lost an) the goal o! error concealment[14], at the receiving si)e ,is to estimate the losses an) conceal them in the )is#laye) vi)eo. $rror resilience ta,es nearly 245 o! the cons+m#tion

1 Compression 'eca+se, generally the $rror Resilience schemes intro)+ce some re)+n)ancy in the )ata. 7n the other han) com#ression schemes aim to remove vario+s re)+n)ancies !rom the )ata. In H.264 we can !in) several #arameters that can 1e t+ne) so that a tra)e2 o!! 1etween com#ression rate an) $rror
Error Resiliency 6

Mainly in this #a#er we are concern with Fle=i1le Macro1loc, 7r)ering AFM7B an) Intra2'loc, re!reshing 1y Rate "istortion AR2"B Control Flexible Macroblock Ordering (FMO) It ran)omiHes the )ata #rior to transmission ,so that i! a segment o! )ata is lost Aeg. A #ac,et or several #ac,etsB, the errors are )istri1+te) more ran)omly over the vi)eo #ict+res ,rather than ca+sing corr+#tion o! a com#lete regions ,ma,ing it more li,ely that relevant neigh1oring )ata is availa1le concealment o! lost content. 0o, Achieve this, each M' is statically assigne) to a slice gro+# +sing Macro1loc, Allocation Ma# AM'AB . M'A ma# in H.264 s+##orts !ollowing ar1itrary sha#esE 1. Interleave) . 0 1 2 0 1 2 0 1 2 ntra!"lock re#res$ing by Rate %istortion (R!%) Control 0he error #ro#agation an) )ri!t )+e to #re)ictive co)ing can 1e eliminate) 1y #erio)ically inserting intra2co)e) M's in the 1it2stream. Error &ropagation A transmission error s+ch as a 1it error or #ac,et loss may ca+se a vi)eo )eco)er to lose synchroniHation with the se3+ence o! )eco)e) <aria1le >ength Co)ing A<>CsB. 0his can ca+se the )eco)er to )eco)e incorrectly some or all o! the in!ormation a!ter the occ+rrence o! the error an) this means that #art or all o! the )eco)e) vi)eo o1Iect #laneA<7 B will 1e )istorte) or com#letely ,lostAie. the e!!ect o! the error s#rea)s S#atially thro+gh the vi)eo o1Iect #lane, S#atial error #ro#agation[9]. I! s+1se3+ent <7 s are #re)icte) !rom the )amage) <7 , the )istorte) are a may 1e +se) as #re)icte) re!erence, lea)ing to T'1)or+/ 'rror )ro)+#+%!o" in s+1se3+ent <7 s.
H.264 Encoder CH. 1 H.264 Decode r
Frame Interpolat -ion DSide

S O ! C E

Odd/Even Frame Splitting

2. "is#erse) 4 2 4 2 4 2 1 2 C C 41 1 2 C C 41 1 2 C C 41 4 2 4 2 4 2 1 C 1 C 1 C 2 4 2 4 2 4

Odd/Even Frame Interleavi ng

DCentral

H.264 Encoder

CH. 2

H.264 Decode r

Frame Interpolat -ion

DSide

C. Foregro+n) an) 'ac,gro+n)

1 2

III. MDC 6ASICS M+lti#le "escri#tion Co)ing was originally +se) !or s#eech comm+nicating over circ+it2switche) networ, in the 1.-4Js. 0ra)itionally, to avoi) comm+nication interr+#tion, an a))itional transmission lin, was on stan)1y an) wo+l) 1e activate) in the case o! the o+tage o! the main lin,. 0his a##roach however was not cost e!!icient an) there!ore the i)ea o! s#litting the in!ormation over two channelsE i.e. M"C, was #ro#ose). At the 1.-. I$$$ In!ormation 0heory

Fig"re-1# $loc% Diagram o& 'emporal Domain (DC

Dor,sho#, the M" #ro1lem was #ose) 1y &ersho, Ditsenha+sen, Dol!, Dyner, Kiv, an) 7Harow. S+##ose a source is described by t'o descriptions eac$ decoded at rate R1 an) R2. $ach )escri#tion can 1e in)ivi)+ally )eco)a1le with )istortion "1 an) "2,res#ectively, while )eco)ing the two )escri#tions together lea)s to )istortion "4E the M" #ro1lem is to characteriHe the achieva1le 3+int+#les["4, "1,"2,R1,R2] . Fig. 2 shows the 1asic 1loc, )iagram o! M"C. 0his !ig+re shows a two2)escri#tion case 1+t a higher n+m1er o! )escri#tions is #ossi1le. In the !ig+re, a so+rce is co)e) s+ch that m+lti#le com#lementary )escri#tions that are in)ivi)+ally )eco)a1le are generate). A!ter the )escri#tions are 1+ilt, they can 1e transmitte) se#arately, #ossi1ly thro+gh )i!!erent networ, #aths. At the receiver si)e, i! only one )escri#tion is availa1le, it is )eco)e) 1y the side decoder an) the res+lting 3+ality A)istortionB is calle) side (uality (distortion). Dhen 1oth )escri#tions are availa1le, they are )eco)e) 1y the central decoder an) the res+lting 3+ality A)istortionB is calle) central distortion ((uality). In central )eco)er the )escri#tions are merge) an) hence a vi)eo with higher 3+ality is achieve)[.]. In other wor)s, there e=ist two ty#es o! )eco)ing at the receiver, when all )escri#tions are receive) the central )eco)ing is +se), an) i! one or more )escri#tions are not receive) the si)e )eco)er is +se) !or the receive) )escri#tionAsB[1:]. 71vio+sly, 3+ality is enhance) 1y the n+m1er o! receive) )escri#tions. Since #re)ictive co)ing is +se) in all mo)ern vi)eo co)ecs, the 3+ality o! a #re)icte) !rame will )e#en) on its re!erence !rame. Dhen M"CJs si)e )eco)er is activeE i.e., when some )escri#tions are lost,a re!erence !rame may not 1e reconstr+cte) correctly )+e to this loss, lea)ing to noisy reconstr+ction o! all other !rames which are #re)icte) !rom it. S+1se3+ently, some o! the erroneo+s !rames co+l) in t+rn 1e +se) as re!erence !or other !rames an) so error #ro#agation occ+rs.
Side Decoder S O ! C E ("ltiple De)cription Encoder C*annel 1 C*annel 2 Side Decoder Central Decoder
DSid e

IV ERC o)%!o"* of H.264/AVC 'r*&* MDC 0hese o#tions wor, only i! the loss rate is very low or at most low. In mo)erate or high loss rate environments, M"C is more 1ene!icial[1C]. 8.29: +ses intelligent intra21loc, re!ereshing 1y R2" control,s+ch that an a##oro#riate 1loc, co)ing o#tion oL will 1e selecte) that minimiHes the ?>agrangian Cost F+ction@ ,+nli,e the #erio)ic or ran)om intra re!resh in earlier stan)ar)s Aeg. M $&2:,8.29CB. O L =arg min [ % AoB +RAoB ] o ) 8ere O M'loc, co)ing mo)e AInter;Intra mo)e an) 1loc, siHeB % AoB M"istortion intro)+ces 1y enco)ing with mo)e O an) is com#+te) 1y the S+m o! A1sol+te "i!!erence ASA"B in low com#le=ity mo)e an) 1y S+m o! S3+are) "i!!erence ASS"B in high com#le=ity mo)e M>agrange #arameter !or a##ro#riate weighting o! rate an) )istortion RAoB M Corres#on)ing co)ing rate, whereas !or Inter21loc, mo)e it re#resents the 1loc, resi)+al an) corres#on)ing motion vectorAsB. Error Concealment *pplication &rogramming nter#ace (*& ) Intra2'loc, re!reshing 1y Rate "istortion AR2"B Control "o+1le R" costN!orNOPO 1loc,s A intL cntNnonH , ;;22Q n+m1er o! nonHero co!!icients int 9:L c1#N1l,, ;;22Q c1#N1l, )o+1le lam1)a, ;;R22 >agrange m+lti#lier int 1loc,, ;;R22 O P O 1loc, n+m1er int mo)e, ;;R22 #artitioning mo)e short #)ir, ;;R22 #re)iction )irection short re!, ;;R22 re!erence !rame short 1w)Nre!, ;;R22 a1# ty#e B "esc2 Calc+lates cost !+nction to !in) the a##ro#riate 1loc, co)ing o#tion. Ret+rn2 &et Rate S"istortion Cost "etail o! Se3+ence Use)E (ame 2 Foreman SiHe 2 TCIF A1-9=1::B Frame rate 2 -.G !#s 'it rate 2 9: K1#s (o. o! !rames 2144

DCentral

DSide

C*annel 1 ("ltiple De)cription Decoder

Fig+re 2* 'loc, )iagram o! Side M"C

Decode r

imaging Vo+rnal s#ecial iss+e on >ow 'it2rate m+ltime)ia comm.,<ol.14,iss+e G,## C1G2C2C 7ct244:. [:] www.ieee.org. [G] htt#*WWwww.+1vi)eo.com [9]?".Mar#e, 0.Diegan) an) &.V.S+llivan, ?0he 8.29:;M $& A)vance vi)eo co)ing stan)ar) an) its a##lications@, I$$$ Comm+nications MagaHine, vol.::, no.O, ##.1C:21::, A+g.2449. [-] Ki1ria R, Kim V A244OB 8.29:;A<C21ase) m+lti#le )escri#tion co)ing

9!#&r' :; Sna#shot o! ?!oreman@ vi)eo se3+ence

!or wireless vi)eo transmission. a#er #resente) at the International Con!erence on comm. [O]A#ostolo#o+los V& A2441B Relia1le vi)eo comm+nication over lossy #ac,et networ,s +sing m+lti#le state enco)ing an) #ath )iversity. a#er #resente) at the <is+al comm. An) Image rocessing A<CI B.

CONCLUSION 1. M"C a##roach2"+#licating the motion in!ormation in 1oth )escri#tions [-2O] Stan)ar) com#ati1ility 2 (o Re)+n)ancy t+na1ility 2 Mo)erate Com#le=ity 2 >ow S+mmary S Motion <ectors AM<sB hel# to conceal the lost )escri#tion more e!!iciently, with the cost o! a))itional rate !or sen)ing M<s. 2. M"C a##roach 2 M+lti2rate M"C [.214] Stan)ar) com#ati1ility 2 Ues Re)+n)ancy t+na1ility 2 8igh Com#le=ity 2 Mo)erate S+mmary S A coarser 3+antiHe) version o! the !rames o! )escri#tion 1 A2B are co#ie) into )escri#tion 2 A1B. 0he 8.29:;A<C vi)eo co)ing stan)ar) aims at achieving im#rove) com#ression #er!ormance an) a networ,2!rien)ly vi)eo re#resentation !or )i!!erent ty#es o! a##lications, s+ch as conversational, storage,an) streaming. In this #a#er, we )escri1e) vario+s error resiliency schemes, incl+)ing a !ew nonnormative error concealment schemes, em#loye) 1y 8.29:;A<C. RE9ERENCES
[1]?"ra!t I0U20 Recommen)ation an) Final "ra!t International Stan)ar) o! Voint <i)eo S#eci!ication AI0U20 Rec. 8.29:;IS7; I$C 1::.9214 A<CB, Mar. 244C [2] 0.Diegan),&.V.S+llivan,&.'Iontegar) an) A.>+thra ?7verview o! the 8.29:;A<C vi)eo co)ing stan)ar)@ I$$$ 0rans. Cir. Syst. <i)eo Vo+rnal0echnology,<ol.1C,## G942G-9 V+ly2244C. [C] S.K+mar an) >.PU ?R<>C )eco)ing scheme !or im#rove) )ata recovery in M $&2: vi)eo co)ing stan)ar)@ Real time

[.] 0illo 0, 'accaglini $, 7lmo & A2414B M+lti#le "escri#tions 'ase) on M+ltirate Co)ing !or V $& 2444 an) 8.29:;A<C. Image rocessing, I$$$ 0ransactions on 1. A-B*1-G921-9-, )oi*14.114.;ti#.2414.24:G9OC. [14]. Ra)+lovic I, Frossar) , Ue2K+i D, 8ann+,sela MM, 8alla#+ro A A2414B M+lti#le "escri#tion <i)eo Co)ing Dith 8.29:;A<C Re)+n)ant ict+res. Circ+its an) Systems !or <i)eo 0echnology, I$$$ 0ransactions on 24 A1B*1::21:O. )oi*14.114.;tcsvt.244..2429O1G. [11] <aisham#ayan <A, Vohn S 'alance) inter!rame m+lti#le )escri#tion vi)eo com#ression. In*Image rocessing, 1.... ICI ... rocee)ings. 1... International Con!erence on, 1... 1.... # O122O19 vol.O1C. )oi*14.114.;ici#.1....O1-2CG. [12]Che2Ch+n S, Uao VV, Chen 88 8.29:;A<C2'ase) M+lti#le "escri#tion Co)ing Scheme. In* Image rocessing, 244-. ICI 244-. I$$$ International Con!erence on, Se#t. 19 244-27ct. 1. 244- 244-. ## I< 2 29G2I< 2 29O. )oi*14.114.;ici#.244-.:CO444G [1C] Rei1man AR, Va!ar,hani 8, Uao D, 7rchar) M0, +ri R A2442B M+lti#le2)escri#tion vi)eo co)ing +sing motion2com#ensate) tem#oral #re)iction. Circ+its an) Systems !or <i)eo 0echnology, I$$$ 0ransactions on 12 ACB*1.C224:. )oi*14.114.;-9...C::4. [1:]. &oyal <K, Kovacevic V A2441B &eneraliHe) m+lti#le )escri#tion co)ing with correlating trans!orms. In!ormation 0heory, I$$$ 0ransactions on :- A9B*21..2222:. )oi*14.114.;1O..:G2:C