Mao) SN ey] abe OlP Enis) as Unis are mM=p- 2 smatox ik pp = [Pe C¥/x)] - pote) = ip | se ee ‘ Cer] Ex. For a_fsc._ hind the channel capa rt) p=og ¢ ii) P2066 e , log =A Pe) mY ACY) bo T Yeag) eq r Ye)yy] s) + x — puctiog ‘e fego— EPPO by OP) eee 4 | i xs = beget + Phge sy Cet) bg lier) ]Pdeq races) © = Cody ht tay 9 Ley C7 o® dog sts = Wo aoa wong =" — Le eg pe a CDG OP) Yop loge + Lice) Leg ery 7 == |tteq Pp (1p) fea (1-P ) ce log ne a plat = log 2 Le Ploilay leg eh) C= | + they TF Cer By 0 J+ O'9 Jog o-g - OJ jogo)ci ee 0B ey, ag 8? = a 2 bye- (rt 4 pC) a mea a r(Se tojahh At 42-78 ° ela S -f- 93h 40 soar is [oa l) =O ae Cascaded Channels: Bomeimes channel: aale- tobe. cas cacled jon aome = fensiont Leb us consider thu case tao cnscade dl Aesnouney sy cham howe tn Avy. Joelero > Ve gM dom %, vee hyn Ammo wos + Av-Mv- 4 FW -Ma- 2. Ake Attppe th ve pow Apecbabilitten cue PP + 44a. 7 Rene oem [ps pqs Crvay apa ay. a Bimtlecty tha umsgen Aroma Gecaeis Ga Sew Teo say Soy Yin za Ave wea per ve. pale prot pa t af ee he Me ar = ong fs ao * chuk | GE ann Ue neon tate : ve (era) +14) 24) exe =Ss MS = 0-042 4al 36 wis) We channel uncdele of Taw ay chownel fo | PCAx) . | aR ar, Vr! af fare ioral Jas P! Abus, Su cascaded — chemarel fo eowacalent ty o Aingda RAC veilh exe! pres = 2 4 Mabe km Usa — chournel ot a bse qiven oy cz \— Heq> Heme =H e2paSt{ af Cricaole f elo vA <- - \-H'y = \l- HC2ea) For O85 7470, AP arecter fran 7 Bence , te chanel aap ct Ho cancackidl BSC's ~b less Hrow a single ase as eo-peucal + 7 BEC Rnanm Erasune Chanwl J Yn an A tp 1) + + Asie els COM soa re Bec in) alin com. % v oO ht axe chietvenited of West aoee iis Oryes. th syakas |imdtcater Haat olure te Ab ise ne as, | Lelrewatiaish c lesistess ean be_macle | An epee DQ a SET cde 7vy Yn sgebels “‘Undicates Lak Pre 1p ip @xased. Hone “the name BEC dn - Jpeactice | valence cerishouw oo in buor 4H, te cushanever debexministic — olers tw 1 wr — faware of 0 02 4 B nO Jporvible, the receiver seeo|ussts St 7% Jer ve- beanam tM He deuishon iy taken, oither 1 Krevovr 0 oz In favour of J Fo. BEC, ta channel mats petecwr= £5 % 4 E P 6 oO 6 L z 3 i t = » ; { L he us gusume Haak plo) = %& ¢ — Pay =I-% ak fe x, [ Hence , HX) = & Jog 4 Ctx) fog lL — = ele Clow, since POU) = Po) wx 4 iO _P M2) = PCI) = Cx) L bb a fein S muabde POX) eo : doy ‘plying Tht rows f- — CNX) lp ac F Cre, reply. Le ttehee , a Leow) - fer et 0 © Cee)q Ciox)P She summation ote jhe columns J— eC) = XP, FUad = way i os e(i = Cl-«)> Gin)4 y —31 “Che condilioual ite ctatotthre) P_C&/Y) an Son bond i alt tw alu ep mat od Sop ds PCY), PCy Pee oe I PCeIN) ~ | ae eos ~eP TCR aya, o Cr G-«)P as Cry Ph i q * } ~ © Io 1 Ohne HCX/N)_= ~ 2 pL, yx) bog £P (ej /ye) Js wat - - [ar begt tk q hog bux) “tage rah) oh Cin) Pp b_Aog 1} = = La log 4 (trot) tog (Ix) = 9 WX) = Ct) CX) Since q = 1 Jo Hair pase 3H dauutual 2nbrali 4 ronnod aptly axe TQ) = HX) = WOxry) | =H (x) — (\-p) HOA) = PHO)Cm = matt (%3) = mat pre Hy Pooman Ewexy) " = since mam. [rcoj=4 ¥ RepebtHison ot ble | The concept ef BEC ia wedl dn te pltou ways , The tozansmibted aly wy epeated ot He channel tip to incroase He channel ebicieney ga ahem wt by. Lelew apy Ps cwe , Dr acceptable o1P sige. ae Y, = 00 & Yooli. Tre ops 4 4a 201 & Yaslo ave Uscarded Cerar & request foe netranimission fb male os jn BEc. 7 The channel umeatrty ir = Me Ne Ya Ye ein) = ie [to oe | i Fazeaihae36 het us Assume Pou) = pcm) = 0-6 there Vose iL _ \ Y Yo 43 M4 PCyg p= my [ee hp tp. Pt te [Ploy PL ip PL /y Hente PQA) = PRQe = P42) | a a ; | RlMs) = pa = PCya) Thsrehore 1 Wey) = PO) fog tt ¢ ‘| ra | PCs) fog 1 pe yy) day) FCS Peg) AEDST ces “Gres oxta tog (_»_\ “tte HOI) = Pts) + 4° bog ( \ ; | . ve ke et ey ZH¥ Ss HO- AOD = (p47) Jog = ae 2 pine ea P42) i Gel= Tig ele a oaF 2Pe w(t] (Pea) bey aa a pe eg Paty, [: * “Ce al} Peg Pox a sagef =e [eae GS)" . | “(Re)a] eee [a GES) s) G a Je Ge, se) = (Pq) [s- a Thus | +he channel equinatert to a gsc i> now wale error prep ae 0 rq? ruta — iunhowabtion 1 (x,Y) db gression ow puginal wodet Cie: Usher neon yn - apo" nepetiion A siys)) Since 46d 1 A - H¢a),35 Hind dhe VIL, @ channe! cap. = | ek Hee channel: Riu d= 0-6 3-0. O-e , = 0°4 O38 SS — oe a ee pov) es 2-27) | i 7 cea Am) a0) = ficug ole fos 0-28 POD = OC P (Ya) = 0-4 ® (Cxry) _ 08 03 | = PCS YD 5 On ot ely) ROX) = Rab) Joa rem) = 0:97] Hw). = Plog (LY Or7BE 6 PON) = HK) — HOY) O97) — O-7a¢ O18 s— (Naw Pus og Pia = O.g tyg = 0.3 Poaz OF | wy08 9% Ie , 06 log Okt o.2beg-02° 0% oF >. - 03 Legos t Cae tara . (“sae 8, - -0-65%8 : wa G, = -0-4765 Lore wees x aaxsy =4 ls wunrten OD (: 30d) Yo joe aban of yabin re cose OB Q@ 4028, T-O-1Y ~ 2 T¢- 0-8 Q, a . om Qn 2 73S 48, 1 OO Gy +°7Q, = —a€0 ont 0:59)4 6951-49) x 07 =08se 40:98, 7 24SbE 34.26 aO-ey34 ar "ES -O8 8 FRG) = 1877 Cater a GF 32 GQ, = —O-6see Goo = 0'9766 ~ 7 = 09764 C= tng ast +2 ) = Log 1c C tur Bis [msg We Ary ; p(diouyicysy = Sey 2 Ay yey -y et 4 ot ny (954-02 88 = 507 0-88, — O-AVO*9764 = 90-714 | ee <———We Career CCS S a2 cRanpets alt non symmebsic shunt vi my oe © na 45 ter < 2 (o> Poo a D =P C1 2 pe | a faa “Te Bod tne chad cop. He aus Losey ngsaxdables Q,¢ Qa are debinsal ley, CejiCay=- Cx Ry ha Q: _ fu oy tn + Po bow Fay for hy Is. |= Fon hy tee Pee day P J « Cy ba (ody 0°? 5 24. oe esoae channel Cron symmetec oes, ar sje ap nlShannop's Th": - >) This 46" jo concerned usin dre zeke of ivlormetivon dranimissiion oven A eomm? channel . he statement of— Shannon's Ae jn + Giver a neuree of M ex se ums roudtm meri, vobich bv genweabing infor at a sate R. Givew my vite a channel aap, C. Then | if, esc, duce extsts a coding tech. | such staat Hu ep ol Hae source may be transmitted over re channel uit a -pteob- | ok wor Sk receiving tht mncsq vabich mey be mele arbiterily small. “Tne imap Jrontune ag H's dh un thar ik _findlieates = S enstb2 nee teams” in upessiti in the plesence bf unmise There {on a ‘i associated uitith _shanaon's th, Th is: ' ” jetta l2 | gy | ee ee “ut ; rely puss auloumalon at a vate &. Giw thin 5 p__R2c_, Hae _pecab af “ere 050 dok_af- Ty jn clase ty tually hor eum possible —sThus Hu channel cap © Ap 0 Com, channel fp ibs vert? ‘imp. chan. a ole, Be Liman. rm gat ble gale ak wold ° exseon jwee treinsmissinn of anhor™ 4a possil BA ook * Shannon'e — Flesk theorem ( Source Cociag th" One of the mest important problem In comm” is the — * efficient representation! of the data generated. by a discrete seurce. The process by which this ' ‘epresentation js achieved "is known: ar — source encoding’ & the device which perkouns the source encocli Js called as ‘source erodes. In order to mate the ounce enceder ose ecient we need to ken ow Awe stabtcHes of ne cource. . That means these gousce ~symbel vglich shave higher -preb should be L oustaned. it \shorker cocle words 4 whewas He source symbols } pee of —oceuvence shoul che Lranimited - dard Jonger cole words. r LH | Given 4 chates that tne ave > Miye. 9 ioord length Lshoutel Ce atways “be eater than vad ve r t Lelia 2 dp wenn) ee SEY Coaseg ekhicteney Ke sno Set |ns h - aaa AW variable length ceding ia done ia onder +o ‘intvease the. siftenay of Hts —ananse ___ | encoder. Dow we ore fess fo—_discuss aww algatibins nohich use “Aare wariable fengh cndinag tech 4 Shannon dana 8 Huffman Shannon's Th on the Channel capacity. Cochanned coding 4D) Given nat __a__saurce__oy—M4_equsal ly i miges alt aa. 724 pntlich in | 4 injormation ata hte R_- Green | nat uh chanel by Cents tan if 7 : paazic | his ty" ic concerned Leith the | soke_ol- teansmiccion of Snformation_cver_a._| comm channel. The channel __cap._C ‘ts _a_sake of} Hhransaiscion sa (its _| seeaw Bee. What ts dre mar. capanhy + yee notse- fess channel whose aide is Jonx an whi the value of He dake tronens Hed may be indicated das ony Que ae 10 diferent admplinades ? : Ake mae empauity ee a foe uncteetess channel ts , Cc =f Rt Hman xe ne Aastaing Hat all 10 mage are eqquatly Ateely | Rean = leg, M 2? fog ,'® = 232. bis | mega vis Channa B.kl= 20 msq /.sec vo = j20 tNow per we fy ioc Cc = 3:32 A)2w 23866 bits )ror. A voice grade Leh hene channel hes a br 4 3y00 Ha, Ye the signal to noise Presi) eniice channel ic 20 dh, dbtermine the. cen charred: 1 tne above chanod bb te be Bed to transmit Ag Ebps of dol dotexmine the minimum sp feqd doe He channelZ 37 Ue Cop Cc sk chorel th = SATOH SIN = 3048 = 10 dog, 4(%n.) = Ankle 3 \wo C= Ww fog (1+ 5m) BHD beg, (Jel) D 33-F4 Kbps Q New SNR c= && bps n hen = 3400 beg, (1x 9n) 176 = 1 SPN Iq—s 1277 gn 2 ASB.= ze Care) + om loge i" = 1 Sten) = eo Fem) 199 rain A ao Y a < ho & — Unigene) {ei F(a) dn 3 oo ory C n Pom) da Jeg (ars?) + 3 «* Va. commen bo 2 ect , Gres*) = ley (Re We= pun) eS roe, S90) Jey 4 othe fare3b Cap. of a Gaussian Channel + ag ~__ Shannon - HarHiy fh” “he noise chav. sf channd ja Goussian. _C channels ssi aussinn noise : ee known ar _G auusicun #! chaniiols) | Moreover, Adars i}. the results ab baine {hor a sian hanvel 6} i Lower Jround won tho perarmane op —o- Se io paioaor oveadee = Gaussian Zhannel. | © us_ik a Hortiulor encod e~ decade én __useal with a Gaussian channel . an error prob. Pe then sarily a pon Gaussian —ehanne| another encnderdecoder cap ba lesigned Sox __pobich the exror pzob sill be ~ Jo | than Pe. Hence _-the rudy af a Gaussian ‘vannel ia we “amp- ‘for anne], ecu) = \ alas = + ) aire™ fare Mence sue 5 —foq—— a [+ alog 5 = 723 ¢ } For a contivmeut channel, \ =—w) WOO - = E pra) tog pew) da __()_ xe fae whe 2S ye e Penry a Bok yantng [od 2— Be —toq PO) = log Yor aby & 3 rence, Wow) = C Pn) Jog f2me"dn AZL oe +3. Pa Jog e* foo yield This oy be evaluaieel to a Ae) 2 fog fares” bes) | P39 Now, it hee 54 Dp band limites) a] OMe then. ‘Ne ren be uniquely s peddi b can taking 219 garnples -per EE) ) -_ ‘Hence the rate of informakon —— dransmissse, Ray 2 2H HOD = =H =a tog (aree*) = WwW og ( farree?)* RO) = w log (ares?) | U tim is bandlimited Gaussian pois with an ova, noise power N, then we have i Ruy) = 2 RUD = to log (2tre nl) - (ven Sour Ce ever a noisy channel. ge Now consider 4 transmibin \nforenatton the yecoived i continous ae at » composed oy | 4 transmi Hel an sive bats ©) then lhe jeint ent i) ky © source 4 noise gs = ROD + R Cn) : _ essing that tbe transmitted sy Oe aye indeperede rst Cas the FS siteechoe),ee, 35 oN) RO) + REP) ee 4 - Since athe received sig gis the sure e}- Une tx. , je Eanemited sig ot 4 toe noise 5, we py eajurake aa — saa Mey) = Can) fo" ber __| or, a Toa f = —— Sele | — BOY + HOW Y) = HOU ACD ov : HOY) RCO ROD + KOU) = ROD + Re) sox )_¥ jj) = t )__ \ [ The rate at _uolich Mae information. | AD. ecelved rom _a_naisy—chaoned is & = ROO- RC*Y) Sy using 2 Provo ahant a Ra e(r/y = Ry)-RUH) K-= Rey) = Ren) bits | s | spe channel _cap+ n bits) sec is ez man [CR] bits }e or. C= Max L ROJ=—ROpd] bits | ince Rep) ss assumed. ‘oo he independ oe mc) mandieniaing R_wequire maximiaing Diy) tek a Anangmnitted aig he Mmnited [ia_ao—auge—pomer—ak Sand —the— _naise_on Ine chanoel__be white Gaussian: woith an |Avexage power “N within the. 8.Ws woof liye _shanol. “Tha —_receh |_e1q ~ vill now Jnave an —cwy pO wer Cs+N) RLY) yp —— maa, tah _—tehen yt) fs —also__a—Gaussiab —— |; oe aesumed + xandom process Aecause boise de Gausstan- entropy rors etl °O CONN Thus second basis 1S RW) = w 105 [are cs# bits )s while he entropy of the noise Js given by Ren) = w hog Pore NI bits Js Y The channel cap. may now be obtained divecHy Since RU) hes “Leen smaximiced - ‘Thus, C= mat PRO) ROOD] ~ . o 4 = WwW fog Lorre [stn] - wo Joq[27me Nn] = Ww bog a] Cc = w leq [+e] bis Is flows eA” io tre bamous Shannon - ortey Ho? ushich in complementary to Shannon’ tot $ applies do a Gaussian The statement jn given . he eh Lintted Gusien ey ot che wahite bande hotse channe). a channel is C= w Io \4 8 ' J | w bits ls ~ whtre 5 avg SG pewer 4 Nis dhe vg, Oe is dhe ~ 40 pose iN oaks [Hy then, sided psd 4) ia is the channel Bel, site poise roveBlog hn + a) tc C= wleq fi4S | pits Js nw J \ lox. _Cateurate the But ok He plettee Cuiclin) lq ina tv, the }otlouing ove Une available data: F i) ne of Ushinguishable brightness tevels +105 ‘Sy dW no- of elements pew picker frame + 300/000 Vy) picture Yrames Franemitked pu seonzo + i) SIN pequired = 30 dB v dhe informablen pox pleture element = Wroan 2 beam Jog, 10 ; fasume Jar all le mugs 3 eso bits] element | ore quay Sealy i a the anger” per picture frame | [! i goo, wo n4->2= 396 ou0 bk | petra, | 3 pls 20 pidure trames ace transmitted pec | second’, the inform” pate uo | R= 196000K 30 = 24-4 x 10° bits }s 9 To transmit infor” ak this sate , the’ chanrel cap. C mutt je auch that, f cliw tay. [as 5) = Ww boy (14 1000) ¢ 7 S_- 30 dB=-1000 1 y ser Aunkiley 30 | Hence we mut have To j Se AST as vw Jey (lool) > 94-4016 ace AYleet ¢ —_ Ww 7 3028107 Hy, ets fiw te wins BH: anal te dranimif pe piture Sty ie a TY. vcimalehy amr. x : $ c wo toy ( its) “C! depends on tue gators i) ew Ny Sn ‘ de pe comm” ohomd ps nohrelearc —— then 9 & >< So Cc +0 New consider frat come oe MOR by et raver S/n BARE ~ Ofr0 bo wi “a t proaches ote on Parameter usill 7. a Awe wall weduce Hee value of Sip) qulltr 1s Ws me conde ral) de deme Wee nbd Ral ha oa Site, Chawel =p:ea? shows that a potseless channel [S)s) =o) yas an infinite capadhy. On the other hand the channel cap: doer not become inlinite as the bw. approaches lofioiry because, usith an P jo bw) the Mofse Power also incseases- ce 24 (asso) ye Abvsliayang ¢ dds s-) s oe 7 ing (ue) esi oppndiacnas te Q — Alon , dni. K incu = 2 azo . x= Ss then as Ww ass 1S me bl pence ome lie ss) - | Hence. = : A ly 4 wre 4 fs f = bk4& S - ee 4 27) 4 7 Rmanee = “rodeo > Ging wp 4 seventh f Pen consider the sacle - ob} lyr eeus on : the bw Ro sin role | ler os 21S) SW = Stty nN then ce w |g Cre) = Steg (1415) = age tite fa We the S/N wotlo is increased 46 9), the Bet yor te same Chemnel cap + can he wand Arom C= aos wtog (1431) ‘ w= 22 2 20 as = kre, log a = . With a Ha BA, the poise power uN) be dis Lkmeos the poise power at sth Thus doe S\% power Lai) have 4o be \ncreasesl by a Fae 4x3) =~ 6S. tp cher worls, 4 204. wedudion CNnee? ds 40 Ge requ “= ~ Incense iy tne Sig power Thus to decrec. Se Line BW, the fl) power tas te bo "neweased | Boi arly ; 2 gan be thown thag to decrease Lhe slQ— power, the bw. Mast—be 4 eo. A Gauss tan ’ Channels ches A BW. Colentate Lye channet aut A A alt power +0 nee spectral aad wa C£Iny) & Vos Hy - Abe Hind ee megti mur? informabion rote ,cs w deg fis N = Ww _dog (= 3 tae? 10% Jog a eS) : “g yor J = \ago0 bits |s Rent = S 7 ; de pba § u = 144000 bLik/s SS By > ili orb