Scribd Logo
Upload

Welcome to Scribd!

  • ITC NOTES Part 2

    Uploaded by

    Chandra Kanth
    151 views20 pages

    Original Title

    ITC NOTES Part 2

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    151 views20 pages

    ITC NOTES Part 2

    Uploaded by

    Chandra Kanth

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    of 20
    ve “Aikido helt dtanvaapelbale Lstuos<] | nb actd ied ooo ‘heli — eae clash, ound be Le / Symbols is O+2 seconds - Lolomlats tolermation vate of the Ihelagragh BOWIE « ‘ Edd: Lot We probobilelter of dosh be 'P’, dhen probable 7 a dota be “ap. : ie P+ep=l | “ p= Mg s | dha, P(dash) = calva) Pode = 2 | wy entaepy- wey — Od. ipa 7s qrven thot Dot durakwn =Tdof = 0.2 sec Dosh duration =Tdash = 3X02 = 0-6 toe _ Buasccon belwetn'Simbek = Teymibek = 0-2. Sec Now feb consider ta ahiing of 1200 &ymbols , then Noy of Dots =1200X%Pdele = 1200% 2 = S00 } Nez of dash = 1200 %Pdotx = Ino =400 7, AMES INFORMATION THEORY AND CODING __ INFORMATION THEO! Now, Leu colenlote the tetol Hime for tbe i) | = Bolt duwodion + Dash Balen liad) | = B00 XO-2--++"400%0-6-+ 1200X0.2. TT = 64d fee Hence, avg epmbot rade will be | Mig =1200 = 1200 = 1-875 Aymbels/eec | = G40 NY Information rake is given 08 Ryans: HES) bg | = 1.875 syd 'y 09163 ul a pe tn coil i ms four Fee A,B sC hath arth: dhe enbvepy .o \phie! Louies Ha Bp Hits) = zt Jog bite] meq sobat Hes) = Bh bogp + fadeg a te lep + BsoyL tloqe tltegg pat dope 4 loge = thet + erstins KANNANAVAR SG BALEKUNDRI INSTITUTE Of TECHNOLOGY. BELAGAVI PAGE Og ee IN THEORY 1OECS5 SS re G5) A Sore $8 emnilling om ¥ t Baqwerce BL | ‘Os wamd ‘I's wth probablste (ord (- -p) Fuspectively« plet the onbsepy of the source Vesa p. | Solty? the endsopy. of the doinary Some ti givenby , / a HOS) = Zi Plog 5 batke/ensg syrtol aie +e loge iy? HOS) = plogt 4 0 toy ‘+6 Plog A Bat PaO. 5 A Folly, +09 tg = o14eq ei Pao-d 5 HC) <0 lng 06 og = 09722: bbe] sym] Pe0.3'; HS= 03g tb Oflg orgs! Latif ste P=04 5 H= = Ore Jot Oo Yog= O87 birt Syme) POS 4 HES) =O5leg Yc tOSdeq 21 bite bymbs P=0-6 : HHS) = 016 fog. Yo borg ding Yoigm 0-171 dtelgete BOTs pasa Hedi ok Nae ag eae atl i P=0-8 5 Hes) =o. | ts You, = oxTra-tsty Pp=o4 5 HOD = moa toad paldenaman i A when P=0 4 HEa0, aaa Pat. $48) =0 | ete ee Ou [0.2] 0.3]0-4[0.5]o.6 [oy | 0. [0-4 is " Y Bee ie hn bd 647] 4 pans 0-4 SUNILS HARAKANNANAVAR 8G BATFRUNDRIINSTITUTE OF TECIINOLOGY, BELAGAVI PAGE 7 | a | = | pINFQHMATION THEORY AND.CODING INFORMATION THEORY. sous HCS) OD 3 4g 2 Plot of H0) vere ¥| PROPERTIES OF ENTROPY + ‘ ‘ PAAR See AD ante . < the entropy pundion 4et O Source Cp G0 with probobiltty PHLP Ree Py hare ‘g = number, of | source Atymbele, 04 { | q % : HOSS She dey = ZA Reeser Many Tokevestiny propedtes cdo dhe elsented 0 pant | Yahe zicropy functon is Kovtinunins for every irdlpelet Vortoble Re in Me Lnberval (0,1) e+, 4 Pk, Varies Confauly 4aom O41, 80 doer Die on. Entropy -pancchn) vantches ot both R=0 ord Poel te HES)=0 « ae the wtepy sundion so. surematsioal furchion itr asquenentte ie, H (Fe, (rte) |= H (U-Ped, Px) bes all kei ie, ke Valve a HCS) remains the Same frvespective ef Uke U1 tke ef ofe % oe = ee ae s eee INSTHUTE OF TECHNOLOGY, BELAGAVI PAGE 3g a PP my = eee | Pa = $2, Pa/Pi} Po = Pa PioRt : | 4H(Sx) = HSB) = HOS) 3Y EXTREMAL PROPERTY © einen Scatdn tke kowlice auth ‘of symbol: = =fsug Sy auth probabilities P= {PRR} than te aan abs tequen by, acs) = a Pr Pet >) ond Wkt, Py +Py +P +B = zy al oF: 4 BK ON: : a prove Liat tre ertheny HO cnecyet Lond oy bestng oo cpaowtit, Dato] 2+ $oqg, — HES) =[S. ny Ze (zy) Seo opin Fhe SAN (ci “) 2 : oie , ( dene eae) pe PNA pee SURI SRRARARSANTA—SCDATIRUNDR RSTTOTTOPTICTNOLGGY BEGACAV! WAG AWECSS__ sf 4 1 Graph of brag Bind pax! ard gto ci gto Gam pan Has bide Ua the eos yer Lied oboe the. logesithanic carne each reat as das the straigid’ Line forme the cue a X= | . boxes x-1 Muntlplying Ci) on be, we ge i ch eae we dn ket ie Inap; > Ua / Nunley tn 9@) both day Ps ond i ona coglel arate ai otenn Sh gels eels x] of lait yn RE) bogs Zh bn ap Snel) si xem 250, LHs es us boggles) ond RNS Cq3® iL plsayt 0- rer. Ho20 Suppose, P; se aa Eero g tathen, Re oe ea 1, this anctteties , = oped SUNILS HARAKANNANAVAR — $G BALEKUNDRI INSTITUTE OF TECHNOLOGY, BELAGAVI PAGE 0 Fw INFORMATION THEORY AND CODING INFORMATION THEORY 4 PROPERTY oF ABET Suppose Mob vse split Me Bryrnbol £4’ ‘Golo * Banb Smbde auch Urat & = 84), 84,)++-/S4n “th pct Pa Pan» Pag: +s Fan auch Ukab, Pay = Patt Ragcthe str t Fay = Zs a) |then, the plated eymbo| ‘alice a ae HH'es) Lue beste EPEC) | 9-1 ss Wel it af bia Ze bog “wae ee Tay z Seley % Binh es fog oF Bribe Fe eeloie Si | Elo Re 3s ifn fe idl gv Hics) = HES) +a eet ally Sw ; cesemrneen | | y dhe SOURCE EFFicieNcy” denoted by 1, # ppren Ly = HCs)_ Me = H SECS) mak Um “SOURCE REDUNDANCY” deweted ky Regs Le apron toy | Bole exprested io "SUNIL S HARAKANNANAVAR Ls, SEALERUNDATNSTITITEOF ‘TECHNOLOGY, BELAGAVI J0EC55 \\ +h Cs) N i AL PAGE 3, GW) Verify the role of, additivilg Aes the follows Source A | B= £649 Sa r8a Sh} vt PHL th Ma Mea Mah SP) the entropy w igen OL Hes) = ZF bog fe sae eae a ACs) = 1.658 bile /rnsy yn Faem Uke addikvite properly» we drome ‘ome + (-R 4's) rdoge +€ veqatat (W—P)S Pe beg GP) Ps Loaf PR), Pa rest ens ta” 7 I es @. A certain doth core a 5 p ys tot ce produrceal in blocks 2f four at a rate of 500 blocks) sec. «the first in coche block i£ eee the aoealeee ey emaimtng- Uk site & Symbel ree P Sieh snakes wf cheacs eet COwe . DBs Given He symbols J Tq = 500 block [sec Laser “the Sypbole eve prodvead dn bbocks f- fou, Dre total Erhepg Hr em Hy Het He cy i ‘SUNIL HARAKANNANAVAR GB ATEKUNDRIINSTITUTE OF TECHNOLOGY, BELAGAWT PNGE Sao INFORMATION THEORY AND CODING INFORMATION THEORY 108C55 Since Stnce bite olways some, Lome, no i rmadion Le Comted | die trek Sas aint card a pe i H, =0 Geter: Gpeen thet the and peso te Occuped bay Ong of Ue &n ne Hy = HO max = Log ores ign © Bete ]reg syne! Since Soimd 4 7 the He SH, =3 lots, ra op, “cin tr = = 0434943 Eohropy sade = ne vole =Re = %e the 2 Re = Sootbleths . 4 ett | Sec books ws [Re = 4500 bits/sec @} fo ovation Covet af. etka constr ee q digsts lon Pr calcd tac Ag peau nite ve ef, 2 pet bt nels. Thea eae be equal and tte tie tive ae ae ey ob ie dy wot de eye roa Repose SUNIL S| Lig ey gig |AVAR S$ G BALEKUNDRI INSTITUTE 01 LOGY, BELAGAVI PAGE 5 ANFUKMALIUN TEUK AND CODING ANFUKMALIUN LHEUKY tuELo> Talk ; ait: Gjnen * Lenglis of- digital cord =9 bets Number of bevels = 5 equapsobable ree, Enhopyly ss 0 t oot Enhopy Hy “The total embopy al 4 drgitasoed ie qren by, Hy = Hy tHy t+ + + +He a WHS ing = 109% = begs, = 29908 bien so Hy = Hg= 0 = Hq =2.328 bode] lemol <1 Wat Tfermetion content, . Hr =@) 329) ( Hy = 20-298 bats/leve} | A hbock cmd waht Ty.prctuse Cente of 595 limes 6h picture thformedion Arab Lia cock Yue Cousids of 595 pretwre ls (prxels)idund Uikat each clement Lan home ade brghtmoss levels . Pcie ore fed od tke rode ef Bo Fiames/ £ec Calonlote Uke Sea anpenetm Renee by a TV deb tp O Viewer - 3! deta numberof pixels in One frame = SA5xSi5-1I5 ps ak i atven that each pixel howe ae defferod bri t tevele from filly block be fully vole. hen se Nemmber of diljerert possibl. frames , = (9567? frames ‘SUNILSHARAKANNANAVAR $1 BALEKUNDRI INSTITUTE OF TECHNOLOGY, BELAGAVI PAGE 34. INFORMATION THEORY AND CODING INFORMATION THEORY 108055 Pek wu sium Job oll ices frames ee Athen maxinwm Se ane coaey cae 2 oe toy = log ques 5 REPS = 96.0510 bie frame se ts given Ura “e = 90 feomes/ sec! ' fesbaspiaey: tone eeaastnen cen a fat Petts HCE Ying Rs = 30 frapies » 2-205%10" bile, oe R, = 66IS X10 A dice are tersid , * hha Onteame qh ai ional of, second 03 Xs 4 duro ewovilt, one, clepined a2 fol Lous: ASfOu, Xe) such Ue ktm <7} B={» xq) Sade Urak x>x%0 G aadhich emond Lovvey mele perma ction © guppot- yous. cunenict by sruwertanl Comipustastion « Es pihen & abil lie af beat) Ainmenlanconsty, {ian Le Soumple Space’ S constete of, Be combinations ef (x1) Xe) given to, bt Ise 4 ‘SONILSHARAKANNANAWAR SG DALEKUNDRIINSTITUTE OF TECHNOLOGY, BELAGAVI PAGE 35 e INFORMA HUN TMDUIC ANU COUING INFUKMALION LEEUKY yi) 4a) CHa) Cee) &S (U9) 8 = |b.) 2a) C3) G4 @5) 4 6») Ga G9 G4 eS Gal) C9) Chay GA) Gd) 6,1) G2) (sa) GA) GE, i) Ga) (a) (6A 9 Enoch pate 8n the pace oloove Lom occur mbit a Pebble mC) =e hel tree on The event A-Containg the. pairs Given by , he =f Ci) G29 G,3) 6,4) CLS) C6) Gp Cee? (255) 3,1) (4/22) (2/4 AD GP) A) 51) 5,2) (1) I f. | Land the evert"B cenlaine tne paige : a 6 Can) (ont) (22) 1 HAY G2) 2) C253) it) Con") C6rt) C3) Cea Cb/5) $ Sinte ol the pains! Ore eqelp Se Pee) =I3 = 3 POA) = 2b Land % Wk ots Galt daformakon of, event t-Ta = logge pe ie sell dnjormetion ob event ® =Ih= te lee Heed dhe enent- B note ie x B Ke ee eet Lnosanalion X omg Y site p ies QS And 0-45 Veapecti A drwrets 2 Bouice “S' ently demo trcbepercleint symbde Lolenlate the ef rcency of Le gpurce and ste vequrdaney- SUNIL S HARAKANNANAVAR SG BALEKUNDRIINSTITUTE OF TECHNOLOGY, BELAGAVI PAGE 26 INFORMATION THEORY AND CODING INFORMATION THEORY OECSS: Given + R =POj=0-55 ; Ry =Pey=0-45 ee Entropy Hes) =z P; log St Ror $0056 log tf 0-48 Gain oe | AO) = 0-99.08 loetar] meq A” Sc Pile p Cuan) 008 O4t O31 D2 Ovit TLS Hi IANAVAR $C BALEKUNDRI INSTITUTS OF TECHNOLOGY, BELAGAVI PACE 37 INFURMALION LBEUKY AND CULING INFOKMAIIUN LUKE wes ly sil He, then Vecener o.mesiage ato 0 nine nw fe th hat Sol ai 40 Tre rac. & how world POT. infornaation theasy < View, tice Lv wmnechion, v haa mess . eee os ips horse ‘A’ 3s not runnmg , then the Sell Tformmlen of. pt horse *B’ 72 Nek Manne Aerie 'e "78 Teguecesty. ep, / rt Z£ 1.69 bite ILE hevse Bes is ee ene te b ie Ef horse E 7% Der unnieg 4 tHen, Wpdhe information vole 201 Ube. jichon the Worse ib at message » Wa 4 in at mat knewn . the mation valve of Uta message stron ardrette napus Ss known i ng et a 44.644 bile ics ie pe a Tas = og hey = a avi9a bile le OB) ten bee Yocry ty You = 30 bite ay tpateg ipdcy abe You = sete bots tee: St ncthing bt ia On To fermdpo quent, +s) ==, Par boa 7) =O. obbeg t+ Ee ponte. posites.) ae + Ont bog te HS) = 17153 bile / horse SUNIL S HARAKANNANAVAR SG \LEKUNDRI INSTITUTE OP TECHNOLOGY, BELAGAVI. PACE 3 In & faraimtle stroncinicsion -Cf piebau, Une ae a. xiof pixels {frome . For a seal os 7 2 Levele ole necesnomy Ascuinre oul rela: Osteo Likely be neous. Fond tte rote of inbormedlion, Uy ene pic we te be transmitted every 3 manvittt « tihat i2 the Sevace eb frien Hala, foctimile cdromumittes ¢ sd$; Total nurber of- purele in one frame =; .9+95 x108 “ Numbe-of brightrest fevele = 12 na es Total nvembes. of dafierent frarres posable = (2)? smee , all Ine levels are eqvolly 4 $e occu, the net~ rexttmucntoforrandinn Cenkent-per frowe eg A= HCD moe = 109.5 oteq, @Y = 2.9510" tog os [CSM = 3-066 X10" borta] Pictude Given thet One piclure te daarance tte. S romntes wee dhe vote eb Aranennsiiey PSI EB Given bi | %= — ae = + — pictus/soc Pn dhe omerage sate 0}: daformatsmn Ye queen by. Re aay HE) = Rictore x 8.066 x1d bi «- 2xXGo Sec Pryfire I) Source efeenag, aves eee =I =1oof, HC)max Sepéexi es Tee On ‘SUNILSHARAKANNANAVAR 5G BALEKUNDRIINSTI TECHNOLOGY, BELAGAVI PAGE aq g INFURMALION LALORY ANU CODING: INEUKMALION LHEUKY auecss | a Suppose Hint 8) 0nd Sy wore "two eso -remony Lources anstthy probabilities P., Pep -yPo fe Source 6 omd 1,9 +39 Fer Source. Sy » Shevw Lat the evdropy of source S, -44E8)) < Bh beyg OR | PLanen thab Ce oS ie Pe a | 2 Given Sy aund Sg ose “Zaso memomy tefonntien Soma He Hes) = =P Pe togk a) ond 2 4 | Ou 4+ ¢3 | Mc a leg gy | ae Z\m=I ‘ eS | dil Siuatl 2 . | acs) ZR ER Zp &) etl sias| does) (clea 30) Zant | ~ = ne 2h © ‘SUNILSHARAKANNANAVAR SG \LFKUNDRI INSTITUTE OF TECHNOLOGY, BELAGAVI PAGE 4.0 INFORMATION THEORY AND CODING INFORMATION THEORY 10ECSS uke, Wal cease —inx > I-x => Inx < x-l warty X =e aye hone , tn (4) & (4-1) Nal Pky taking itumenton fos oll K=12,-~9 bod al Lali ty hge Boge Zim MG) < teas Z rele] anglng £956) in © we ge, = ni Cd 16 — Zh ep & daqe(| Z azn . Sly 34 Oo ° D e- HOS —-S fy ae 0 Ser een me | EXTENSION OF ZERO-MEMoRY douRce $ OOO IOS | u \Extension Of} -Zein—memory Sources hocome: a necessity Lin, jaome of Ue Codlng + dp understand Ha lconcapt Oy source erdention fetus Conrida a. source 's sills Sr Ord Sq -nsith Fisamd By sape Such Lot) SUNIL SHARAKANNANAVAR — §G DALEKUNDRIINSTITUTE OF TECHNOLOGY, BELAGAVI ‘PAGE 4 IN aN | INFORMATION THEORY 108C35 sows. will Lome A Le P4 extended. INFORMATION THEORY AND CODING sivtloaly , the 37 extension oe i HeSi= sts) > —=—— & Drarchore, the nit extencion She basic Linos4 sill Pome 2" seymboelt ound Mike exctropy ef the wl exerted \eouece 12 ee by HS") =ntcs) S0urto #|Pxove Hot Hes = n HC) sobs Ret ue COnsicler Ure source S ={8p Sy 2 6q), voll P= SP, Py -ePy py « dia ni? extension ch thie Bouse , 3) will have gq? nuvenbes. 5 anaiedly (6 ea-- 9p) f: shies of och ef tose 6 de Gren by ple) == PCS) -PCSt2) -PCSi3) -» - oP (Sim) o EPG) 2 PCSPER CS aPCStad... 4 EPCSin) Eo Ret Cte j = s PCS) +B. PUSH) « F Plsigdeee z! (Sta) ol =I ) PCS bog |_ 6 F PCy). 7 Zep FCOZ Roan. Saty HCE) olele ceed Ras. = Hc) an | p23 s SO gt My, | awd, 3 ‘ at See: awe Zhe ee eG) a . Now aubetttae values of gb) ip Eqdqianeiget HCP) = HES) F HGS) Hees HHO Do terms, ee A a rn te ee LSE hall ct | [fe Tesi IN teeth dol vr mi sos

    You might also like