21 views

Uploaded by Vignesh Sathya

Statistical Theory of communication Problem set

- 41R-08 Risk Analysis and Contingency Determination Using Range Estimating
- Shannon Theories
- Statistic Book
- Introduction to the Theory and Practice of Economtrics
- A Novel Non-Shannon Edge Detection Algorithm for Noisy Images
- Probability Cheatsheet 140718
- WiMAX Cluster Cluster Optimization Report
- Math Problems Percentage
- aaoczc111 2ktfuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
- PTSPQNAUNITII
- Investigation of the Electrochemical Factors Affecting the Grinding Environment of a Porphyry Copper Sulphide Ore
- 08-Entropie
- TCS interview Questions 2
- IBPS Clerk Sample Paper 3
- sta1503_2013_trial_exam+solutions_--tl_103_2013_3_e
- ma3215_hw5b_soln.pdf
- CHA1HAC5.pdf
- Multiple Disc
- Exam 1 Solutions
- Probabilistic_load_flow_a_review.pdf

You are on page 1of 2

Problem set-1 (Information measure)

Subject: Statistical Theory of Communication

1. The inhabitants of a certain village are divided into two groups A and B.Half the people in group

A always tell the truth, 3/10 always lie,and 2/10 always refuse to answer. In group B,3/10 of the

people are truthfulm ,half are liars and 2/10 always refuse to answer.Let p be the probability that

a person selected at random will belong to group A.Let I=I(p) be the information conveyed about

a persons truth telling status by specifying his group membership.Find the maximum possible

value of I and the percentage of people in group A for which maximum occurs.

2. A single unbiased die is tossed once.If the face of the die is 1,2,3 or 4 an unbiased coin is tossed

once.If the face of the die is 5 or 6,the coin is tossed twice.Find the information conveyed about

the face of the die by the number of heads obtained.

3. Suppose that in a certain city,3/4 of the high-school students pass and 1/4 fail.Of those who pass,10

percent own cars,while 50 percent of the failing students own cars.All of the car-owning students

belong to group A,while 40 percent of those who do not own cars but pass,as well as 40 percent of

those who do not own cars but fail,belong to group A.

How much information is conveyed about a students academic standing by specifying whether

or not he owns a car?

How much information is conveyed about a studentss academic standing by specifying whether

or not he belongs to a group

If a students academic standing,car-owning status,and group A status are trasmitted by three

successive binary digits,how much information is conveyed by each digit?

4. Establish the following

H(Y, Z/X) = H(Y /X) + H(Z/X)

H(Y, Z/X) = H(Y /X) + H(Z/X, Y )

H(Z/X, Y ) H(Z/X)

5. prove that H(X, Y ) = H(X) + H(Y /X) = H(Y ) + H(X/Y )

6. Prove that H(Y /X) H(Y ) with equality if and only if X and Y are independent Given a discrete

random variable X with values x1 ,x2 ,...xM ,define the random variable Y by Y=g(X),where g is an

Figure 1:

Figure 2:

abitrary function.Show that H(Y ) H(X).Under what conditions on the function will there be

equality? [HINT:H(Y/X)=0 (why?)]

7. Apply Huffmans encoding procedure and shannon-fano encoding procedure to the following message ensemble and determine the average length of the encoded message.

P (X) = 0.18, 0.17, 0.16, 0.15, 0.10, 0.08, 0.05, 0.05, 0.04, 0.02

8. Determine the rate of transmission of the channel mentioned in figure 1.

9. The random variable as the pdf as shown in the figure 2. Find the corresponding entropy function.

10. Find the entropy of a continous random variable with the density function f (x) = bx2 , 0 x a

and 0 , otherwise.

- 41R-08 Risk Analysis and Contingency Determination Using Range EstimatingUploaded byDody Bdg
- Shannon TheoriesUploaded bygenepope
- Statistic BookUploaded bykeziavalenni
- Introduction to the Theory and Practice of EconomtricsUploaded byPatricio Padilla
- A Novel Non-Shannon Edge Detection Algorithm for Noisy ImagesUploaded byijcsis
- Probability Cheatsheet 140718Uploaded byMohit Agrawal
- WiMAX Cluster Cluster Optimization ReportUploaded byBoby Sharif
- Math Problems PercentageUploaded bykaushalm356
- PTSPQNAUNITIIUploaded bysrinivas
- aaoczc111 2ktfuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuUploaded bySaketh Dahagam
- Investigation of the Electrochemical Factors Affecting the Grinding Environment of a Porphyry Copper Sulphide OreUploaded byIonut Patras
- 08-EntropieUploaded byMOHIT KUMAR SINGH
- TCS interview Questions 2Uploaded byBaBa Somanath
- IBPS Clerk Sample Paper 3Uploaded bykapeed_sup
- sta1503_2013_trial_exam+solutions_--tl_103_2013_3_eUploaded bysal27adam
- ma3215_hw5b_soln.pdfUploaded byPei Jing
- CHA1HAC5.pdfUploaded bynavs05
- Multiple DiscUploaded bykerplah218
- Exam 1 SolutionsUploaded byrqzhu
- Probabilistic_load_flow_a_review.pdfUploaded bySyed Subhan Ahsen
- Stoc_Pres_9Uploaded byabokhaled1409
- 4 Statistical Analysis of Thermal Actions on a Concrete Segmental Box-Girder Bridge.pdfUploaded byAndrés Sánchez
- week10(3)Uploaded byjacksim1991
- Microsoft Word - PERFORtemUploaded byAnup Dey
- IBPS RRB PO Prelims 2018 - Memory Based Question Paper by AffairsCloud.pdfUploaded bySukriti Ghosh
- LecturePPTSlides_Ch10Uploaded byUsernamefire
- 4_ECE_MA2261Uploaded byBIBIN CHIDAMBARANATHAN
- Spring 2006 Test 2 SolutionUploaded byAndrew Zeller
- cap4.pdfUploaded byFrancisca Ignacia
- MAT207_APSR-syllabusUploaded byAshwin Ramesh

- SA 2 CHAP 12.pdfUploaded byVK Barack
- COMP 4211 - Machine LearningUploaded byLinh Ta
- Functional EquationsUploaded byElvin Aliyev
- Mechanical Seal PumpUploaded byPhanhai Kaka
- Silt Factor fUploaded byprasadnn2001
- A Review of DSC Kinetics Methods.pdfUploaded byChanin Ngudsuntear
- BS8100-Appendix a-Measurement and Interpretation of Wind DataUploaded byRoy Christian Coarita Tintaya
- psabits withanswersUploaded byChinnareddy Karri
- Kinetic, isotherm and thermodynamics investigation on adsorption of divalent copper using agro-waste biomaterials, Musa acuminata, Casuarina equisetifolia L. and Sorghum bicolorUploaded byRatnakaram Venkata Nadh
- Rate factors LabUploaded byAadil
- 9701_s15_qp_32.pdfUploaded byAl Beruni
- Functions AssignmentUploaded byAgrieliø De Lazø II
- Biometric Systems Components ESUploaded byPranesh
- 9701_w08_qp_5Uploaded byHubbak Khan
- Revealing Prior-Austenite Grain Boundaries in Heat-Treated SteelsUploaded bymp87_ing
- D7032.1213477-1.pdfUploaded byProm072A
- Chapter 19Uploaded byZyrine Zyrus Alayu
- Cla-Val Pressure Relief R9-08Uploaded bymodat
- 68 - Performance Based Seismic Design of Tall Building Structures - Case Study_tcm12-8478Uploaded byArdi Kurniawan
- Slope Paper 193Uploaded bygipale31
- Lecture 1; IntroductionUploaded byWasif Malik
- Digital Speedometer using FPGAUploaded byauike87
- 9 8 Intake Design (HIS)Uploaded bysenthil031277
- A 1-Bit Analog-To-Digital Converter Using Delta Sigma Modulation for Sensing in CMOS ImagersUploaded byaadil007
- Scientific American Volume 196 Issue 4 1957 [Doi 10.1038_scientificamerican0457-45] Morrison, Philip -- The Overthrow of ParityUploaded bysaurabhid
- Eurocodes for the Design of Bridges_Vortrag IQPC DarmstadtUploaded bystructural engineer 02
- ASTM D 2166-2006Uploaded byOmar Martinez
- Scr DieselUploaded byPreeti Sahu
- Map ProjectionUploaded byhimanshu1105
- High-pressure Homogenization of Raw and Pasteurized Milk MoUploaded bymfhfhf