28 views

Uploaded by syed02

as2

- Point-To-Point Radio Link Engineering
- lect10
- vol9_4_47en
- Umts Chap6
- rsh_qam11_tif_14.doc
- Jsac Eh Review Article
- 04 98 374 Gaming Development Fundamentals
- OFDM and MIMO Multiuser Scheduling
- Fundamentals of Information Theory and Coding Design
- Ready-Posed_3D_Human_vol_2.pdf
- Lab 2
- Header Files
- Channel Capacity.pptx
- Erd
- 06283726The Approximate Sum Capacity of the Symmetric Gaussian K-User Interference Channel
- leadership quality management.docx
- Setar Models
- Ready-Posed 3D Human Vol 1
- Detecting Circular Shapes From Areal Images Using Median Filter and CHT
- Computer Graphics

You are on page 1of 2

TC-502 Information Theory

Assignment number 2

1. The joint probability matrix for two random variables X and Y is given below. Compute H(X),

H(Y), H(X; Y), H(X|Y), H(Y|X), I(X;Y).

X\Y y1 y2 y3 y4

x1 0.05 0 0.2 0.05

x2 0 0.1 0.1 0

x3 0 0 0.2 0.1

x4 0.05 0.05 0 0.1

2. Given H(B|A) = 0.83, H(A) = 0.92, and H(A|B) = 0.73. Find H(B), H(A, B), and I(A, B).

incorrectly (as a 1) and correctly transmits a 1 (as a 1) three times more often than transmitting it

incorrectly (as a 0). The input to the channel can be assumed equiprobable.

(a) What is the channel matrix P? Sketch the channel.

(b) Calculate the output probabilities, P(b).

(c) Calculate the backward channel probabilities, P(a|b).

4. Two Binary Symmetric Channels are connected in cascade, as shown in the figure below.

(b) Draw the channel diagram for the resultant channel.

(c) Find P(z1) and P(z2) if P(x1) = 0.6 and P(x2) = 0.4.

(a) Find the output probabilities if P(x1) = and P(x2) = P(x3) = .

(b) Find the output entropy H(Y).

6. Consider a binary symmetric communication channel, whose input source is the alphabet X =

{0, 1} with probabilities {0.5, 0.5}; whose output alphabet is Y = {0, 1}; and whose channel

matrix is

1

=

1

Where is the probability of transmission error.

(a) What is the entropy of the source, H(X)?

(b) What is the probability distribution of the outputs, p(Y), and the entropy of this output

distribution, H(Y)?

(c) What is the joint probability distribution for the source and the output, p(X; Y), and

what is the joint entropy, H(X; Y)?

(d) What is the mutual information of this channel, I(X; Y)?

(e) How many values are there for for which the mutual information of this channel is

maximal? What are those values, and what then is the capacity of such a channel in bits?

(f) For what value of is the capacity of this channel minimal? What is the channel

capacity in that case?

1 1

0

= 2 2

0 0 1

(a) Draw the channel diagram.

(b) Find the channel capacity.

- Point-To-Point Radio Link EngineeringUploaded bycharlo_badje1766
- lect10Uploaded bynishasaiyed2304
- vol9_4_47enUploaded bybaruaeee
- Umts Chap6Uploaded byNguyenDucTai
- rsh_qam11_tif_14.docUploaded byJay Brock
- Jsac Eh Review ArticleUploaded byAmit Dost
- 04 98 374 Gaming Development FundamentalsUploaded bymoobiilee
- OFDM and MIMO Multiuser SchedulingUploaded byjameelahmad
- Fundamentals of Information Theory and Coding DesignUploaded byQuang Minh Nguyen
- Ready-Posed_3D_Human_vol_2.pdfUploaded byAntezanaFernando
- Lab 2Uploaded byHamid Ali
- Header FilesUploaded byzuto1
- Channel Capacity.pptxUploaded byAshley Seesurun
- ErdUploaded byĴëfřÿ Ĵŭvëñťîńí
- 06283726The Approximate Sum Capacity of the Symmetric Gaussian K-User Interference ChannelUploaded byBakoury1
- leadership quality management.docxUploaded byselinasimpson361
- Setar ModelsUploaded byAnthony Alarcón Moreno
- Ready-Posed 3D Human Vol 1Uploaded byAntezanaFernando
- Detecting Circular Shapes From Areal Images Using Median Filter and CHTUploaded byTI Journals Publishing
- Computer GraphicsUploaded bymdharma;
- quality management system diagram.docxUploaded byselinasimpson361
- Dem Case StudyUploaded byChandra Aji Saputra
- Reglas de Catalogación Angloamericanas.pdfUploaded byAntonio Silva Vera
- Mfa-merit Unit 2 Matlab Graphics-5168Uploaded byFrancisco Javier Villaseca Ahumada
- quality assurance quality management.docxUploaded byselinasimpson381
- 4547323Uploaded byAnonymous l7c8qLZWV
- Leaf Severity Measurement SeminarUploaded bypgakare
- The Object Character Intelligence Recognition With Detection and Tracking Object Via SURFUploaded bypagefic
- Outlier modification in Fuzzy Linear Regression with Fuzzy input and output using Tw based arithmetic operationsUploaded byJournal of Computing

- 12.Friend FunctionUploaded bysyed02
- 05 Full Wave RectUploaded bysyed02
- Templates 1Uploaded bysyed02
- 22 Class B Power AmplfiersUploaded bysyed02
- Cal 2 Assignment 2Uploaded bysyed02
- 14 I-V Analysis of BJTUploaded bysyed02
- 14 I-V Analysis of BJTUploaded bysyed02
- 07 ClippersUploaded bysyed02
- Computer Programming WK1Uploaded bysyed02
- 04 RectificationUploaded bysyed02
- 10 Zener.pdfUploaded bysyed02
- Intro L1(22Jan)Uploaded bysyed02
- 10 ZenerUploaded bysyed02
- 06 FiltersUploaded bysyed02
- Chapter-2 lec-4 practice questions.docxUploaded bysyed02
- AssignmentUploaded bysyed02
- Lecture+03Uploaded bysyed02
- Lecture+03Uploaded bysyed02
- Muslim Rule in India 712-1857Uploaded byShair Zaman Bhutto
- Writing PracticeUploaded bysyed02
- Academic vs Non-Academic Ariting-essay ProcessUploaded bysyed02
- Lecture+15+_Structures_Uploaded bysyed02
- Lecture 9Uploaded byKamal Joshi
- Lecture++12+_Pointers_Uploaded bysyed02
- Lecture+16+_More+on+Structures_Uploaded bysyed02
- thedeclineofmughals-Uploaded bysyed02
- thedeclineofmughals-Uploaded bysyed02
- 02 PN JunctionUploaded bysyed02
- Conquest+of+SindhUploaded bysyed02
- Assignment (1)Uploaded bysyed02

- Symantec Installation Procedure AP-0800-0025Uploaded bymrrsiddiqui
- 845PE Max2 (MS-6704)v1.0Uploaded byPapee90
- Allen 04 Loop InterchangeUploaded bydarezzo.guido
- IVMSUploaded byMoises Alejandro Hidalgo
- IRAT Analysis (2)Uploaded byBrandon Sanders
- Tutorial Sol No 10Uploaded byAudrey Patrick Kalla
- Dynamic Web Based platform for Vehicle PoolingUploaded byIJSTE
- CUPS Printing in Linux UNIX for Intermec Printers Tech BriefUploaded byj2448910
- BackYard Rowhomes Andersonville Chicago BrochureUploaded byHeather Gustafson
- Shear Strength and Deformation Capacity of InteriorUploaded bysokamanty
- Proposed New Noise Ordinance - 10.30Uploaded byBilly Smith
- Coe4dk4 Outline 2017 v01Uploaded byAndrew
- Delay Analysis Methodology in Construction ProjectsUploaded bysarathirv6
- Mainframe RefresherUploaded bybpks_0132912
- Advanced Steel Design_HW_3_mastan1Uploaded byYogeshUnde
- Powerpoint for PerturbationUploaded byronric razales
- Apollo Price ListUploaded byJack Chavan
- TANCETUploaded byPrakash Natarajan
- Metering Pumps H1 Series Novados 2 2 2 UKUploaded byRaquel Estrada Torres
- asdasd.pdfUploaded byWilliam
- Business jet aircraft cabin interiorsUploaded byusakalamba
- NN40171-505_01.04_remoteworkerconfig.pdfUploaded byMichelle G. Chong
- 11.Lecture Rock Mechanics TGL in Situ Stress-WK11Uploaded byFebrianto Mangopo
- PNX8500Uploaded byGrosan Sergiu
- Computational Complexity - Christos PapadimitriouUploaded byaempinto028980
- Case Study Elective 2Uploaded byrexieace
- LogUploaded bythemici
- AnyBus Ethernet DualPortUploaded bypwmvsi
- A. Inoue (Auth.), Professor Akihisa Inoue, Professor Koji Hashimoto (Eds.)-Amorphous and Nanocrystalline Materials_ Preparation, Properties, And Applications-SpringeUploaded byunknown1711
- SPAMFighter Mail GatewayUploaded byscrib_nok