Sharlyn Mae E.

Pangan BSIT 2-1AA

1. Assume that there are 4 equiprobable input states, such as 𝑥1 = 35, 𝑥2 = 65, 𝑥3 = 95, and 𝑥4 = 125 and
3 equiprobable values for the channel noise, such as 𝜂1 = 5, 𝜂2 = 10, and 𝜂3 = 15, identify the
following:
a. Input Entropy
𝑚𝑥 = 4
(𝑥) = 𝑙𝑜𝑔2𝑚𝑥
(𝑥) = 𝑙𝑜𝑔2(4)
𝑯(𝒙) = 𝟐 𝒃𝒊𝒕𝒔
b. Noise Entropy
𝑚𝜂 = 3
(𝜂) = 𝑙𝑜𝑔2𝑚𝜂
(𝜂) = 𝑙𝑜𝑔23
𝑯(𝜼) = 𝟏. 𝟓𝟖 𝒃𝒊𝒕𝒔
c. Outputs of each equiprobable input states
𝑦 = 𝑥 + , 𝜂1 = 5, 𝜂2 = 10, 𝜂3 = 15
𝑥1 = 35
𝒚𝟏 = 𝑥1 + 𝜂1 = 35 + 5 = 40
𝒚𝟐 = 𝑥1 + 𝜂2 = 35 + 10 = 45
𝒚𝟑 = 𝑥1 + 𝜂3 = 35 + 15 = 50
𝑥2 = 65
𝒚𝟒 = 𝑥2 + 𝜂1 = 65 + 5 = 70
𝒚𝟓 = 𝑥2 + 𝜂2 = 65 + 10 = 75
𝒚𝟔 = 𝑥2 + 𝜂3 = 65 + 15 = 80
𝑥3 = 95
𝒚𝟕 = 𝑥3 + 𝜂1 = 95 + 5 = 100
𝒚𝟖 = 𝑥3 + 𝜂2 = 95 + 10 = 105
𝒚𝟗 = 𝑥3 + 𝜂3 = 95 + 15 = 110
𝑥4 = 125
𝒚𝟏𝟎 = 𝑥4 + 𝜂1 = 125 + 5 = 130
𝒚𝟏𝟏 = 𝑥4 + 𝜂2 = 125 + 10 = 135
𝒚𝟏𝟐 = 𝑥4 + 𝜂3 = 125 + 15 = 140

d. Output Entropy
𝑚𝑦 = 12
(𝑦) = 𝑙𝑜𝑔2𝑚𝑦
(𝑦) = 𝑙𝑜𝑔212
𝑯(𝒚) = 𝟑. 𝟓𝟖

Double check:
𝐻(𝑦) = 𝐻(𝑥) + 𝐻(𝜂)
(𝑦) = 2 + 1.58
𝑯(𝒚) = 𝟑. 𝟓𝟖