Problem Sheet

1. How much information is gained when a die is thrown and (i) a four occurs (ii) a four or a
six occurs (iii) any number occurs?

[2.58 bits, 1.58 bits, 0 bits]

2. A newspaper picture consists of 50 rows and 40 columns of black and white dots. Calculate
the information in the picture if black and white dots are (a) equally probable (b) the
probability of white dots is three times that of black dots.

[2000 bits, 1622 bits]

3. The Chinese alphabet consists of more than 10,000 characters, although only 6000 are in
general use, so how much information is gained when a single Chinese character appears?
[12.55 bits]
4. How much information is gained by the appearance of a single decimal number in English
text?

[3.32 bits]