Experiment #03: Binary Arithmetic

Coding

Due Date: 4/30/2012

Binary Arithmetic Coding

This exercise is from section 4.9, problem #8.
 Generate a binary sequence of length L with P(0) = 0.8;
you can assume that the data source is IID.
 Write a small program of a binary arithmetic encoder and
encode the random binary sequence.
 Plot the difference of the rate in bits/symbol and the
estimated entropy as a function of L (L = 10 ~ 100).
Comment on the effect of L on the rate.

Note that the alphabet of a binary arithmetic

coding is only {0, 1}. You dont have to worry about
the EOS symbol since you know the length is L bits.

Hand-in for the Homework

Please write a short report to summarize your
experiments

Note: you can write your program based on the
pseudo codes in page 103, 104, and 107 of the
textbook