There are many useful identities in information theory, some of which are easy to prove but difficult to come up with in the first place. Therefore, I decided to collect them here. This article can also serve as a starting point for a second course on information theory.

This is the first draft of my notes on probability. An updated version is available at http://prapun.googlepages .com/.