Professional Documents
Culture Documents
Lecture 8 Information
Lecture 8 Information
• Information quality
Dimensions and Characteristics
Dimensions
Assumptions
• The world can take one of several different states.
• Each state is a complete description of reality.
• Only one of the states can hold at any time.
• The list or collection or set of all possible states is called the state space denoted
by Ω 𝑤 , containing states 𝑤1 , 𝑤 2 , ⋯ , 𝑤𝑛 .
• The set of possible states is finite (the small-world assumption).
• There are no states of which individuals are not aware.
Example
• Rolling a dice leads to the state space Ω = 1, 2, 3, 4, 5, 6 .
Information Structure
The signal can take different values or, equivalently, have different
realizations.
In the dice example, a signal can take the values 𝑜𝑑𝑑, 𝑒𝑣𝑒𝑛 and indicates
which of these events has happened.
Perfect and Void Signals
A perfect signal takes different values for each possible state, thus
creating an information structure of events with only one state in each.
[highest information content]
In reality, most signals fall between those two extremes. They do contain
some information, but are often imperfect. For example, a signal
𝑜𝑑𝑑, 𝑒𝑣𝑒𝑛 is imperfect as both realizations contain more than one
states.
Noisy Signal
There is asymmetric
information when one
information structure is finer
than another.
𝑃𝑟 𝐸 𝑃𝑟 𝐹 𝐸 = 𝑃𝑟 𝐸 ∩ 𝐹 = 𝑃𝑟 𝐹 𝑃𝑟 𝐸 𝐹
• 𝐸 is an event.
• 𝐹 is a signal related to the event.
• | means “conditional on”.
• 𝑃𝑟 𝐸 ∩ 𝐹 denotes the probability that one observes event 𝐸 and signal 𝐹.
Bayes’ Rule
Assume that an individual originally thinks that event 𝐸 will occur with
probability 𝑃𝑟 𝐸 , the prior probability. Now a signal 𝐹 comes. The prior
information then needs to be updated for the information contained in
signal 𝐹. From the prior probability 𝑃𝑟 𝐸 and the probability 𝑃𝑟 𝐹 of
signal 𝐹, the individual can infer the posterior probability of event 𝐸,
𝑃𝑟 𝐸 𝐹 , by using Bayes’ rule
𝑃𝑟 𝐸 𝑃𝑟 𝐹 𝐸
𝑃𝑟 𝐸 𝐹 =
𝑃𝑟 𝐹
Bayes’ Rule
𝑃𝑟 𝐹𝐸
The fraction can be interpreted as a correction factor affecting the
𝑃𝑟 𝐹
prior probability 𝑃𝑟 𝐸 after observing signal 𝐹.