You are on page 1of 11

# MS&E 252 Handout #12

## Homework Assignment #3 Solutions

40 1.00

0.90
35

0.80
30
0.70

25
0.60

20 0.50

0.40
15

0.30
10
0.20

5
0.10

0 0.00
-INF - 0 0.5 - 1 1.5 - 2 2.5 - 3 3.5 - 4 4.5 - 5 5.5 - 6 6.5 - 7 7.5 - 8 8.5 - 9 9.5 - 10

Question 1

10% 50%
90%
Question 2

10% 50%
90%
Question 3

Question 4

Question 5

10% 50%
90%
Question 6

10% 50%
90%
Question 7

10% 50%
90%
Question 8

10% 50%
90%
Question 9

Question 10

## -2.50 -2.00 -1.50 -1.00 -0.50 0.00 0.50 1.00

Score on HW Question (./1)

Page 1 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Distinctions
An expert:
• has powerful distinctions and knows how they relate to each other,
• in some cases, has required physical skills,
• knows the history and borders of the field, and
• has humility (and knows what he or she does not know)
We define clairvoyance as information, which resolves all uncertainty about an
uncertain distinction. We call the PIBP of clairvoyance on a distinction the value
of clairvoyance on that distinction.
We define a distinction as a thought, which separates one large group of things
into two or more smaller groups. We call the small groups the degrees of the
distinction. We require the degrees to be mutually exclusive (a thing only falls
into one degree) and collectively exhaustive (a thing will always fall into one of
the degrees). We can create several kinds of distinctions over the same large
group; for example, we can create the two distinctions "sex" and "hair length"
over the group "humans."
We call a distinction clear when it satisfies the clarity test. This means that a
clairvoyant could, without exercise of judgment, tell in which degree any
particular thing falls.
We call a distinction observable when we "know it when we see it." In other
words, the decision maker could tell in which degree any particular thing falls.
We call a distinction useful when it
• means what we want it to mean, and/or
• helps us achieve clarity of action.
Decision Basis:
• Alternatives are what you can do. Need more than one.
• Preferences are what you want. You must care about what might happen.
• Information is what you know. Information links what you want to what
you can do.
The probability of an event is a number from 0 to 1 describing a person's beliefs
about the likelihood of that event occurring. Since a probability describes a
person's belief, we say that it is conditioned on that person's background state of
information (written &), or the sum of all that person's knowledge and
experience, which affects his or her belief.
An associative logic error occurs when a person confuses conditional
probabilities for one another. For example, if a person thinks that since most
hemophiliacs are male, most males are hemophiliac. In probabilistic notation, if a
person thinks that since {A | B, &} is large, then {B | A, &} must also be large.
We use the word associative, since people who make this error think that A and B
are associated with each other, and thus tend to occur together. The opposite of
associative logic we call distinctive logic.
We say that two uncertain distinctions are relevant when knowledge of one will
affect our beliefs about the other. In probabilistic notation, A is relevant to B
given & if and only if {A | B, &} {A | ¬B, &}.
Page 2 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

We call a possibility a possible event that could occur, usually with a particular
probability.

Probabilistic questions
1) Solution: b
If we define events A & B as follows:
A: At least one quarter lands “heads”
B: Both quarters land “heads”
Then we’re interested in finding: p{B|A&}
From the problem’s statement: p{(H,H)|&}= p{(H,T)|&}= p{(T,H)|&}=p{(T,T)|&}=0.25
It follows that: p{B|A&} = p{(H,H)|&}/[p{(H,H)|&}+ p{(H,T)|&}+ p{(T,H)|&}] =
0.25/0.75 = 1/3

2) Solution: a
We’re interested in finding: p{A|B’&}
From the problem’s statement: p{B|&}=0.82 and p{A’B’|&}=0.08
Clearly: p{A’B’|&}=p{A’|B’&}* p{B’|&}
This can be rewritten as: p{A’B’|&}=[1-p{A|B’&}]*[1- p{B|&}]
Solving for p{A|B’&}, we obtain:
p{A|B’&}=1- p{A’B’|&}/[1- p{B|&}]=1-0.08/(1-0.82)=1-0.08/0.18=0.1/0.18=0.56

3) Solution: d
It is important for distinctions to pass the clarity test because clear distinctions make for
effective communication among all parties in a decision. Answer (a) is incorrect because
the value of information does not have anything to do with the clarity of a distinction.
Answer (b) is incorrect because there is no such person as a clairvoyant; it is only an
imaginary construct to aid in thinking about decisions. Answer (c) is incorrect because we
cannot really begin to assign probabilities to outcomes unless those outcomes are clearly
defined, let alone the fact that it is never coherent nor necessary to use a range of
probabilities to describe uncertainties.

4) Solution: c
Statement I is true: If A and B are mutually exclusive, p{A and B|&}=0. If A and B are
irrelevant, p{A and B|&} = p{A|&} p{B|&}=0. But p{A|&} 0 and p{B|&} 0 by
assumptions. And so A and B cannot be irrelevant
Statement II is true: Let us suppose that A and B are irrelevant. We have p{A and B|&} =
p{A |&} p{B|&}.
We always have: p{A or B|&} = p{A|&}+ p{B|&} - p{A and B|&}.
And so p{A or B|&} = p{A|&}+ p{B|&} - p{A |&} p{B|&}
= p{A |&} (1 - p{B|&}) + p{B|&} < 1 * (1 - p{B|&}) + p{B|&} = 1
So p{A or B|&} < 1. A and B cannot be collectively exhaustive.
Statement III is true: it is clearly an example of associative logic error
Page 3 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Statement IV is false: Knowing Berkeley’s chances against UCSD and Stanford’s chances
against Berkeley do not necessarily say anything about Stanford’s chances against UCSD.

5) Solution: d
b) corresponds to a diagram without any arrow. c) corresponds to a diagram with arrows
pointing from C to B, A to B and A to C. This corresponds to a cycle and this cannot be a
valid relevance diagram. d) is correct. a) does not correspond to any given diagram and is
false. Indeed, we generally do not have {C|A,&}{C|B,&} = {C|A,B,&}

6) Solution: b
Let A, B, and C be outcomes, so that A corresponds to the outcome “A is scheduled to be
executed,” and so on. Let “A,” “B,” and “C” denote what the guard says, so that “A”
corresponds to “A is pardoned.” We want to compute the following probability: P{A |
“B”, &}. The problem statement gives us the values of
P{A | &}, P{B | &}, P{C | &},
P{“B” | A, &}, P{“B” | B, &}, P{“B” | C, &},
P{“C” | A, &}, P{“C” | B, &}, P{“C” | C, &}.
From this information we can construct the following probability tree:

“B”
1/6
1/2
A
1/3
1/2
1/6
“C”
“B”
0
0
1/3
B
1
1/3
“C”
“B”
1/3
1
1/3
C
0
0
“C”

## Now to compute P{A | “B”, &}, we flip the tree as follows:

Page 4 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

A
1/6
1/3

“B” 0
0
0.5 B

2/3
1/3
C
A
1/6
1/3

0.5 2/3
1/3
“C” B

0 0
C
The answer we want is circled. The guard has not given Prisoner A any useful
information, since A’s probability assignment for his own execution has not changed.

7) Solution: b
The original probability tree is:
NY
0.056
Small 0.7
0.2 0.3
SF 0.024
I-Banking
0.4 NY
0.32
0.8 1
Large 0
0
SF
NY
0.03
Small 0.5
0.1 0.5
0.6 SF 0.03
Consulting NY
0.27
0.9 0.5
Large 0.5
SF 0.27

Flip the tree to make location and industry the first and second distinctions:

Page 5 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Small
0.056
I-Banking 0.149
0.556 0.851
NY Large 0.32
0.676 Small
0.03
0.444 0.1
Consulting 0.9
0.27
Large
Small
0.024
I-Banking 1
0.074 0
0.324 Large 0
SF Small
0.03
0.926 0.1
Consulting 0.9
Large 0.27
The conditional probability is circled in the previous tree. b) is the correct answer.

8) Solution: d
Flip the tree to make firm size and location the first and second distinctions:
I-Banking
0.056
NY 0.651
0.614 0.349
Small Consulting 0.03
0.14 I-Banking
0.024
0.386 0.444
SF 0.556
0.03
Consulting
I-Banking
0.32
NY 0.542
0.686 0.458
0.86 Consulting 0.27
Large I-Banking
0
0.314 0
SF 1
Consulting 0.27

Page 6 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

The conditional probability is circled in the previous tree. d) is the correct answer.

9) Solution: d

Using the given elemental probabilities, we can draw a tree and fill in its branch
probabilities:
A
0.15
Easy 0.5
0.6 0.5
0.15
Lazy B or Less
0.5 A
0.02
0.4 0.1
Difficult 0.9
0.18
B or Less
A
0.27
Easy 0.9
0.6 0.1
0.5 0.03
B or Less
Hard-Working A
0.12
0.4 0.6
Difficult 0.4
0.08
B or Less
Statement I is false – a student is as likely to be lazy as to be hard-working given &, since
{Y = “Lazy” | &} = {Y = “Hard-Working” | &} = 0.5.

Statement II is true – as shown by the probabilities that were circled in the tree above, {X
= “Easy” | Y = “Lazy”, &} = 0.6 = {X = “Easy” | Y = “Hard-Working”, &}.

Statement III is true – as shown by the probabilities that are surrounded by a box in the
tree above, {Z = “A” | Y = “Hard-Working”, X = “Difficult”} = 0.6 > 0.5 = {Z = “A” | Y
= “Lazy”, X = “Easy”}.

Statement IV is true – we need to flip the tree to see this, by making Z the first distinction
in the tree (see flipped tree below). Once this is done, we can see from the conditional
probabilities of Y that X is relevant to Y given Z: for example, the two conditional
probabilities that were circled on the tree below do not match.

Page 7 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Lazy
0.15
Easy 0.36
0.75 0.64
0.27
A Hard-Working
0.56 Lazy
0.02
0.25 0.14
Difficult 0.86
0.12
Hard-Working
Lazy
0.15
Easy 0.83
0.41 0.17
0.44 0.03
Hard-Working
B or Less Lazy
0.18
0.59 0.69
Difficult 0.31
0.08
Hard-Working

10) Solution: b

Diagram a) implies that Y and X are irrelevant given Z, which we know from the
previous question to be false (see statement IV).

Diagram d) implies that Z and X are irrelevant given Y, which we know from the first of
the two probability trees above to be false.

Diagrams b) and c) are both compatible with the fact that Z is relevant to Y given X and
with the fact that Z is relevant to X given Y. However, c) also implies a possibility of
relevance between X and Y given &, which we know to be false (see statement II).
Therefore, although both diagrams are compatible with the probability distribution
provided, b) best describes the relationships in this distribution because it reflects this
stronger and true statement about the independence of X and Y given &.

Quantitative Problems
1)
Part a)
Remember that your PIBP should not depend on the \$2000 market buying price, but only
on your use of the cheese.

Page 8 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Part b)
When you determine your bid, you will probably consider the \$2000 market buying price.
This means that your bid may exceed your PIBP.

Part c)
The main difference between your PIBP and the amount you would bid are market
considerations. In this case, the main effect is the ability to resell the cheese for \$2000.

2)
Aruna wants to maximize her e-score, what probability, p, should she write down for
She should assign 0.7 to the probability of (a) being correct.
Aruna’s e-score is:
100 100 ln( p ) 100 100 ln((1 − p ) / 3)
.7*( + ) + .3 *( + )
15 15 ln(4) 15 15 ln(4)
If you take the derivative of this expression with respect to p, you will find that the
maximum occurs at p=0.7. The best strategy is to assign your true beliefs. It is called a
“strictly proper scoring rule.”

3) Weather

Part a)
Here are some useful clarity test definitions.
• R = During the 3-hour party, it rains .05 inches in any 15 minute period, measured in
the center of the outdoor party area.
• W = The temperature does not drop below 65°F at all and doesn't drop below 70°F for
any 15 minute period, as measured in the center of the outdoor party area.

One may find it difficult to say when the clarity test is satisfied, but may often use the
heuristic of asking other people if they understand what is meant by both the distinctions.
Think for yourself whether or not the above definitions pass the clarity test.

Part b)
Here are some definitions of the different probabilistic information.
• {¬R|&} = the probability that it does not rain, given only my background state of
information.
• {W|¬R, &} = the probability that it will be warm, given only that it doesn't rain and
my background state of information.
• {¬R|W, &} = the probability that it doesn't rain, given only that it will be warm and
my background state of information.
• {¬R,W|&} = the probability that it doesn't rain and it will be warm, given only my
background state of information.

Page 9 of 11 HW #3 Solutions
MS&E 252 Handout #12
Decision Analysis I October 26th, 2004

Part c)
Each of you may have different models of the weather to explain the relevance or lack of
relevance between R and W. However, the relevance between R and W does not
necessarily mean that one causes the other. Relevance does not imply causation.

Part d)
We wrote this question to give you practice thinking about probabilities and flipping
trees.

4) Die
Part a)
The possibilities are {1, 2, 3, 4, 5, 6}. Here is a tree expressing equal probability for each
possibility.
1
1/6

2
1/6

3
1/6

1/6
4

1/6
5

1/6
6

Part b)
pdf
1/6

1 2 3 4 5 6

1
Cumulative
5/6
4/6
3/6
2/6
1/6
Excess
1 2 3 4 5 6

Page 10 of 11 HW #3 Solutions