# Welcome back

## Find a book, put up your feet, stay awhile

Sign in with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more

Download

Standard view

Full view

of .

Look up keyword

Like this

Share on social networks

57Activity

×

0 of .

Results for: No results containing your search query

P. 1

ProbabilityRatings: (0)|Views: 819|Likes: 76

Published by api-3855803

See more

See less

https://www.scribd.com/doc/7340657/Probability

03/18/2014

text

original

Massachusetts Institute of Technology

Course Notes 10

6.042J/18.062J, Fall \u201902: Mathematics for Computer Science

November 4

Professor Albert Meyerand Dr. Radhika Nagpal

revised November 6, 2002, 572 minutes

Introduction to Probability

1 Probability

Probability will be the topic for the rest of the term. Probability is one of the most important sub- jects in Mathematics and Computer Science. Most upper level Computer Science courses require probability in some form, especially in analysis of algorithms and data structures, but also in infor- mation theory, cryptography, control and systems theory, network design, arti\ufb01cial intelligence, and game theory. Probability also plays a key role in \ufb01elds such as Physics, Biology, Economics and Medicine.

There is a close relationship between Counting/Combinatorics and Probability. In many cases, the probability of an event is simply the fraction of possible outcomes that make up the event. So many of therules we developed for \ufb01nding the cardinality of \ufb01nite sets carry over to Proba- bility Theory. For example, we\u2019ll apply an Inclusion-Exclusion principle forprobabilities in some examples below.

In principle, probability boils down to a few simple rules, but it remains a tricky subject because these rules often lead unintuitive conclusions. Using \u201ccommon sense\u201d reasoning about probabilis- tic questions is notoriously unreliable, as we\u2019ll illustrate with many real-life examples.

This reading is longer than usual . To keep things in bounds, several sections with illustrative examples that do not introduce new concepts are marked \u201c[Optional].\u201d You should read these sections selectively, choosing those where you\u2019re unsure about some idea and think another ex- ample would be helpful.

2 Modelling Experimental Events

One intuition about probability is that we want to predict how likely it is for a given experiment

to have a certain kind of outcome. Asking this question invariably involves four distinct steps:

Find the sample space.Determine all the possible outcomes of the experiment.

De\ufb01ne the event of interest.Determine which of those possible outcomes is \u201cinteresting.\u201d

Determine the individual outcome probabilities.Decide how likely each individual outcome is

to occur.

Determine the probability of the event.Combine the probabilities of \u201cinteresting\u201d outcomes to

\ufb01nd the overall probability of the event we care about.

In order to understand these four steps, we will begin with a toy problem. We consider rolling

three dice, and try to determine the probability that we roll exactly two sixes.

Copyright \u00a9 2002,Prof. Albert R. Meyer. All rights reserved.

2

Course Notes 10: Introduction to Probability

Step 1: Find the Sample Space

Every probability problem involves some experiment or game. The key to most probability prob- lems is to look carefully at thesample space of the experiment. Informally, this is the set of all pos- sible experimentaloutcomes. An outcome consists of the total information about the experiment after it has been performed. An outcome is also called a \u201csample point\u201d or an \u201catomic event\u201d.

In our die rolling experiment, a particular outcome can be expressed as a triple of numbers from 1 to 6. For example, the triple(3, 5, 6) indicates that the \ufb01rst die rolled 3, the second rolled 5, and the third rolled 6.1

Step 2: De\ufb01ne Events of Interest

We usually declare some subset of the possible outcomes in the sample space to be \u201cgood\u201d or

\u201cinteresting.\u201d Any subset of the sample space is called anevent.

For example, the event that all dice are the same consists of six possible outcomes

{(1, 1, 1), (2, 2, 2), (3, 3, 3), (4, 4, 4), (5, 5, 5), (6, 6, 6)}.

LetT be the event that we roll exactly two sixes.T has3\u00b7 5 = 15 possible outcomes: we need to

choose which die is not a six, and then we need to choose a value for that die. Namely,

T::={(1,6,6),(2,6,6),(3,6,6),(4,6,6),(5,6,6),

(6, 1, 6), (6, 2, 6), (6, 3, 6), (6, 4, 6), (6, 5, 6),

(6, 6, 1), (6, 6, 2), (6, 6, 3), (6, 6, 4), (6, 6, 5)}

Our goal is to determine the probability that our experiment yields one of the outcomes in this set

T.

Step 3: Specify Outcome Probabilities

Assign a real number between zero and one, called aprobability, to each outcome of an experiment

so that the sum of the probabilities of all the outcomes is one. This is called specifying aprobability

spaceappropriate to the experiment. We use the notation, Pr{w}, to denote the probability of an

outcomew.

Assigning probabilities to the atomic outcomes is anaxiomatic action. One of the philosophical bases for probability says that the probability for an outcome should be the fraction of times that we expect to see that outcome when we carry out a large number of experiments. Thinking of the probabilities as fractions of one whole set of outcomes makes it plausible that probabilities should be nonnegative and sum to one.

In our experiment (and in many others), it seems quite plausible to say that all the possible out-

comes are equally likely. Probability spaces of this kind are calleduniform:

1Notice that we\u2019re assuming the dice are distinguishable\u2014say they are different colors\u2014so we know which is which.

We would need a different sample space of outcomes if we regarded the dice asindistinguishable.

possible poker hands, we saw that

\u2022 There are 624 \u201cfour of a kind\u201d hands, so the probability of 4 of a kind is624/

\ue000

52

5

\ue001

Course Notes 10: Introduction to Probability

3

De\ufb01nition 2.1.Auniform probability space is a \ufb01nite space in which all the outcomes have the

same probability. That is, ifS is the sample space, then

Pr{w}=1

|S|

for every outcomew\u2208S .

Since there are63 = 216 possible outcomes, we axiomatically declare that each occurs with proba-

bility1/216.

Step 4: Compute Event Probabilities

We now have a probability for each outcome. To compute the probability of the event,T , that we get exactly two sixes, we add up the probabilities of all the outcomes that yield exactly two sixes. In our example, since there are15 outcomes inT , each with probability1/216, we can deduce that Pr{T }= 15/216.

Probability on a uniform sample space such as this one is pretty much the same as counting. Another example where it\u2019s reasonable to use a uniform space is for poker hands. Instead of asking how many distinct full houses there are in poker, we can ask about the probability that a \u201crandom\u201d poker hand is a full house. For example, of the

\ue000

52

5

\ue001

= 1/4165.

\u2022 There are 3744 \u201cfull house\u201d hands, so the probability of a full house is6/4165\u2248 1/694.

\u2022 There are 123,552 \u201ctwo pair \u201d hands, so the probability of two pair\u22481/21.

3 The Monty Hall Problem

In the 1970\u2019s, there was a game showcalledLet\u2019s Make a Deal, hosted by Monty Hall and his as- sistant Carol Merrill. At one stage of the game, a contestant is shown three doors. The contestant knows there is a prize behind one door and that there are goats behind the other two. The con- testant picks a door. To build suspense, Carol always opens adifferent door, revealing a goat. The contestant can then stick with his original door or switch to the other unopened door. He wins the prize only if he now picks the correct door. Should the contestant \u201cstick\u201d with his original door, \u201cswitch\u201d to the other door, or does it not matter?

This was the subject of an\u201cAsk Marilyn\u201d column inParade Magazine a few years ago. Marilyn wrote that your chances of winning were2/3 if you switched \u2014 because if you switch, then you win if the prize was originally behind either of the two doors you didn\u2019t pick. Now, Marilyn has been listed in theGuiness Book of World Records as having the world\u2019s highest IQ, but for this answer she got a tidal wave of critical mail, some of it from people with Ph.D.\u2019s in mathematics, telling her she was wrong. Most of her critics insisted that the answer was 1/2, on the grounds that the prize was equally likely to be behind each of the doors, and since the contestant knew he was going to see a goat, it remains equally likely which the two remaining doors has the prize behind it. The pros and cons of these argumentsstill stimulate debate.

You've already reviewed this. Edit your review.

1 hundred reads

1 thousand reads

cmtinv liked this

manjunathgy liked this

janmejay10 liked this

Anuradha Vasudeva liked this

zashakeel liked this

Nico Geotina liked this

gmschennai20037601 liked this

deepak chugh liked this

- Read and print without ads
- Download to keep your version
- Edit, email or read offline

© Copyright 2015 Scribd Inc.

Language:

Choose the language in which you want to experience Scribd:

Sign in with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

Password Reset Email Sent

Join with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

By joining, you agree to our

read free for one month

Personalized recommendationsbased on books you love

Syncing across all your devices

Join with Facebook

or Join with EmailSorry, we are unable to log you in via Facebook at this time. Please try again later.

Already a member? Sign in.

By joining, you agree to our

to download

Personalized recommendationsbased on books you love

Syncing across all your devices

Continue with Facebook

Sign inJoin with emailSorry, we are unable to log you in via Facebook at this time. Please try again later.

By joining, you agree to our

Are you sure?

This action might not be possible to undo. Are you sure you want to continue?

CANCEL

OK

You've been reading!

NO, THANKS

OK

scribd