You are on page 1of 70

# Probability and Statistics

GENG200
GENG 200

## Instructor: Dr Ahmed M. Massoud

Assistant professor,
professor Electrical Department,
Department
College of Engineering , Qatar University

00am -10:
10:00am
00am Tuesday

## 1 Qatar University, College of Engineering Dr Ahmed Massoud

Textbook
“Applied Statistics and Probability for Engineers”,
Douglas
g C. Montgomery,
g y, Arizona State University,
y,
George C. Runger, Arizona State University,
4th edition , publisher John Wiley & Sons, Inc. 2007

References
“Probability and Statistics for Engineering and the sciences”,
J L
Jay L. D
Devore
6th edition, publisher John Wiley & Sons, Inc. 2007

## 2 Qatar University, College of Engineering Dr Ahmed Massoud

Course content
Introduction
P b bilit
Probability
Discrete Random Variables and Probability Distributions
C ti
Continuous R d
Random V i bl and
Variables d Probability
P b bilit Distributions
Di t ib ti
Joint Probability Distributions
R d
Random S
Sampling
li andd Data
D Description
D i i
Point Estimation of Parameters
S i i l Intervals
Statistical I l for
f a Single
Si l Sample
S l
Tests of Hypotheses for a Single Sample and Statistical
Inference for Two Samples

## 3 Qatar University, College of Engineering Dr Ahmed Massoud

GENG 200 Assessment methods

Home work 5%
Quizzes 10%
Midterm I 20%
Midterm II 25%
Final exam 40%

## 4 Qatar University, College of Engineering Dr Ahmed Massoud

Quizzes:
5 quizzes (the best 4 quizzes will be considered)
Midterm exam dates:
Exam I week 6
Exam II week 13

Computer
p software

Statgraphics
JMP
Statisticia

Also Matlab

Chapter
p 1:
Introduction

## 7 Qatar University, College of Engineering Dr Ahmed Massoud

Probability
y versus Statistics
Probability deals with predicting the likelihood of future events,
while statistics involves the analysis of the frequency of past
events.

## Probability is primarily a theoretical branch of mathematics.

Statistics is an applied branch of mathematics.

## In summary, probability theory enables us to find the

consequences of a given ideal world, while statistical theory
enables us to measure the extent to which our world is ideal.

## 8 Qatar University, College of Engineering Dr Ahmed Massoud

In probability
 The standard example is flipping a fair coin. “Fair” means,
technically, that the probability of heads on a given flip is 50%,
andd the
h probability
b bili off tails
il on a given
i fli is
flip i 50%.
50% This
Thi doesn't
d '
mean that every other flip will give a head — after all, three
heads in a row is no surprise.
surprise

##  Another example would be flipping an unfair coin,

coin where we
know ahead of time that there's a 60% chance of heads on each
toss.

 A third
d eexample
p e wou
would
d be rolling
o ded ddie,
e, w
where
e e ((for
o
example) the chances of rolling 1, 2, 3, 4, 5, or 6 are 25%, 5%,
20%, 20%, 20%, and 10%, respectively.

## 9 Qatar University, College of Engineering Dr Ahmed Massoud

Mechanistic and Empirical Models
Models play an important role in the analysis:

##  Ohm’s law is a mechanistic model because it is built from

our underlying knowledge of the basic physical mechanism
that relates these variables.

##  an empirical model uses our engineering and scientific

knowledge of the phenomenon, but it is not directly
developed from our theoretical or first-principles
understanding
d di off the
h underlying
d l i mechanism.
h i

## 10 Qatar University, College of Engineering Dr Ahmed Massoud

2.1 Sample Spaces and Events
2.1.1 Random Experiments
If we measure the current in a thin copper wire,
wire we are conducting
an experiment. However, in day-to-day repetitions of the
measurement the results can differ slightly because of small
variations in variables that are not controlled in our experiment,
including changes in ambient temperatures and slight variations in
gauge. Consequently, this experiment is said to have a random
component.

Definition
An experiment that can result in different outcomes, even though it
i repeated
is t d in
i the
th same manner every time,ti i called
is ll d a random
d
experiment.

## 11 Qatar University, College of Engineering Dr Ahmed Massoud

Definition
The set of all possible outcomes of a random experiment is
called the sample space of the experiment.
experiment The sample space
is denoted as S.

## 12 Qatar University, College of Engineering Dr Ahmed Massoud

13 Qatar University, College of Engineering Dr Ahmed Massoud
Definition

## A sample space is discrete if it consists of a finite or

countable infinite set of outcomes.

## A sample space is continuous if it contains an interval

(either finite or infinite) of real numbers.

## 14 Qatar University, College of Engineering Dr Ahmed Massoud

15 Qatar University, College of Engineering Dr Ahmed Massoud
16 Qatar University, College of Engineering Dr Ahmed Massoud
17 Qatar University, College of Engineering Dr Ahmed Massoud
18 Qatar University, College of Engineering Dr Ahmed Massoud
19 Qatar University, College of Engineering Dr Ahmed Massoud
Definition
An event is a subset of the sample space of a random experiment.

## The union of two events is the event that consists of all

outcomes that are contained in either of the two events.

## The intersection of two events is the event that consists of all

outcomes that are contained in both of the two events.

## The complement of an event in a sample space is the set of

outcomes in the sample space that are not in the event.
event

## 20 Qatar University, College of Engineering Dr Ahmed Massoud

21 Qatar University, College of Engineering Dr Ahmed Massoud
22 Qatar University, College of Engineering Dr Ahmed Massoud
23 Qatar University, College of Engineering Dr Ahmed Massoud
24 Qatar University, College of Engineering Dr Ahmed Massoud
25 Qatar University, College of Engineering Dr Ahmed Massoud
Probability
Probability is used to quantify the likelihood that an outcome of a
random experiment will occur.
occur

“The
The chance of rain today is 30%
30%’’ is a statement that quantifies our
feeling about the possibility of rain.

## The likelihood of an outcome is quantified by assigning a number

from the interval [0, 1] to the outcome

Higher numbers indicate that the outcome is more likely than lower
numbers. A 0 indicates an outcome will not occur.
numbers occur A probability of 1
indicates an outcome will occur with certainty.

## 26 Qatar University, College of Engineering Dr Ahmed Massoud

Wh
Whenever a sample i t off N possible
l space consists ibl outcomes
t
that are equally likely, the probability of each outcome is
1/N.
N

D fi i i
Definition
For a discrete sample space, the probability of an event E,
d
denoted
d as P(E),
( ) equals
l the
h sum off the
h probabilities
b bili i off the
h
outcomes in E.

## 27 Qatar University, College of Engineering Dr Ahmed Massoud

28 Qatar University, College of Engineering Dr Ahmed Massoud
 What is the probability that it contains no particles?
 What is the probability that it contains three or more particles?

## 29 Qatar University, College of Engineering Dr Ahmed Massoud

30 Qatar University, College of Engineering Dr Ahmed Massoud
31 Qatar University, College of Engineering Dr Ahmed Massoud

## 32 Qatar University, College of Engineering Dr Ahmed Massoud

33 Qatar University, College of Engineering Dr Ahmed Massoud
What is the probability that a wafer either at the edge or it contains four
or more particles?
p

What is the probability that a wafer contains less than two particles or it
is both at the edge and contains more than four particles?

## 34 Qatar University, College of Engineering Dr Ahmed Massoud

35 Qatar University, College of Engineering Dr Ahmed Massoud
Th
Three or more events
t

## 36 Qatar University, College of Engineering Dr Ahmed Massoud

37 Qatar University, College of Engineering Dr Ahmed Massoud
CONDITIONAL PROBABILITY

## 38 Qatar University, College of Engineering Dr Ahmed Massoud

39 Qatar University, College of Engineering Dr Ahmed Massoud
Tree diagram for example 2-16

## 40 Qatar University, College of Engineering Dr Ahmed Massoud

41 Qatar University, College of Engineering Dr Ahmed Massoud
42 Qatar University, College of Engineering Dr Ahmed Massoud
Multiplication rule

## 43 Qatar University, College of Engineering Dr Ahmed Massoud

44 Qatar University, College of Engineering Dr Ahmed Massoud
Total Probability Rule (multiple events)

## 45 Qatar University, College of Engineering Dr Ahmed Massoud

46 Qatar University, College of Engineering Dr Ahmed Massoud
47 Qatar University, College of Engineering Dr Ahmed Massoud
48 Qatar University, College of Engineering Dr Ahmed Massoud
INDEPENDENCE

## 49 Qatar University, College of Engineering Dr Ahmed Massoud

50 Qatar University, College of Engineering Dr Ahmed Massoud
Example 2-24
from table 2-4,
2-4 find the probability that a part is defective if it
has surface flaws?
find the probability that a part has a surface flaws if it is
defective?
Prove that the two events are independent.

## 51 Qatar University, College of Engineering Dr Ahmed Massoud

Find the probability that the second part is defective
Check independence?

Solution:

G
Generally
ll

## 53 Qatar University, College of Engineering Dr Ahmed Massoud

54 Qatar University, College of Engineering Dr Ahmed Massoud
55 Qatar University, College of Engineering Dr Ahmed Massoud
56 Qatar University, College of Engineering Dr Ahmed Massoud
BAYES’ THEOREM

## 57 Qatar University, College of Engineering Dr Ahmed Massoud

58 Qatar University, College of Engineering Dr Ahmed Massoud
59 Qatar University, College of Engineering Dr Ahmed Massoud
Random variables

## 60 Qatar University, College of Engineering Dr Ahmed Massoud

I chapter
In h t 2: 2 probability
b bilit
1
1. Sample space and events
2. Interpretations of probability
3
4. Conditional probability
5. Multiplication and total probability rules
6. Independence
7. Bayes’ theorem
8. Random variables

Counting
g techniques
q

## 62 Qatar University, College of Engineering Dr Ahmed Massoud

Counting techniques

## 63 Qatar University, College of Engineering Dr Ahmed Massoud

64 Qatar University, College of Engineering Dr Ahmed Massoud
65 Qatar University, College of Engineering Dr Ahmed Massoud
66 Qatar University, College of Engineering Dr Ahmed Massoud
67 Qatar University, College of Engineering Dr Ahmed Massoud
68 Qatar University, College of Engineering Dr Ahmed Massoud
69 Qatar University, College of Engineering Dr Ahmed Massoud
70 Qatar University, College of Engineering Dr Ahmed Massoud