Professional Documents
Culture Documents
GENERAL PROBABILITY
GENERAL PROBABILITY UNIVARIATE PROBABILITY
UNIVARIATE PROBABILITY *Moment Generating Function (MGF)
DISTRIBUTIONS
DISTRIBUTIONS 𝑀𝑀' (𝑡𝑡) = E[𝑒𝑒 3' ]
Basic Probability Relationships 𝑀𝑀4'56 (𝑡𝑡) = 𝑒𝑒 63 ⋅ 𝑀𝑀' (𝑎𝑎𝑎𝑎)
Pr(𝐴𝐴 ∪ 𝐵𝐵) = Pr(𝐴𝐴) + Pr(𝐵𝐵) − Pr(𝐴𝐴 ∩ 𝐵𝐵) *Learn both discrete and continuous cases 𝑀𝑀' (0) = 1
Pr(𝐴𝐴 ∪ 𝐵𝐵 ∪ 𝐶𝐶) 𝑀𝑀'57 (𝑡𝑡) = 𝑀𝑀' (𝑡𝑡) ⋅ 𝑀𝑀7 (𝑡𝑡) (independent)
= Pr(𝐴𝐴) + Pr(𝐵𝐵) + Pr(𝐶𝐶) *Probability Mass Function (PMF) 𝑑𝑑#
𝑀𝑀 (𝑡𝑡)[ = E[𝑋𝑋 # ]
− Pr(𝐴𝐴 ∩ 𝐵𝐵) − Pr(𝐵𝐵 ∩ 𝐶𝐶) − Pr(𝐴𝐴 ∩ 𝐶𝐶) ∑()) + 𝑝𝑝' (𝑥𝑥) = 1 𝑑𝑑𝑡𝑡 # ' 3$0
+ Pr(𝐴𝐴 ∩ 𝐵𝐵 ∩ 𝐶𝐶) Pr(𝑋𝑋 = 𝑎𝑎) = 0 (continuous)
Pr(𝐴𝐴! ) = 1 − Pr(𝐴𝐴) Probability Generating Function (PGF)
*Cumulative Distribution Function 𝑃𝑃' (𝑡𝑡) = E[𝑡𝑡 ' ]
Law of Total Probability (CDF) 𝑃𝑃' (𝑡𝑡) = 𝑀𝑀' (ln 𝑡𝑡)
#
𝐹𝐹' (𝑥𝑥) = Pr(𝑋𝑋 ≤ 𝑥𝑥) = ∑",+ 𝑝𝑝' (𝑖𝑖) 𝑃𝑃' (0) = 𝑝𝑝' (0)
Pr(𝐵𝐵) = . Pr(𝐵𝐵 ∩ 𝐴𝐴" ) 𝑑𝑑#
Pr(𝑎𝑎 < 𝑋𝑋 ≤ 𝑏𝑏) = 𝐹𝐹' (𝑏𝑏) − 𝐹𝐹' (𝑎𝑎) 𝑃𝑃 (𝑡𝑡)[
"$%
- 𝑑𝑑𝑡𝑡 # ' 3$0
𝑓𝑓' (𝑥𝑥) = 𝐹𝐹 (𝑥𝑥) (continuous) = 𝑝𝑝' (𝑛𝑛)
-+ ' 𝑛𝑛!
De Morgan’s Law 𝑑𝑑#
Pr[(𝐴𝐴 ∪ 𝐵𝐵)! ] = Pr(𝐴𝐴! ∩ 𝐵𝐵! ) 𝑃𝑃 (𝑡𝑡)[ = E[𝑋𝑋(𝑋𝑋 − 1) … (𝑋𝑋 − 𝑛𝑛 + 1)]
*Expected Value 𝑑𝑑𝑡𝑡 # ' 3$%
Pr[(𝐴𝐴 ∩ 𝐵𝐵)! ] = Pr(𝐴𝐴! ∪ 𝐵𝐵! ) E[𝑐𝑐] = 𝑐𝑐
.
E[𝑔𝑔(𝑋𝑋)] = ∫/. 𝑔𝑔(𝑥𝑥) ⋅ 𝑓𝑓' (𝑥𝑥) 𝑑𝑑𝑑𝑑 Percentiles
Conditional Probability . The 100𝑝𝑝th percentile is the smallest value
E[𝑔𝑔(𝑋𝑋)] = ∫0 𝑔𝑔! (𝑥𝑥) ⋅ 𝑆𝑆' (𝑥𝑥) 𝑑𝑑𝑑𝑑,
Pr(𝐴𝐴 ∩ 𝐵𝐵) of 𝜋𝜋8 where 𝐹𝐹' _𝜋𝜋8 ` ≥ 𝑝𝑝.
Pr(𝐴𝐴|𝐵𝐵) = for 𝑥𝑥 ≥ 0 and 𝑔𝑔(0) = 0
Pr(𝐵𝐵)
&
∫1 𝑔𝑔(𝑥𝑥) ⋅ 𝑓𝑓' (𝑥𝑥) 𝑑𝑑𝑑𝑑
E[𝑔𝑔(𝑋𝑋)|𝑗𝑗 ≤ 𝑋𝑋 ≤ 𝑘𝑘] = Univariate Transformation
Independence Pr(𝑗𝑗 ≤ 𝑋𝑋 ≤ 𝑘𝑘) 𝑑𝑑
Pr(𝐴𝐴 ∩ 𝐵𝐵) = Pr(𝐴𝐴) ⋅ Pr(𝐵𝐵) E[𝑐𝑐 ⋅ 𝑔𝑔(𝑋𝑋)] = 𝑐𝑐 ⋅ E[𝑔𝑔(𝑋𝑋)] 𝑓𝑓7 (𝑦𝑦) = 𝑓𝑓' [𝑔𝑔/% (𝑦𝑦)] ⋅ [ 𝑔𝑔/% (𝑦𝑦)[
𝑑𝑑𝑑𝑑
Pr(𝐴𝐴|𝐵𝐵) = Pr(𝐴𝐴) E[𝑔𝑔% (𝑋𝑋) + ⋯ + 𝑔𝑔& (𝑋𝑋)] where 𝑦𝑦 = 𝑔𝑔(𝑥𝑥) ⇔ 𝑥𝑥 = 𝑔𝑔/%(𝑦𝑦)
= E[𝑔𝑔% (𝑋𝑋)] + ⋯ + E[𝑔𝑔& (𝑋𝑋)]
Bayes’ Theorem
Pr(𝐵𝐵|𝐴𝐴& ) ⋅ Pr(𝐴𝐴& ) Variance, Standard Deviation, and
Pr(𝐴𝐴& |𝐵𝐵) = #
∑"$% Pr(𝐵𝐵|𝐴𝐴" ) ⋅ Pr(𝐴𝐴" ) Coefficient of Variation
Var[𝑋𝑋] = E[𝑋𝑋 2 ] − (E[𝑋𝑋])2
Combinatorics Var[𝑎𝑎𝑎𝑎 + 𝑏𝑏] = 𝑎𝑎2 ⋅ Var[𝑋𝑋]
𝑛𝑛! = 𝑛𝑛 ⋅ (𝑛𝑛 − 1) ⋅ … ⋅ 2 ⋅ 1 Var[𝑐𝑐] = 0
𝑛𝑛! SD[𝑋𝑋] = UVar[𝑋𝑋]
#𝑃𝑃& =
(𝑛𝑛 − 𝑘𝑘)!
CV[𝑋𝑋] = SD[𝑋𝑋]⁄E[𝑋𝑋]
𝑛𝑛 𝑛𝑛!
#𝐶𝐶& = :𝑘𝑘 ; =
(𝑛𝑛 − 𝑘𝑘)! ⋅ 𝑘𝑘!
Continuous Distributions
Symmetry:
(+/C)" 𝑋𝑋 − 𝜇𝜇 Pr(𝑍𝑍 ≤ 𝑧𝑧) = Pr(𝑍𝑍 ≥ −𝑧𝑧)
1 / 𝑍𝑍 =
⋅ 𝑒𝑒 2D" , 𝜎𝜎 D"3 " Pr(𝑍𝑍 ≤ −𝑧𝑧) = Pr(𝑍𝑍 ≥ 𝑧𝑧)
Normal 𝜎𝜎√2𝜋𝜋 𝜇𝜇 𝜎𝜎 2 𝑒𝑒 C35 2
−∞ < 𝑥𝑥 < ∞ Pr(𝑍𝑍 ≤ 𝑧𝑧) = Φ(𝑧𝑧) Sum of independent normals ~
Normal_𝜇𝜇 = ∑#"$% 𝜇𝜇" , 𝜎𝜎 2 = ∑#"$% 𝜎𝜎"2`
K
𝑋𝑋, 𝑋𝑋 < 𝑢𝑢 ∫0 𝑥𝑥 ⋅ 𝑓𝑓' (𝑥𝑥) 𝑑𝑑𝑑𝑑 + 𝑢𝑢 ⋅ 𝑆𝑆' (𝑢𝑢) For exponential:
Policy Limit 𝑌𝑌 = †
𝑢𝑢, 𝑋𝑋 ≥ 𝑢𝑢 K
∫0 𝑆𝑆' (𝑥𝑥) 𝑑𝑑𝑑𝑑 𝜃𝜃 ⋅ Pr(𝑋𝑋 < 𝑢𝑢)