Professional Documents
Culture Documents
1. Introduction
2. Point Estimate
3. Maximum Likelihood Estimator
4. Interval Estimation
Definition
Let X ∼ N(µ, σ 2 ), then a point estimate is given by an approximate value for a
parameter in the distribution of X obtained from a sample. A sample mean
n
1X
X̄ = Xi (2)
n
i=1
is an estimator of variance σ 2 of X.
Definition
Let Xi for i = 1, ..., n be an independent random sample with
Xi ∼ N(µ, σ 2 ) for each i. Then an estimator of the coefficient of variation
is given by
S
κ̂ = (4)
X̄
where S and X̄ are sample standard deviation and sample mean
respectively.
Definition
Let f be a function defined on identically independent random variables
and θ be a parameter,
and if
∂L(x, θ)
=0 (6)
∂θ
∂ 2 L(x, θ)
<0 (7)
∂θ2
then the maximum among the values of θ for which (6) and (7) are
satisfied is called ’Maximum Likelihood Estimator’. L(θ) and logL(θ) have
their maxima at the same values of θ and hence, it is sometimes easier to
find the maximum of loglikelihood function.
Definition
A random sample of size n from a normal distribution has the density
function:
1 1 x−µ 2
f (x, µ, σ) = √ e − 2 ( σ ) , −∞ < µ < ∞, σ > 0. (8)
σ 2π
If µ = 0 and σ = 1, f (x; µ, σ) is known as standard normal density
function. The likelihood function of (8) is given by
1 1 2
L(X1 , X2 , ..., Xn ; µ, σ) =Πni=1 √ e − 2σ2 (xi −µ)
σ 2π
P n (9)
1 − 12 (xi −µ)2
2σ
= e i=1
(2πσ 2 )n/2
n
∂logL n 1 X 2
= − + (xi − µ) (12)
∂σ 2 2σ 2 2σ 4
i=1
Putting these derivatives equal to zero and solving the resulting equations for µ
and σ 2 ,
n
1 X
(xi − µ) = 0
σ2
i=1
n
X
=⇒ xi − nµ = 0 (13)
i=1
n
1X
=⇒ µ̂ = xi
n
i=1
Equating (12) to 0,
N(0,1)
0.3
P(Z)
0.2
1−α
0.1
−4 −2 0 2 4
X −µ x−µ
random variable Z as Z = σ and at X = x, Z = z, z = σ , then
P(−zα/2 ≤ Z ≤ zα/2 ) =1 − P(−zα/2 > Z ) + P(Z > zα/2 )
=1 − (α/2 + α/2) (16)
=1 − α.
( because α/2 is the area of the region falls left to −zα/2 as well as right
to zα/2 as shown in the figure)
If there is a sample of normally distributed random variables X1 , X2 , ..., Xn
then z is given by
x̄ − µ
z= √ (17)
σ/ n
where x̄ is sample mean, µ is normal mean, σ is standard deviation and n
is sample size.