Professional Documents
Culture Documents
@Elisabetta Pellini 2
Error Normality Assumption
@Elisabetta Pellini 3
Error Normality Assumption
@Elisabetta Pellini 4
Error Normality Assumption
@Elisabetta Pellini 5
Error Normality Assumption
@Elisabetta Pellini 6
Sampling Distribution of the OLS Estimators
𝛽𝛽̂𝑗𝑗 by subtracting its mean (𝛽𝛽𝑗𝑗 ) and dividing by its standard deviation
(𝑠𝑠𝑠𝑠 𝛽𝛽̂𝑗𝑗 ):
𝛽𝛽̂𝑗𝑗 − 𝛽𝛽𝑗𝑗
~𝑁𝑁 0,1
̂
𝑠𝑠𝑠𝑠 𝛽𝛽𝑗𝑗
• Since the 𝑠𝑠𝑠𝑠 𝛽𝛽̂𝑗𝑗 is unknown, we use its estimator SE 𝛽𝛽̂𝑗𝑗 and we obtain
the following statistic:
𝛽𝛽̂𝑗𝑗 − 𝛽𝛽𝑗𝑗
~𝑡𝑡 𝑛𝑛 − 𝑘𝑘 − 1
̂
𝑆𝑆𝑆𝑆 𝛽𝛽𝑗𝑗
@Elisabetta Pellini 8
Sampling Distribution of the OLS Estimators
𝛽𝛽̂𝑗𝑗 − 𝛽𝛽𝑗𝑗
~𝑡𝑡 𝑛𝑛 − 𝑘𝑘 − 1
̂
𝑆𝑆𝑆𝑆 𝛽𝛽𝑗𝑗
• This is called the t statistic or t test. Given that we have replaced 𝑠𝑠𝑠𝑠 𝛽𝛽̂𝑗𝑗
with 𝑆𝑆𝑆𝑆 𝛽𝛽̂𝑗𝑗 , then the probability distribution of the t statistic is the
Student’s t-distribution with 𝑛𝑛 − 𝑘𝑘 − 1 degrees of freedom, where n is
the number of observations, k is the number of slope parameters (or
regressors) and 1 stands for the intercept
@Elisabetta Pellini 9
Interval Estimation
@Elisabetta Pellini 10
Interval Estimation
�𝑗𝑗 −𝛽𝛽𝑗𝑗
𝛽𝛽
• Using the fact that �𝑗𝑗 ) has a Student’s t distribution with 𝑛𝑛 − 𝑘𝑘 − 1
𝑆𝑆𝑆𝑆(𝛽𝛽
degrees of freedom, we can make the following statement:
�𝑗𝑗 −𝛽𝛽𝑗𝑗
𝛽𝛽
𝑃𝑃 −𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,𝛼𝛼 ⁄2 < �𝑗𝑗 ≤ 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,𝛼𝛼 ⁄2 = 1 − 𝛼𝛼
𝑆𝑆𝑆𝑆 𝛽𝛽
where 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,𝛼𝛼 ⁄2 is the critical value from the Student’s t distribution
such that the probability of finding a value larger than that is (𝛼𝛼⁄2)
@Elisabetta Pellini 11
Interval Estimation
𝑃𝑃 𝛽𝛽̂𝑗𝑗 − 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,𝛼𝛼 ⁄2 𝑆𝑆𝑆𝑆 𝛽𝛽̂𝑗𝑗 < 𝛽𝛽𝑗𝑗 < 𝛽𝛽̂𝑗𝑗 + 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,𝛼𝛼 ⁄2 𝑆𝑆𝑆𝑆 𝛽𝛽̂𝑗𝑗 = 1 − 𝛼𝛼
@Elisabetta Pellini 12
Interval Estimation
𝑃𝑃 𝛽𝛽̂𝑗𝑗 − 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,0.025 𝑆𝑆𝑆𝑆 𝛽𝛽̂𝑗𝑗 < 𝛽𝛽𝑗𝑗 < 𝛽𝛽̂𝑗𝑗 + 𝑡𝑡 𝑛𝑛−𝑘𝑘−1 ,0.025 𝑆𝑆𝑆𝑆 𝛽𝛽̂𝑗𝑗 = 0.95
@Elisabetta Pellini 13
Interval Estimation: A practical Example
@Elisabetta Pellini 14
Interval Estimation: A practical Example
• We estimate with 95% confidence that if ROE=0 then the expected salary is
between $425,558 and $1,109,500 (note that salary is in thousands$)
• We estimate with 95% confidence that an increase in ROE of one
percentage point will lead to an increase in the expected salary between
$1,175.4 𝑎𝑎𝑎𝑎𝑎𝑎 $30,594.6
@Elisabetta Pellini 15
Hypothesis Testing in the Linear Regression Model
@Elisabetta Pellini 16
Hypothesis Testing in the Linear Regression Model
@Elisabetta Pellini 17
Hypothesis Testing in the Linear Regression Model
• Using an econometric model we can test this theory. Let’s consider the
simple regression model:
𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 = 𝛽𝛽0 + 𝛽𝛽1 𝑅𝑅𝑅𝑅𝑅𝑅 + 𝜀𝜀
@Elisabetta Pellini 18
Hypothesis Testing in the Linear Regression Model
@Elisabetta Pellini 19
Testing Hypothesis about a Single Population Parameter: the t Test
@Elisabetta Pellini 20
Testing Hypothesis about a Single Population Parameter: the t Test
• How can we check if the evidence against the null is strong enough to
reject it?
• We can use 𝛽𝛽̂1 , the estimate of the population parameter that we obtained
from the sample of data. If the null hypothesis is true, a sample value of
𝛽𝛽̂1 far away from zero (the null hypothesis) provides evidence against
the null
• Given that there is some sampling variability in the estimate 𝛽𝛽̂1 , the
distance of 𝛽𝛽̂1 from the hypothesized value under the null has to be
weighed against the standard error of 𝛽𝛽̂1
@Elisabetta Pellini 21
Testing Hypothesis about a Single Population Parameter: the t Test
@Elisabetta Pellini 22
Testing Hypothesis about a Single Population Parameter: the t Test
�1
𝛽𝛽
𝑡𝑡 = �1 ) ~𝑡𝑡𝑛𝑛−𝑘𝑘−1
𝑆𝑆𝑆𝑆(𝛽𝛽
@Elisabetta Pellini 23
Testing Hypothesis about a Single Population Parameter: the t Test
𝛼𝛼 = 0.05
0 Critical
value
@Elisabetta Pellini 24
Testing Hypothesis about a Single Population Parameter: the t Test
• Thus, if the t statistic, calculated using the sample of data, is larger than the
critical value, then we should reject the null hypothesis
𝛼𝛼 = 0.05
@Elisabetta Pellini 25
Testing Hypothesis about a Single Population Parameter: the t Test
𝛽𝛽̂1
𝑡𝑡 = > 𝑡𝑡𝑛𝑛−𝑘𝑘−1,0.05
𝑆𝑆𝑆𝑆(𝛽𝛽̂1 )
Crit. Value:
𝑡𝑡𝑛𝑛−𝑘𝑘−1,0.05
@Elisabetta Pellini 26
• In our example, suppose we
select 𝛼𝛼 = 0.05.
@Elisabetta Pellini 27
Testing Hypothesis about a Single Population Parameter: the t Test
𝐻𝐻0 : 𝛽𝛽1 = 0
�1
𝛽𝛽
𝐻𝐻1 : 𝛽𝛽1 > 0 • From the data: t = �1 ) =
𝑆𝑆𝑆𝑆(𝛽𝛽
15.885
≈ 2.33
6.81
Crit.
Value:
1.77
@Elisabetta Pellini 28
Testing Hypothesis about a Single Population Parameter: the p-value
• The p-value of the test statistic is the probability of getting the observed
value of the test statistic or a value with even greater evidence against
the null, if the null is true
α= 0.05
p-value=0.018
1.77 2.33
Here: 𝑃𝑃 𝑡𝑡 > 2.33 = 0.018 it is smaller than 0.05, so we reject the null hypothesis at
5% significance level
@Elisabetta Pellini 29
P-Value
• Guideline:
• If 0.05 ≤ 𝑝𝑝 − 𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣 < 0.10: some weak evidence against the null
@Elisabetta Pellini 30
Testing Hypothesis about a Single Population Parameter: the t Test
𝐻𝐻0 : 𝛽𝛽1 = 0
𝐻𝐻1 : 𝛽𝛽1 < 0
• In this case, we reject the null
hypothesis in favour of the
alternative hypothesis if the t
statistic takes on a value
smaller than the critical value
�1
𝛽𝛽
t= �1 )
𝑆𝑆𝑆𝑆(𝛽𝛽
< −𝑡𝑡𝑛𝑛−𝑘𝑘−1,0.05
Crit. Value:
−𝑡𝑡𝑛𝑛−𝑘𝑘−1,0.05
@Elisabetta Pellini 31
Testing Hypothesis about a Single Population Parameter: the t Test
• In this type of test, if we reject the null hypothesis 𝐻𝐻0 : 𝛽𝛽𝑗𝑗 = 0 at say 5%
significance level, we say that: x is statistically significant or statistically
different from zero at the 5% level
@Elisabetta Pellini 32
Testing Hypothesis about a Single Population Parameter: the t Test
@Elisabetta Pellini 33
• In our example, suppose we select
as significance level for the test
𝛼𝛼 = 0.05 so that 𝛼𝛼 = 0.025
@Elisabetta Pellini 34
Testing Hypothesis about a Single Population Parameter: the p-value
• In a two-tailed test, the p-value corresponds to the sum of the upper- and
lower-tail probabilities for the positive and negative values of the t
statistic
α/2 = 0.025 α/2 = 0.025
p-value/2=0.018 p-value/2=0.018
@Elisabetta Pellini 35
Testing Other Hypotheses about a Single Population Parameter
• Although 𝐻𝐻0 : 𝛽𝛽𝑗𝑗 = 0 is the most common hypothesis, we may sometimes want
to test other hypotheses
𝐻𝐻0 : 𝛽𝛽𝑗𝑗 = 𝑎𝑎 against 𝐻𝐻1 : 𝛽𝛽𝑗𝑗 ≠ a or against 𝐻𝐻1 : 𝛽𝛽𝑗𝑗 > a or 𝐻𝐻1 : 𝛽𝛽𝑗𝑗 < a
• In this case we would say 𝛽𝛽̂𝑗𝑗 is statistically different from “a” (or
larger/smaller than “a”)
@Elisabetta Pellini 36
Testing Other Hypotheses about a Single Population Parameter
• If the null hypothesis is 𝐻𝐻0 : 𝛽𝛽𝑗𝑗 = 𝑎𝑎, then the null is rejected against the
alternative 𝐻𝐻1 : 𝛽𝛽𝑗𝑗 ≠ 𝑎𝑎 at the 5% significance level if the value a is not
contained in the 95% confidence interval
@Elisabetta Pellini 37
Testing hypothesis in the CAPM
• 𝑟𝑟𝑖𝑖 and 𝑟𝑟𝑓𝑓 are the returns to a given security and the risk-free rate,
respectively
• 𝑟𝑟𝑚𝑚 is the return on the market portfolio
• 𝛽𝛽 is the security’s ‘‘beta’’ value, which measures the sensitivity of a given
security return to variation in the whole stock market return. Values of
beta less than 1 indicate that the security is ‘‘defensive’’ (or less risky than
the market) since its variation is less than the market’s. A beta greater than
1 indicates an ‘‘aggressive stock” (or riskier than the market)
@Elisabetta Pellini 38
Testing hypothesis in the CAPM
• 𝛽𝛽1 is not observable from the market, but it can be estimated with the
method that we have seen
• Typically 𝑟𝑟𝑓𝑓 , the risk-free rate, is the rate on short-term Treasury Bills,
while a broad stock market index is used as a proxy for the market (FTSE
All-Share, FTSE100, S&P500…)
@Elisabetta Pellini 39
Testing hypothesis in the CAPM
for a stock using five years of monthly data, that is T=60 observations, and find
the following result:
Standard errors
• 𝛽𝛽̂1 = 1.347. This value is larger than 1, thus the stock appears to be
“aggressive” or riskier than the market. However we cannot conclude that
the estimated beta is statistically larger than 1 and hence that the stock is
indeed riskier than the market, unless we conduct a test of hypothesis
@Elisabetta Pellini 40
Testing hypothesis in the CAPM
𝐻𝐻1 : 𝛽𝛽1 > 1 (the stock is riskier than the market. The alternative
hypothesis is the one that the researcher supports)
@Elisabetta Pellini 41
Testing hypothesis in the CAPM
@Elisabetta Pellini 42
Testing for Abnormal Excess Returns- Jensen’s alpha
• In the model:
• Testing for the presence and significance of abnormal returns was first
done by Jensen (1968)
@Elisabetta Pellini 43
Testing for Abnormal Excess Returns- Jensen’s alpha
• 𝐻𝐻0 : 𝛼𝛼 = 0
• 𝐻𝐻1 : 𝛼𝛼 ≠ 0
• A positive and significant 𝜶𝜶 for a given stock would suggest that the
stock is able to earn significant abnormal returns or able to “beat the
market”
@Elisabetta Pellini 44
Testing for Abnormal Excess Returns- Jensen’s alpha
�
𝛼𝛼 0.0138
The test statistic is: 𝑡𝑡 = = = 1.169
𝑆𝑆𝑆𝑆(�𝛼𝛼) .0118
@Elisabetta Pellini 45
References
@Elisabetta Pellini 46