Econometrics Chapter Three

Chapter Three
THE CLASSICAL REGRESSION ANALYSIS

Multiple Linear Regression Model
By : Habtamu Legese 2023
By: Habtamu Legese (Asst.Prof)

23/02/2023 1
https://youtube.com/@economicsbyhabtamu
3.1 Introduction
• In simple regression we study the relationship between
a dependent variable and a single explanatory
variable. But it is rarely the case that economic
relationships involve just two variables.
• Rather a dependent variable Y can depend on a whole
series of explanatory variables or regressors.
• For instance, in demand studies we study the
relationship between quantity demanded of a good and
price of the good, price of substitute goods and the
consumer’s income.
23/02/2023 2
Cont.
• The model we assume is:

23/02/2023 3
Cont.

23/02/2023 4
3.2 Assumptions of Multiple Regression Model
• In order to specify our multiple linear regression
model and proceed our analysis with regard to
this model, some assumptions are compulsory.
• But these assumptions are the same as in the

single explanatory variable model developed
earlier except the assumption of no perfect
multicollinearity.
23/02/2023 5
These assumptions are:

23/02/2023 6
Cont.

23/02/2023 7
3.3.1 Estimation of parameters of two-explanatory
variables model

23/02/2023 8
Cont.

23/02/2023 9
Cont.

23/02/2023 10
Cont.

23/02/2023 11
Cont.

23/02/2023 12
Cont.

23/02/2023 13
We know that

23/02/2023 14
Cont.

23/02/2023 15
Cont.

23/02/2023 16
• Using the Cramer’s rule, solve the following systems of
equations
2x - 3y = 1
X + 5y = 7

23/02/2023 17
Cont.

23/02/2023 18
23/02/2023 19
23/02/2023 20
23/02/2023 21
23/02/2023 22
23/02/2023 23
Variance of the parameters
Gujarati: Basic Econometrics, Fourth Edition page 208

23/02/2023 24
Cont.

23/02/2023 25
Cont.

23/02/2023 26
23/02/2023 27
23/02/2023 28
3.5. Hypothesis Testing in Multiple Regression Model
• In multiple regression models we will undertake two
tests of significance.
• One is significance of individual parameters of the

model. This test of significance is the same as the tests
discussed in simple regression model.
• The second test is overall significance of the model.

23/02/2023 29
3.5.1. Tests of individual significance

23/02/2023 30
23/02/2023 31
23/02/2023 32
23/02/2023 33
23/02/2023 34
23/02/2023 35
23/02/2023 36
3.3.2 The coefficient of determination(𝑹𝟐 ):two
explanatory variables case
• In the simple regression model, we introduced 𝑹𝟐 as a
measure of the proportion of variation in the
dependent variable that is explained by variation in the
explanatory variable.
• In multiple regression model the same measure is
relevant, and the same formulas are valid but now we
talk of the proportion of variation in the dependent
variable explained by all explanatory variables
included in the model.
23/02/2023 37
The coefficient of determination is:

23/02/2023 38
Cont.
𝟐
• If 𝑹 is low, there is no association between the
values of Y and the values predicted by the model,
𝑌෠ and the model does not fit the data well.

23/02/2023 39
23/02/2023 40
3.3.3 Adjusted Coefficient of Determination 𝑹𝟐
• One difficulty with 𝑹𝟐 is that it can be made large by adding
more and more variables, even if the variables added have no
economic justification.
• Algebraically, it is the fact that as the variables are added the
sum of squared errors (RSS) goes down (it can remain
unchanged, but this is rare) and thus 𝑹𝟐 goes up.
• If the model contains n-1 variables then 𝑹𝟐 = 1. The
manipulation of model just to obtain a high 𝑹𝟐 is not wise.
• An alternative measure of goodness of fit, called the adjusted 2
𝑹𝟐 and often symbolized as 𝑹𝟐 , is usually reported by

regression programs.
23/02/2023 41
Cont.
• It is computed as:
• This measure does not always goes up when a

variable is added because of the degree of freedom
term n-k is the numerator.

23/02/2023 42
23/02/2023 43
23/02/2023 44
3.5.2 Test of Overall Significance
• Through out the previous section we were concerned with testing
the significance of the estimated partial regression coefficients
individually, i.e. under the separate hypothesis that each of the
true population partial regression coefficient was zero.

23/02/2023 45
Cont.

23/02/2023 46
Cont.
• The test procedure for any set of hypothesis can be
based on a comparison of the sum of squared errors
from the original, the unrestricted multiple
regression model to the sum of squared errors from a
regression model in which the null hypothesis is
assumed to be true.

23/02/2023 47
Cont.

23/02/2023 48
Cont.

23/02/2023 49
Cont.

23/02/2023 50
Cont.

23/02/2023 51
Cont.

23/02/2023 52
Cont.
• If the computed value of F is greater than the critical
value of F (k-1, n-k), then the parameters of the model
are jointly significant or the dependent variable Y is
linearly related to the independent variables included
in the model.

23/02/2023 53
23/02/2023 54
23/02/2023 55
23/02/2023 56
23/02/2023 57
23/02/2023 58
23/02/2023 59
• Equating the expression to null vector 0, we obtain:

23/02/2023 60
23/02/2023 61
23/02/2023 62
23/02/2023 63
23/02/2023 64
23/02/2023 65
23/02/2023 66
23/02/2023 67
23/02/2023 68
23/02/2023 69
Thank You
23/02/2023 70

Econometrics Chapter Three

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Econometrics Chapter Three

Uploaded by

Copyright:

Available Formats

Chapter Three

THE CLASSICAL REGRESSION ANALYSIS

By : Habtamu Legese 2023

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

• But these assumptions are the same as in the

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

• One is significance of individual parameters of the

• The second test is overall significance of the model.

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

𝑹𝟐 and often symbolized as 𝑹𝟐 , is usually reported by

• This measure does not always goes up when a

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

By: Habtamu Legese (Asst.Prof)

You might also like