Professional Documents
Culture Documents
Regression Models
To accompany
Quantitative Analysis for Management, Tenth Edition,
by Render, Stair, and Hanna © 2008 Prentice-Hall, Inc.
Power Point slides created by Jeff Heyl © 2009 Prentice-Hall, Inc.
Learning Objectives
After completing this chapter, students will be able to:
4.1 Introduction
4.2 Scatter Diagrams
4.3 Simple Linear Regression
4.4 Measuring the Fit of the Regression
Model
4.5 Using Computer Software for
Regression
4.6 Assumptions of the Regression
Model
10 –
Sales ($100,000)
8–
6–
4–
2–
| | | | | | | |
0 0– 1 2 3 4 5 6 7 8
Payroll ($100 million)
Figure 4.1
where
Y= dependent variable (response)
X= independent variable (predictor or explanatory)
0= intercept (value of Y when X = 0)
1= slope of the regression line
= random error
Yˆ b0 b1 X
where
Y^ = dependent variable (response)
X = independent variable (predictor or explanatory)
b0 = intercept (value of Y when X = 0)
b1 = slope of the regression line
Y = Sales
X = Area payroll
The line chosen in Figure 4.1 is the one that
minimizes the errors
X
X
average (mean) of X values
n
Y
Y
average (mean) of Y values
n
b1
( X X )(Y Y )
(X X ) 2
b0 Y b1 X
© 2009 Prentice-Hall, Inc. 4 – 14
Triple A Construction
Regression calculations
Y X (X – X)2 (X – X)(Y – Y)
6 3 (3 – 4)2 = 1 (3 – 4)(6 – 7) = 1
8 4 (4 – 4)2 = 0 (4 – 4)(8 – 7) = 0
9 6 (6 – 4)2 = 4 (6 – 4)(9 – 7) = 4
5 4 (4 – 4)2 = 0 (4 – 4)(5 – 7) = 0
4.5 2 (2 – 4)2 = 4 (2 – 4)(4.5 – 7) = 5
9.5 5 (5 – 4)2 = 1 (5 – 4)(9.5 – 7) = 2.5
ΣY = 42 ΣX = 24 Σ(X – X)2 = 10 Σ(X – X)(Y – Y) = 12.5
Y = 42/6 = 7 X = 24/6 = 4
Table 4.2
X
X 24
4
6 6
Y
Y 42
7
6 6
b1
( X X )(Y Y ) 12.5
1.25
(X X ) 2
10
b0 Y b1 X 7 (1.25 )( 4 ) 2
Therefore Yˆ 2 1.25 X
© 2009 Prentice-Hall, Inc. 4 – 16
Triple A Construction
Regression calculations
X
X 24
4
6 6 sales = 2 + 1.25(payroll)
Y
Y 42
7
If the payroll next
year is $600 million
6 6
b1
ˆ
( X X )(Y YY
1.5
) 2 12 .25(6) 9.5 or $ 950,000
1.25
(X X ) 2
10
b0 Y b1 X 7 (1.25 )( 4 ) 2
Therefore Yˆ 2 1.25 X
© 2009 Prentice-Hall, Inc. 4 – 17
Measuring the Fit
of the Regression Model
Regression models can be developed
for any variables X and Y
How do we know the model is actually
helpful in predicting Y based on X?
We could just take the average error, but
the positive and negative errors would
cancel each other out
Three measures of variability are
SST – Total variability about the mean
SSE – Variability about the regression line
SSR – Total variability that is explained by
the model
© 2009 Prentice-Hall, Inc. 4 – 18
Measuring the Fit
of the Regression Model
Sum of the squares total
SST (Y Y )2
SSE e 2 (Y Yˆ )2
SSR (Yˆ Y )2
An important relationship
SST SSR SSE
Table 4.3
SST = 22.5
Sum of the squared error SSE = 6.875
SSRˆ=2 15.625
SSE e (Y Y )
2
SSR (Yˆ Y )2
An important relationship
SST SSR SSE
8– ^
Y–Y Y
6–
SSR
4–
2–
| | | | | | | |
0 0– 1 2 3 4 5 6 7 8
Payroll ($100 million)
Figure 4.2
r r2
r 0.6944 0.8333
Program 4.1A
© 2009 Prentice-Hall, Inc. 4 – 26
Using Computer Software
for Regression
Program 4.1B
© 2009 Prentice-Hall, Inc. 4 – 27
Using Computer Software
for Regression
Program 4.1C
© 2009 Prentice-Hall, Inc. 4 – 28
Using Computer Software
for Regression
Program 4.1D
© 2009 Prentice-Hall, Inc. 4 – 29
Using Computer Software
for
Correlation coefficient is
Regression
called Multiple R in Excel
Program 4.1D
© 2009 Prentice-Hall, Inc. 4 – 30
Multiple Regression Analysis
Multiple regression models are
extensions to the simple linear model
and allow the creation of models with
several independent variables
Y = 0 + 1X1 + 2X2 + … + kXk +
where
Y= dependent variable (response variable)
Xi = ith independent variable (predictor or
explanatory variable)
0 = intercept (value of Y when all Xi = 0)
I = coefficient of the ith independent variable
k= number of independent variables
= random error
© 2009 Prentice-Hall, Inc. 4 – 31
Multiple Regression Analysis
To estimate these values, a sample is taken
the following equation developed
Yˆ b0 b1 X 1 b2 X 2 ... bk X k
where
Ŷ = predicted value of Y
b0 = sample intercept (and is an estimate
of 0)
bi = sample coefficient of the ith variable
(and is an estimate of i)
Program 4.2
Yˆ 146631 44 X 1 2899 X 2
© 2009 Prentice-Hall, Inc. 4 – 35
Evaluating Multiple Regression Models