Professional Documents
Culture Documents
Statistics For Business and Economics: Simple Regression
Statistics For Business and Economics: Simple Regression
Chapter 12
Simple Regression
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-1
Correlation Analysis
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-2
Correlation Analysis
§ The population correlation coefficient is
denoted ρ (the Greek letter rho)
§ The sample correlation coefficient is
s xy
r=
sxsy
where
s xy =
å (x - x)(y - y) i i
n -1
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-3
Introduction to
Regression Analysis
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-4
Linear Regression Model
Yi = β0 + β1x i + ε i
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-5
Simple Linear Regression
Model
The population regression model:
Population Random
Population Independent Error
Slope
Y intercept Variable term
Coefficient
Dependent
Variable
Yi = β0 + β1Xi + ε i
Linear component Random Error
component
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-6
Simple Linear Regression
Model
(continued)
Y Yi = β0 + β1Xi + ε i
Observed Value
of Y for Xi
εi Slope = β1
Predicted Value
Random Error
of Y for Xi
for this Xi value
Intercept = β0
Xi X
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-7
Simple Linear Regression
Equation
The simple linear regression equation provides an
estimate of the population regression line
Estimated Estimate of Estimate of the
(or predicted) the regression regression slope
y value for intercept
observation i
Value of x for
yˆ i = b0 + b1x i observation i
ei = ( y i - yˆ i ) = y i - (b0 + b1x i )
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-8
Least Squares Estimators
= min å (y i -yˆ i )2
å (x - x)(y - y)
i i
sY
b1 = i=1
n
= rxy
sX
å i
(x
i=1
- x) x
2
b0 = y - b1x
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-11
Linear Regression Model
Assumptions
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-12
Interpretation of the
Slope and the Intercept
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-13
Simple Linear Regression
Example
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-14
Sample Data for House Price
Model
House Price in $1000s Square Feet
(Y) (X)
245 1400
312 1600
279 1700
308 1875
199 1100
219 1550
405 2350
324 2450
319 1425
255 1700
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-15
Graphical Presentation
350
300
250
200
150
100
50
0
0 500 1000 1500 2000 2500 3000
Square Feet
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-16
Regression Using Excel
§ Tools / Data Analysis / Regression
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-17
Excel Output
Regression Statistics
Multiple R 0.76211 The regression equation is:
R Square 0.58082
Adjusted R Square 0.52842 house price = 98.24833 + 0.10977 (square feet)
Standard Error 41.33032
Observations 10
ANOVA
df SS MS F Significance F
Regression 1 18934.9348 18934.9348 11.0848 0.01039
Residual 8 13665.5652 1708.1957
Total 9 32600.5000
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-18
Graphical Presentation
350 Slope
300
250
= 0.10977
200
150
100
50
Intercept 0
= 98.248 0 500 1000 1500 2000 2500 3000
Square Feet
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-19
Interpretation of the
Intercept, b0
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-20
Interpretation of the
Slope Coefficient, b1
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-21
Predictions Using
Regression Analysis
Predict the price for a house
with 2000 square feet:
= 98.25 + 0.1098(200 0)
= 317.85
The predicted price for a house with 2000
square feet is 317.85($1,000s) = $317,850
Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chap 12-22