Professional Documents
Culture Documents
Regression
1
Introduction to Linear Regression
• The Pearson correlation measures the
degree to which a set of data points form a
straight line relationship.
• Regression is a statistical procedure that
determines the equation for the straight
line that best fits a specific set of data.
2
Introduction to Linear Regression (cont.)
5
Introduction to Linear Regression (cont.)
6
Introduction to Linear Regression (cont.)
• The ability of the regression equation to
accurately predict the Y values is
measured by first computing the
proportion of the Y-score variability that is
predicted by the regression equation and
the proportion that is not predicted.
8
Introduction to Linear Regression (cont.)
9
Introduction to Linear Regression (cont.)
11
Introduction to Multiple Regression
with Two Predictor Variables
• In the same way that linear regression
produces an equation that uses values of
X to predict values of Y, multiple
regression produces an equation that uses
two different variables (X1 and X2) to
predict values of Y.
• The equation is determined by a least
squared error solution that minimizes the
squared distances between the actual Y
values and the predicted Y values.
13
Introduction to Multiple Regression
with Two Predictor Variables (cont.)
• For two predictor variables, the general form of
the multiple regression equation is:
Ŷ= b1X1 + b2X2 + a
15
Introduction to Multiple Regression
with Two Predictor Variables (cont.)
17
Partial Correlation
• A partial correlation measures the
relationship between two variables (X and
Y) while eliminating the influence of a third
variable (Z).
• Partial correlations are used to reveal the
real, underlying relationship between two
variables when researchers suspect that
the apparent relation may be distorted by
a third variable.
18
Partial Correlation (cont.)
• For example, there probably is no
underlying relationship between weight
and mathematics skill for elementary
school children.
• However, both of these variables are
positively related to age: Older children
weigh more and, because they have spent
more years in school, have higher
mathematics skills.
19
Partial Correlation (cont.)
• As a result, weight and mathematics skill
will show a positive correlation for a
sample of children that includes several
different ages.
• A partial correlation between weight and
mathematics skill, holding age constant,
would eliminate the influence of age and
show the true correlation which is near
zero.
20