Regression

According to Wallis and Roberts, It is more important to find out what the relation actually is, in order to estimate or predict one variable (the dependent variable); and the statistical technique appropriate to such a case is called Regression Analysis According to Blair Regression is the measure of the average relationship between two or more variables in terms of the original units of the data.

Regression (Contd)
According to Ya-lun-chou statistical technique which attempts to establish the nature of relationships between the variable , i.e to study the functional relationship between the variables and thereby provide a mechanism for prediction and forecasting is known as regression analysis

Kinds of Regression Analysis

The regression analysis may be classified as:

Linear and Curvilinear Regression Simple and Multiple Regression

Linear Regression If the relationship can be represented by a straight line, then it is known as linear regression. In this case values of the dependent variable changes at a constant rate for a unit change in the values of the independent variable

Non-Linear Regression When the relationship between variables can be represented by a curve other than straight line, then it is called non-linear regression. Simple Regression If the study is based only on two variables, it is called simple regression. Multiple Regression If the study is based on more than two variables, it is called multiple regression.

Find Regression equations through Least Squares

Regression Equation of X on Y be:

X=Nc+d Y XY=c Y+ dY2

Regression Equation of Y on X be: Y=Na + b X XY=a X+ bX2

Solve these equations and solve them.

Correlation coefficient

rs =

Bxy * Byx

You can construct graph of regression lines using these equations.

Difference between Correlation and Regression

Correlation Coefficient, R, measures the strength of bivariate association The regression line is a prediction equation that estimates the values of y for any given x

Problem 1:
Obtain the lines of regression for the data and estimate the value of y when x=5.2

x Y

1 6

2 8

3 7

4 6

5 8

Practice

Problem 2:
Obtain the lines of regression for the data and estimate the value of x when y=6.4

x y

1 9

2 8

3 10

4 12

5 11

6 13

7 14

8 16

9 15

Practice