1

Lahore Garrison University

STAT 114Probability&Statistics Week-17 Lecture-31

Topic: Non linear regression introduction

 2
Preamble (Past Lesson Brief)

simple linear regression line

Lahore Garrison University

 The Difference between Linear and Nonlinear 3
Regression Models

 Linear Regression Equations

 A linear regression model follows a very particular form. In statistics, a regression model is linear when all terms in
the model are one of the following: The constant A parameter multiplied by an independent variable (IV) Then, you
build the equation by only adding the terms together. These rules limit the form to just one type:
 Dependent variable = constant + parameter * IV + … + parameter * IV
 Statisticians say that this type of regression equation is linear in the parameters. However, it is possible to model
curvature with this type of model. While the function must be linear in the parameters, you can raise an independent
variable by an exponent to fit a curve. For example, if you square an independent variable, the model can follow a
U-shaped curve. While the independent variable is squared, the model is still linear in the parameters. Linear models
can also contain log terms and inverse terms to follow different kinds of curves and yet continue to be linear in the
parameters. The regression example below models the relationship between body mass index (BMI) and body fat
percent. In a different blog post, I use this model to show how to make predictions with regression analysis. It is a
linear model that uses a quadratic (squared) term to model the curved relationship.

Lahore Garrison University

 4

Lahore Garrison University

 5
Nonlinear Regression Equations

showed how linear regression models have one basic configuration. Now, we’ll focus on the “non” in
nonlinear! If a regression equation doesn’t follow the rules for a linear model, then it must be a
nonlinear model. It’s that simple! A nonlinear model is literally not linear.
 The added flexibility opens the door to a huge number of possible forms. Consequently,
nonlinear regression can fit an enormous variety of curves. However, because there are so many
candidates, you may need to conduct some research to determine which functional form provides
the best fit for your data.
 Below, I present a handful of examples that illustrate the diversity of nonlinear regression
models. Keep in mind that each function can fit a variety of shapes, and there are many nonlinear
functions. Also, notice how nonlinear regression equations are not comprised of only addition
and multiplication! In the table, thetas are the parameters, and Xs are the independent variables.

Lahore Garrison University

 6
Example

Lahore Garrison University

 7
Example

Lahore Garrison University

 8

Q &A

Lahore Garrison University

 9
References

 Probability and Statistics for Engineers and Scientists by Ronald E. Walpole,

Raymond H. Myers, Sharon L. Myers and Keying E. Ye, Pearson; 9th Edition
(January 6, 2011). ISBN-10: 0321629116 2
 Walpole, P.E., Myers R.H., Myers S.L. (1998), “Probability and Statistics for
Engineers and Scientists”, 7th Ed. Prentice Hall.
 Introduction to Statistical Theory Part 1,Prof Sher Muhammad Chaudhry

Lahore Garrison University