0 Up votes0 Down votes

3 views14 pages2b

Jan 24, 2017

© © All Rights Reserved

PDF, TXT or read online from Scribd

2b

© All Rights Reserved

3 views

2b

© All Rights Reserved

- Multiple Regression Concepts
- ECO 740
- Changqi(John Liu) 6sigma
- ANOVA 2-way
- Elements of Forecasting in Business, Finance, Economics and Government Francis X. Diebold
- et.iso.21187.2012
- Children Acquiring Computing Skills
- Visual Search Results
- Reward System Emp Motiv and Performance
- 2009-12-12_200528_mraWEEK_6_Assignments
- IBM SPSS Advanced Statistics
- Akhtaruddin, 2005, Corporate Mandatory Disclosure Practices in Bangladesh
- θ.docx
- Regression Final Final
- ch12
- Standford - HRP 259 Introduction to Probability and Statistics - Linear Regression
- Rgression in Economics
- STATS 1900 Sem 2 2013 Major Assignment_Solution.doc
- THE EFFECT OF JOB VALUE ON OCCUPATIONAL SELF EFFICACY OF SECONDARY SCHOOL TEACHERS
- R Notes for Data Analysis and Statistical Inference

You are on page 1of 14

Multiple linear regression involves one dependent

variable and more than one independent variable. The

equation that describes multiple linear regression model is

given below:

y = 0 + 1 x1 + 2 x2 + .

. + k xk +

.

.,xk are

independent variables. These independent variables being

used to predict the dependent variable.

coefficients (also called model parameters). These

regression coefficients are estimated based on observed

sample data.

The term (pronounced as epsilon) is random error.

Sasadhar Bera, IIM Ranchi

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

i = 1, 2, . . ., n

y

y1

y2

.

yi

.

yn

x1

x11

x21

.

xi1

.

xn1

j = 1, 2, . . .,k

x2

x12

x22

.

xi2

.

xn2

.

.

.

.

.

.

.

xj

x1j

x2j

.

xij

.

xnj

.

.

.

.

.

.

.

xk

x1k

x2k

.

xik

.

xnk

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

The scalar notation of regression model:

yi = 0 + 1 xi1 + 2 xi2 + .

i = 1, 2, . . ., n

j = 1, 2, . . .,k

. + j xij + . . + k xik + i

k = number of independent variables

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

yn1 = Xn(k+1) (k+1) 1 + n1

n = total number of observations, k = total number of

variables, is model parameters in vector notation.

y1

.

y yi

.

y n

1 x11 . x1 j

. . .

.

X 1 x i1 . x ij

. . .

.

1 x . x

n1

nj

.

.

.

.

.

x 1k

.

x ik

.

x nk

0

1

.

j

.

k

1

.

i

.

n

The error in regression model is the difference between

actual and predicted value. It may be positive or negative

value.

Error is also known as residual. Predicted value by

regression equation is called fitted value or fit.

The sum of squared difference between the actual and

predicted values known as sum of square of error. Least

square method minimizes the sum of square of error to

find out the best fitting plane.

It is to be noted that the regressor variables in linear

regression model are non-random. That means its values

are fixed.

Sasadhar Bera, IIM Ranchi

In matrix notation, the regression equation:

y =X +

n

that minimizes L =

i 1

2

i

=

T

y X ( y X)

T

T

T

( L) 2 X y 2 X X 0

Sasadhar Bera, IIM Ranchi

For

ith

y i Xi

ei y i y i

n

2

e

i

i 1

n k 1

of regressors.

MSE

Variance( ) = (X T X) 1

Sasadhar Bera, IIM Ranchi

The test for significance of regression is a test to

determine if there is a linear relationship between the

response variable and regressor variables.

H0 : 1 = 2 = . . . = k = 0

H1 : At least one j is not zero

The test procedure involves an analysis of variance

(ANOVA) partitioning of the total sum of square into a sum

of squares due to regression and a sum of square due to

error (or residual)

Total number of model parameters = p = Number of

regression coefficients = (k+1)

Sasadhar Bera, IIM Ranchi

10

ANOVA table

Source of

Variation

Regression

Residual

error

Total

DF

SS

MS

FCal

SSR

SSR /k =MSR

MSR/MSE

n k-1

SSE

SSE / (n-k-1)

= MSE

n 1

TSS

y

2

i

n

T

SSR yi y XT y i1

n

i 1

n

SSE yi yi y T y XT y

i 1

n

TSS yi y

i 1

11

Coefficient

Adding an unimportant variable to the model can actually

increase the mean square error, thereby decreasing the

usefulness of the model.

The hypothesis for testing the significance of any

individual regression coefficient, say j is

H0: j = 0

H1: j 0

j

2 C jj

, ( n k 1)

element of (XTX)-1 . Reject H0 if Tcal > t , ( n k 1)

2

12

In matrix notation, the regression equation:

y =X +

where Normal (0, 2)

Mean response = y = E(y) = E(X ) + E() = X + 0

y|x = E(y | x0 ) = x0

0

var(y | x0 )

x T0 (XT X)1 x 0

y|x

( n p )

x T0 (XT X)1 x 0

Sasadhar Bera, IIM Ranchi

13

Coefficient of multiple determination =

R2

SSR

=

TSS

SSE

1

TSS

TSS

TSS

SSR : Sum of square due to regression

SSE : Sum of square due to error

TSS : Total sum of square

dependent variable explained by regressor variables.

R2 is measure the goodness of linear fit. The better the

linear fit is, the R2 closer to 1.

14

The major drawback of using coefficient of multiple

determination (R2) is that adding a predictor variable to the

model will always increase R2, regardless of whether the

additional variable is significant or not. To avoid such

situation, regression model builders prefer to use adjusted

R2 statistic.

SSE

2

adj

n 1

( n p)

(1 R 2 )

1

1

TSS

n p

(n 1)

are added to the model.

chance that non-significant terms have been included in the

15

model.

Sasadhar Bera, IIM Ranchi

- Multiple Regression ConceptsUploaded byvamsidhar999
- ECO 740Uploaded byAhmad Asifa Nural Anuar
- Changqi(John Liu) 6sigmaUploaded byLe Bao Doanh
- ANOVA 2-wayUploaded byWiween Mihad
- Elements of Forecasting in Business, Finance, Economics and Government Francis X. DieboldUploaded bybeekay
- Children Acquiring Computing SkillsUploaded byVictor Chan
- Visual Search ResultsUploaded byJacky C.Y. Ho
- IBM SPSS Advanced StatisticsUploaded byJean Hans Garçon
- et.iso.21187.2012Uploaded byleovence
- Reward System Emp Motiv and PerformanceUploaded byShahid Randhāwa
- Akhtaruddin, 2005, Corporate Mandatory Disclosure Practices in BangladeshUploaded bySwapon Ahmed
- θ.docxUploaded byGuillermo Montes
- 2009-12-12_200528_mraWEEK_6_AssignmentsUploaded byVeera Muthu
- Regression Final FinalUploaded bymodestavon
- ch12Uploaded byAnubha Shahi
- Standford - HRP 259 Introduction to Probability and Statistics - Linear RegressionUploaded byManuel
- Rgression in EconomicsUploaded byMuhammad Umer Farooq Awan
- STATS 1900 Sem 2 2013 Major Assignment_Solution.docUploaded byPandurang Thatkar
- THE EFFECT OF JOB VALUE ON OCCUPATIONAL SELF EFFICACY OF SECONDARY SCHOOL TEACHERSUploaded byAnonymous CwJeBCAXp
- R Notes for Data Analysis and Statistical InferenceUploaded byrgardnercook
- Root Mean Square-StatsUploaded bySankar Cdm
- BusStatCaseAna2Uploaded byMark Angelo Solilapsi Gregana
- Econometrics Assignment 3Uploaded byPedro Fernandez
- DS AssignmentUploaded byanand62002
- 17. Yusuf, Wiwin Paramitha, 2019Uploaded byyusufrauf
- article 9 (2).pdfUploaded bymahedre
- OPIANA_MIDTERM+Problem-set-4-5-6-7-and-8- 9-10 (1)Uploaded byGerry Cucharo
- tr-1Uploaded byAzis Purnama
- Econ MIdterm 2 PractiseUploaded byConnor
- Simple RegressionUploaded byjyotisagar talukdar

- S128Uploaded byNamita Dey
- Tripadvisor Ppp OptUploaded byNamita Dey
- Introduction to Social Crm for TravelUploaded byNamita Dey
- Thomas Cook CrmUploaded byahen123
- Norm Exercise3 (1)Uploaded byLaura Catalina Perez
- M102 Manoj SahuUploaded byNamita Dey
- Travel and TourismUploaded byNamita Dey
- Norm_Exercise2.docUploaded byNamita Dey
- Norm Exercise1Uploaded byNamita Dey
- Inter_NPDUploaded bypraneeth9
- Top 10 Advertising Agency in India 2013 _ Best Advertising Agencies in IndiaUploaded byNamita Dey
- Marquess Beta WildStone 13Uploaded byNamita Dey
- Weekly Workshift Scheduling_Summary of a CaseUploaded byNamita Dey
- CDK Digital Case Prep QuestionsUploaded byNamita Dey
- Decoding Patanjali’s Popularity _ VCCircleUploaded byNamita Dey
- docslide.us_ch-03-case-sport-obermeyer.pptUploaded byAnkit Mishra
- Sport Obermeyer CaseUploaded byNamita Dey
- Ultratech and Jaypee Associates DealUploaded byNamita Dey
- Additinal SurchargeUploaded byNamita Dey
- Hydro_review-2014Uploaded byNamita Dey
- 812Uploaded byNamita Dey
- Session 1Uploaded byNamita Dey
- SimulationUploaded byNamita Dey
- InventoryUploaded byNamita Dey
- CRISIL First Cut_CPI_IIP_Aug_2016.pdfUploaded byAnirudh Kumar
- Demographic QuestionairesUploaded byNamita Dey
- Icici Crm PaperUploaded byNamita Dey
- 11_chapter 3.pdfUploaded byNamita Dey
- ALM OracleUploaded byGuerilla Che

- Week2_handoutUploaded byhsdfighsi
- Harvard Ec 1123 Econometrics Problem Set 7 - Tarun Preet SinghUploaded bytarun singh
- MCQs (Machine Learning)Uploaded byZeeshan Ali Khan
- 1 - IV and 2SLSUploaded bysadatnfs
- ScribdUploaded byarjunkrishnan93
- ProbitAnalysisUploaded byraennita
- tsUploaded byflorissnoek
- Chapter 14 Fixed Effects Regressions Least Square Dummy Variable Approach (EC220)Uploaded bySafinaMandokhail
- Linear RegressionUploaded bytruongvinhlan19895148
- Excel Beta ExampleUploaded byKaushik_n
- as6f13Uploaded bymazin903
- Ho EstimateUploaded bySakib Baghoust
- Applied Regression Analysis Final ProjectUploaded bybqa5055
- simpregUploaded bychristos_nakis
- 1112SEM2-ST5223Uploaded byjiashengrox
- SPSS Independent Samples T TestUploaded byJeffer Mwangi
- 1 Analysis of Variance of Multiple Factors (1)Uploaded bylblackdragonl
- OLS_regressionUploaded byAliya89
- RaoBlackwell[1]Uploaded byManuel Cueva Galvez
- Filtering and System Identification, MatlabUploaded byUtku Oğuzman
- Solution Manual for Introduction to Econometrics - Gary KoopUploaded byMasoomeh Akbarzadeh
- Ch17 Curve FittingUploaded byvarunsingh214761
- Problem Set EconometricsUploaded byJelac Capalac
- Ratio and Product Type Estimators Using Stratified Ranked Set SamplingUploaded byinventionjournals
- Procedimiento StataUploaded byGiovanna Allcca
- Parametric and Non Parametric Approach in Structural Equation Modeling (SEM): The Application of BootstrappingUploaded byWan Mohamad Asyraf Bin Wan Afthanorhan
- Project Time Series 2Uploaded byBratu Andreea
- Probability Vs Non-Probability SamplingUploaded byMasood Ishfaq
- 4. Maths - IJAMSS - Exponential Type Ratio -Shailendra RawalUploaded byiaset123
- Lecture 1Uploaded bySelMarie Nutelliina Gomez

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.