0 Up votes0 Down votes

3 views21 pagesres

Jun 01, 2014

© © All Rights Reserved

PPTX, PDF, TXT or read online from Scribd

res

© All Rights Reserved

3 views

res

© All Rights Reserved

- 2015.pdf
- Hayashi Ch 1 Answers
- BCA 4th Sem. Asst. 2018-19
- StochasticFrontierModels
- Let's Take the Con Out of Eco No Metrics
- 5.LeastSquares
- Frontier 41 Guide
- 10.1.1.91
- FULL KP
- Lec9.1
- micecx2
- Lecture2- Matrix Approach to Multiple Regression
- Project 1 Excel
- DT SEHA 12-05
- OLS Advanced
- size in the performance of small.pdf
- The Mathematical Derivation of Least Squares
- Experimental Design
- Excel de Pom
- Multivariat Asi Before

You are on page 1of 21

technique that calculates the Beta-hats -- estimated

parameters or coefficients of the model so as to

minimize the sum of the squared residuals.

e

i

2

= (Y

i

Yhat)

2

Where

e = = the residual

Yhat is the predicted value of Y

Why OLS?

1. OLS is relative easy to use. For a model

with one or two independent variables you

one can run OLS with a simple spreadsheet

(without using the regression function).

2. The goal of minimizing the sum of squared

residuals is appropriate from a theoretical

point of view.

3. OLS estimates have a number of useful

characteristics.

Why not minimize residuals?

Residuals can be positive and negative. Just

minimizing residuals can produce an

estimator with large positive and negative

errors that cancel each other out.

Minimizing the absolute value of the sum of

residuals poses mathematical problems. Plus,

we wish to minimize the possibility of very

large errors.

Useful Characteristics of OLS

1. Estimated regression line goes through the

means of Y and X. In equation form Mean

of Y =

0

+

1

(Mean of X)

2. The sum of residuals is exactly zero.

3. OLS estimators, under a certain set of

assumptions (which we discuss later), are

BLUE (Best Linear Unbiased Estimators).

Note: OLS is the estimator, the coefficients or

parameters are the estimates.

Classical Assumption 1

The error term has a zero population mean.

We impose this assumption via the constant

term.

The constant term equals the fixed portion of

the Y that cannot be explained by the

independent variables.

The error term equals the stochastic portion

of the unexplained value of Y.

Classical Assumption 2

The error term has a constant variance

Heteroskedasticity

Where does this most often occur? Cross-

sectional data

Why does this occur in cross-sectional data?

Classical Assumption 3

Observations of the error term are

uncorrelated with each other.

Serial Correlation or Autocorrelation

Where does this most often occur? Time-

series data

Why does this occur in time-series data?

Classical Assumption 4-5

The data for the dependent variable and

independent variable(s) do not have

significant measurement errors.

The regression model is linear in the

coefficients, is correctly specified, and has an

additive error term.

Classical Assumption 6

The error term is normally distributed

This is an optional assumption, but a good

idea. Why?

One cannot use the t-statistic or F-statistic

unless this holds (will explain these later).

Five More Assumptions

1. All explanatory variables are uncorrelated with the error term.

When would this not be the case? Then a system of equations is

needed (i.e. supply and demand).

What are the consequences? Estimation of slope coefficient for

correlated X terms is biased.

2. No explanatory variable is a perfect linear function of any other

explanatory variable.

Perfect collinearity or multicollinearity

Consequence: OLS cannot distinguish the impact of each X on Y.

3. X values are fixed in repeated sampling.

4. The number of observations n must be greater than the number of

parameters to be estimated.

5. There must be variability in X and Y values.

The Gauss-Markov Theorem

Given Classical Assumptions, the OLS

estimator

k

is the minimum variance

estimator from among the set of all linear

unbiased estimators of

k

.

In other words, OLS is BLUE

Best Linear Unbiased Estimator

Where Best = Minimum Variance

Given assumptions

The OLS coefficient estimators will be

unbiased

have minimum variance

are consistent

are normally distributed.

The last characteristic is important if we wish

to conduct statistical tests of these

estimators, the topic of the next chapter.

Unbiased Estimator and Small Variance

Unbiased estimator an estimator whose

sampling distributions has as its expected

value the true value of .

In other words... the mean value of the

distribution of estimates equals the true

mean of the item being estimated.

In addition to an unbiased estimate, we also

prefer a small variance.

How does OLS Work?

The Univariate Model

Y =

0

+

1

X +

For Example: Wins =

0

+

1

Payroll +

How do we calculate

1

?

Intuition:

1

equals the joint variation of X and Y

(around their means) divided by the variation of X

around its mean. Thus it measures the portion of the

variation in Y that is associated with variation in X.

In other words, the formula for the slope is:

Slope = COV(X,Y)/V(X)

or the covariance of the two variables divided by

the variance of X.

How do we calculate

1

?

Some Simple Math

1

= [(Xi - mean of X) * (Yi - mean of Y)] /

(Xi - mean of X)

2

If

xi = Xi - mean of X and

yi = Yi - mean of Y

then

1

= [(xi*yi)] / (xi)

2

How do we calculate

0

?

Some Simple Math

0

= mean of Y

1

*mean of X

0

is defined to ensure that the

regression equation does indeed pass

through the means of Y and X.

Multivariate Regression

Multivariate regression an equation with more than

one independent variable.

Multivariate regression is necessary if one wishes to

impose ceteris paribus.

Specifically, a multivariate regression coefficient

indicates the change in the dependent variable

associated with a one-unit increase in the

independent variable in question holding constant the

other independent variables in the equation.

Omitted Variables, again

If you do not include a variable in your model, then

your coefficient estimate is not calculated with the

omitted variable held constant.

In other words, if the variable is not in the model it

was not held constant.

Then again.... there is the Principle of Parsimony or

Occams razor (that descriptions be kept as simple as

possible until proven inadequate).

So we dont typically estimate regressions with

hundreds of independent variables.

The Multivariate Model

Y =

0

+

1

X

1

+

2

X

2

+ .......

n

X

n

+

For Example, a model where n=2:

Wins =

0

+

1

PTS +

2

DPTS +

Where

PTS = Points scored in a season

DPTS = Points surrendered in a season

How do we calculate

1

and

2

?

Some Less Simple Math

Remember:

xi = Xi - mean of X and

yi = Yi - mean of Y

1

= [(x

1

*yi)*(x

2

)

2

- (x

2

*yi)*(x

1

*x

2

)

] /

[(x

1

)

2

* (x

2

)

2

- (x

1

*x

2

)

2

]

2

= [(x

2

*yi)*(x

1

)

2

- (x

1

*yi)*(x

1

*x

2

)] /

[(x

1

)

2

* (x

2

)

2

- (x

1

*x

2

)

2

]

0

= mean of Y

1

*mean of X

2

*mean of X

Issues to Consider when reviewing

regression results

1. Is the equation supported by sound theory?

2. How well does the estimated regression fit the data?

3. Is the data set reasonably large and accurate?

4. Is OLS the best estimator for this equation?

5. How well do the estimated coefficients correspond to our

expectations?

6. Are all the obviously important variables included in the

equation?

7. Has the correct functional form been used?

8. Does the regression appear to be free of major econometric

problems?

NOTE: This is just a sample of questions one can ask.

- 2015.pdfUploaded byriska
- Hayashi Ch 1 AnswersUploaded byLauren sp
- BCA 4th Sem. Asst. 2018-19Uploaded byKumar Info
- StochasticFrontierModelsUploaded byAdrian Babin
- Let's Take the Con Out of Eco No MetricsUploaded byfanilaman
- 5.LeastSquaresUploaded byAmmi Jan
- Frontier 41 GuideUploaded byRirin Kuncaraning Sari
- 10.1.1.91Uploaded bybleego
- FULL KPUploaded bysujee_lucky
- Lec9.1Uploaded byKashef Hoda
- micecx2Uploaded bychrisignm
- Lecture2- Matrix Approach to Multiple RegressionUploaded byAbdur Rehman
- Project 1 ExcelUploaded byhuyentran1212
- DT SEHA 12-05Uploaded bychiclayoperu
- OLS AdvancedUploaded byAlexis Singh
- size in the performance of small.pdfUploaded byAlifah Salwa
- The Mathematical Derivation of Least SquaresUploaded byPCCPatron
- Experimental DesignUploaded bycuachanhdong
- Excel de PomUploaded byElizabeth Inoñan
- Multivariat Asi BeforeUploaded byKristina Nainggolan
- WorldUploaded byAgus
- soal nmer 7Uploaded byardhia
- [Jeffrey M. Wooldridge] Instructor’s Solutions M(B-ok.org)Uploaded byLaura Elena Amaya Durán
- 2-14-1387871444-18. Manage-Taguchi-Aneesh_Chintaman_Gangal.pdfUploaded byHumberto Galvez
- Wooldridge, J. M., 2010. Econometric Analysis of Cross Section and Panel DataUploaded byAssan Achibat
- 2.Int.J.contemp.math.SciencesUploaded byAnonymous ZYDuXSI
- Analisis quimicos de la piñaUploaded byJesus Desiree Rojas Silva
- ULFIATI MAFTUHAH.docxUploaded byulfiati maftuhah
- Blood Pressure and Activity LevelUploaded byDENNIS KIHUNGI
- TugasUploaded byeka peranduwinata

- List of Homoeopathic Medicines,Combinations & Their UsesUploaded bygirish2611
- 06 Logistic RegressionUploaded byRahulsinghoooo
- Cray Graph Engine User GuideUploaded byRahulsinghoooo
- a Declarative Approach to Ontology Translation With Knowledge PreservationUploaded byRahulsinghoooo
- 2 - 4 - Relational Algebra Details- Union, Diff, Select (10-53)Uploaded byRahulsinghoooo
- MIT15071XT114-U0101_100Uploaded byRahulsinghoooo
- 3.3_dameron_7-7-04Uploaded byRahulsinghoooo
- LinksUploaded byRahulsinghoooo
- Week1 Recitation AllSlidesUploaded byRahulsinghoooo
- 6 - 16 - Lecture 57 BONUSUploaded byRahulsinghoooo
- Movies Database and ScriptsUploaded byRahulsinghoooo
- Data Science Interview QuestionUploaded byRahulsinghoooo
- HadoopUploaded byKartik Mahadevan
- Stats - IntroUploaded byamalia
- Netwok IpUploaded byRahulsinghoooo
- 2 - 6 - Relational Algebra Details- Theta-Join (8-34)Uploaded byRahulsinghoooo
- 2 - 7 - SQL for Data Science- Interpreting Complicated SQL (12-12)Uploaded byRahulsinghoooo
- 2 - 9 - Physical Optimization (11-14)Uploaded byRahulsinghoooo
- 2 - 2 - Motivating Relational Algebra (8-57)Uploaded byRahulsinghoooo
- 2 - 1 - From Data Models to Databases (10-35)Uploaded byRahulsinghoooo
- 5 - 6 - Recap and Big Data (11-39)Uploaded byRahulsinghoooo
- 5 - 3 - Effect Size, Meta-Analysis, Heteroskedasticity (9-31)Uploaded byRahulsinghoooo
- 5 - 2 - Publication Bias (8-45)Uploaded byRahulsinghoooo
- 5 - 1 - Statistics Intro (10-36)Uploaded byRahulsinghoooo
- 6 - 3 - Lecture 46 DifferencesUploaded byRahulsinghoooo
- 6 - 13 - Lecture 56 Approximation and ErrorUploaded byRahulsinghoooo
- 6 - 5 - Lecture 48 Numerical O.D.E.sUploaded byRahulsinghoooo
- 6 - 15 - Lecture 57 Calculus ReduxUploaded byRahulsinghoooo

- Calibration Workshop 2 ManualUploaded byAbu Alamsyah
- Determinants of the Access to Sources of Finance for Small and Medium Enterprises Smes in Libya-A Conceptual StudyUploaded byGlobal Research and Development Services
- N2-FixersUploaded byGrignion
- A Review Paper on Sloping Ground Building Structures under Seismic and Wind Load ConditionsUploaded byEditor IJTSRD
- Amateur's WorkshopUploaded byjimboreno
- b.tech Lateral EntryUploaded byGur Preet
- Cento Fake San Marzano Tomatoes Class Action Lawsuit E.D.N.Y._2_19-cv-00974-JS-GRB_14_0Uploaded bySpencer Sheehan
- UVM Tutorial for Candy Lovers – 9Uploaded byjagdish
- PDF Merge SoftwareUploaded byNorris Paiement
- MOQ.pdfUploaded bycharles_asner
- TCSUploaded byRocky Adi
- Productions of MasculinityUploaded byjane
- ReadmeUploaded byRishbha Sapkota
- coa-ch-01Uploaded byapi-208618088
- Information Technology Management Frog VLE ApplicationUploaded byValerie Sinti
- Kotler, Conor - Marketing professional services (cité 30) - 1977Uploaded bySanjay Khanna
- GCR_2016_62-63Uploaded byvijaygalaxy
- Chaotic Dynamics Lab ReportUploaded bySameer Saini
- 205.05 3T MRI SOP Emerg Code Blue 06June2013Uploaded byMelly Anggriani
- MDEQ Marathon Petroleum Permit 63-08CUploaded byStephen Boyle
- Winding-up Simpleguide Cht EngUploaded byKhairun Nisya
- LAWS AND EXECUTIVE ISSUANCES.docxUploaded byEirenne Phae Ramil Vista
- NE40E-X16 Product Description.pdfUploaded bysdebb srg
- 01 - Beer Stabilisation Part 1Uploaded byMartey Sampson
- filme2Uploaded byEduardo Custódio
- Pet Unit6 WorksheetUploaded bySaul Ruano Alcalde
- 89 Katz vs. US Digest.pdfUploaded byKJPL_1987
- Yearly Scheme of Work Year CEFR 1 2019Uploaded byrafizahhanim
- Central BankUploaded bybenzinoalone
- EEDI Guidance NotesUploaded byJeff Martin

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.