ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar...
-
Upload
glenn-kayton -
Category
Documents
-
view
709 -
download
72
Transcript of ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar...
![Page 1: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/1.jpg)
ECONOMETRICS I
CHAPTER 3: TWO VARIABLE REGRESSION MODEL:
THE PROBLEM OF ESTIMATION
Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition, The McGraw-Hill Companies
![Page 2: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/2.jpg)
3.1 THE METHOD OF ORDINARY LEAST SQUARES
• PRF:
• SRF:
• How is SRF determined?
• We do not minimize the sum of the residuals!
• Why not?
![Page 3: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/3.jpg)
Least squares criterion
![Page 4: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/4.jpg)
3.1 THE METHOD OF ORDINARY LEAST SQUARES
• We adopt the least-squares criterion• We want to minimize the sum of the squared
residuals.
• This sum is a function of estimated parameters:
• Normal equations:
![Page 5: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/5.jpg)
3.1 THE METHOD OF ORDINARY LEAST SQUARES
• Solving the normal equations simultaneously, we obtain the following:
• Beta2-hat can be alternatively expressed as the following:
![Page 6: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/6.jpg)
Three Statistical Properties of OLS Estimators
I. The OLS estimators are expressed solely in terms of the observable quantities (i.e. X and Y). Therefore they can easily be computed.
II. They are point estimators (not interval estimators). Given the sample, each estimator provide only a single (point) value of the relevant population parameter.
III. Once the OLS estimates are obtained from the sample data, the sample regression line can be easily obtained.
![Page 7: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/7.jpg)
The properties of the regression line
1. It passes through the sample means of Y and X.
![Page 8: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/8.jpg)
The properties of the regression line
2.
![Page 9: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/9.jpg)
The properties of the regression line
3. The mean value of the residuals is zero.
![Page 10: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/10.jpg)
The properties of the regression line
4.
5.
0ˆ iiYu
![Page 11: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/11.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 12: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/12.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 13: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/13.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 14: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/14.jpg)
![Page 15: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/15.jpg)
![Page 16: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/16.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 17: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/17.jpg)
![Page 18: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/18.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 19: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/19.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
![Page 20: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/20.jpg)
![Page 21: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/21.jpg)
3.2 The Classical Linear Regression Model: The Assumptions Underlying the Method of Least Squares
• Example of perfect multicollinearity: X1 = 2X2+X3
Y X1 X2 X3
6 5 2 1
11 10 4 2
17 11 5 1
22 16 6 4
25 19 8 3
33 22 10 2
15 11 3 5
![Page 22: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/22.jpg)
PRECISION OR STANDARD ERRORS OF LEAST SQUARES ESTIMATES
• var: variance• se: standard error• : the constant homoscedastic
variance of ui• : the standard error of the
estimate
• : OLS estimator of
2
![Page 23: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/23.jpg)
Gauss – Markov Theorem
• An estimator, say the OLS estimator , is said to be a best linear unbiased estimator (BLUE) of β2 if the following hold:
![Page 24: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/24.jpg)
![Page 25: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/25.jpg)
The coefficient of determination r2
• TSS: total sum of squares• ESS: explained sum of squares• RSS: residual sum of squares
![Page 26: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/26.jpg)
![Page 27: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/27.jpg)
The coefficient of determination r2
The quantity r2 thus defined is known as the (sample) coefficient of determination and is the most commonly used measure of the goodness of fit of a regression line. Verbally, r2 measures the proportion or percentage of the total variation in Y explained by the regression model.
![Page 28: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/28.jpg)
The coefficient of determination r2
•
![Page 29: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/29.jpg)
The coefficient of determination r2
•
![Page 30: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/30.jpg)
The coefficient of correlation r
r is the sample correlation coeffient
![Page 31: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/31.jpg)
![Page 32: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/32.jpg)
Some of the properties of r
![Page 33: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/33.jpg)
Homework
• Study the numerical example on pages 87-90. There will be questions on the midterm exam similar to the ones in this example.
• Data on page 88:
![Page 34: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/34.jpg)
Homework
![Page 35: ECONOMETRICS I CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION Textbook: Damodar N. Gujarati (2004) Basic Econometrics, 4th edition,](https://reader033.fdocuments.in/reader033/viewer/2022061310/56649c765503460f9492a25a/html5/thumbnails/35.jpg)
Homework