CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

18
CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Transcript of CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Page 1: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

CHAPTER 12.

AUTOCORRELATION:

WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Page 2: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Questions in Autocorrelation:

The nature of autocorrelation?

The theoretical and practical consequences of autocorrelation?

Detection of autocorrelation?

Remedies of autocorrelation?

Page 3: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

The Nature of the Problem

E(ui, uj) = 0 i j

Autocorrelation is defined as correlation between disturbances . CLRM assumes that the disturbance term relating to any observation is not influenced by the distrurbance term relating to any other observation.

Page 4: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Autocorrelation vs Serial Correlation

Some authors but not all prefer to distinquish these two terms. Tintner (1965) defines autocorrelation as “lag correlation of a

given series with itself, lagged by a number of time units”, where he reserves the term serial correlation to “lag correlation between two different series.

That is, autocorrelation is the correlation between u1, u2, ...u10

Whereas Serial correlation is u1, u2, .... u10 and v2, v3, ...v11

u and v are two different time series

Page 5: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Reasons behind Autocorrelation

Inertia: Time series such as GNP, price indexes, production, employment

and unemployment exhibit business cycles. Starting at the bottom of the recession, when economic recovery starts, most of these series start moving upward. It continues until something happens to slow them down (i.e. Increase in interest rate or taxes or both). Therefore, in regressions involving time series data, successive observations are likely to be interdependent.

Specification Bias: Excluded Variables Case Some true regressors might be missed in the models

Specification Bias: Incorrect Functional Form

Page 6: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Reasons (Continued)

Cobweb Phenomenon The supply of many agricultural commodities

reflects cobweb phenomenon, where supply reacts to price with a lag of one time period because supply decisions take time to implement. Thus supply function is:

Supplyt = 1+2Pt-1+ut

Here disturbances are not expected to be random because if the farmers overproduce in year t, they are likely to reduce their production in t+1, and so on, leading to a Cobweb pattern.

Page 7: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Reasons (Continued)

Lags Using unnecessary lags

i.e. Const = 1 + 2Income + 3Const-1 + ut

Where consumers do not change their consumption habits readily. If we use lagged term, the resulting error term will reflect systematic pattern due to the influence of lagged consumption on current consumption

Page 8: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Reasons (Continued)

Unnecessary manipulation of data Averaging series, interpolation, extrapolation,

etc...

Data Transformation For example, using differenced data instead of

level form or using level form data instead of differenced data.

Page 9: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Reasons (Continued)

Non – Stationarity (Chapter 21) A time series is stationary if its characteristics

(mean, variance, covariance) are time variant; that is, they do not change over time. Non-stationarity may cause autocorrelation.

Page 10: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Positive vs Negative Autocorrelation

Page 11: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Detecting Autocorrelation -1

Plotting residuals and standardized residuals of regression against time and compare if they show similar pattern which signs for autocorrelation

Standardized residuals= residuals / st.error of regression.

Page 12: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Both residuals are NOT RANDOM

Page 13: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Again both ut and ut-1 are NOT RANDOM

So,

autocorrelation

Page 14: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Detecting Autocorrelation - 2

Several tests for detecting autocorrelation.

The most popular and celebrating approach is

Durbin-Watson d Test which is developed by Durbin and Watson (1951).

nt

t t

nt

t tt

u

uud

2

2

2

21

ˆ

ˆˆ

DW d statistic

A great advantage of d statistic is that it is based on the estimated residuals, which are routinely computed in regression analysis.

Sum of squared differences

Residual sum of squares

Page 15: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Assumptions of d statistic

Regression model includes the intercept term. If it is not present, it is essential to re-run the regression including intercept to obtain RSS.

The explanatory variables are non-stochastic or fixed in repeated sampling.

Ut is generated by the first order autoregressive scheme: ut=ρut-

1+et where ρ (rho) stands for AR(1) coefficient. Therefore, it cannot be used to detect higher order autoregressive schemes. ut=ρut-1+et is also known as autoregressive model.

Ut is assumed to be normally distributed.

Regression model does not include lagged variables. If so, d test is inapplicable.

No missing obserbation in the data.

Page 16: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Using DW test for Detecting Autocorrelation

Durbin and Watson (1951) developed confidence intervals for d statistics with dL and dU which is provided in Appendix D.

Autocorrelation coefficient is represented by ρ (rho) where if:

ρ = +1: perfect positive autocorrelation

ρ = -1: Perfect negative autocorrelation

Thus, -1 < ρ < +1

When -1 < ρ < +1, then 0 < d < 4 When ρ = 0, then d = 2, So: d ≈ 2 ( 1 – ρ)

2

1

ˆ

ˆ12

t

tt

u

uud

Page 17: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

Confidence Intervals for d Statistic

Computed d statistic is compared with lower and upper d values from DW table and null hypothesis is tested.

Page 18: CHAPTER 12. AUTOCORRELATION: WHAT HAPPENS IF THE ERROR TERMS ARE CORRELATED?

APPLICATION TO

MONEY AND INCOME DATA FOR

JAPAN