Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time...
Transcript of Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time...
![Page 1: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/1.jpg)
Univariate Time Series Analysis
Univariate Time Series Analysis
Klaus Wohlrabe1 and Stefan Mittnik
1 Ifo Institute for Economic Research, [email protected]
SS 2017
1 / 212
![Page 2: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/2.jpg)
Univariate Time Series Analysis
1 Organizational Details and Outline2 An (unconventional) introduction
Time series CharacteristicsNecessity of (economic) forecastsComponents of time series dataSome simple filtersTrend extractionCyclical ComponentSeasonal ComponentIrregular ComponentSimple Linear Models
3 A more formal introduction4 (Univariate) Linear Models
Notation and TerminologyStationarity of ARMA ProcessesIdentification Tools
2 / 212
![Page 3: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/3.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Table of content I1 Organizational Details and Outline
2 An (unconventional) introductionTime series CharacteristicsNecessity of (economic) forecastsComponents of time series dataSome simple filtersTrend extractionCyclical ComponentSeasonal ComponentIrregular ComponentSimple Linear Models
3 A more formal introduction
4 (Univariate) Linear ModelsNotation and Terminology
3 / 212
![Page 4: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/4.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Table of content IIStationarity of ARMA ProcessesIdentification Tools
4 / 212
![Page 5: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/5.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Introduction
Time series analysis:Focus: Univariate Time Series and Multivariate TimeSeries Analysis.A lot of theory and many empirical applications with realdataOrganization:
25.04. - 30.05.: Univariate Time Series Analysis, sixlectures (Klaus Wohlrabe)28.04. - 02.06.: Fridays: Tutorials with Malte Kurz13.06. - End of Semester: Multivariate Time SeriesAnalysis (Stefan Mittnik)
⇒ Lectures and Tutorials are complementary!
5 / 212
![Page 6: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/6.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Tutorials and Script
Script is available at: moodle website (see course website)Password: armaxgarchxScript is available at the day before the lecture (noon)All datasets and programme codesTutorial: Mixture between theory and R - Examples
6 / 212
![Page 7: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/7.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Literature
Shumway and Stoffer (2010): Time Series Analysis andIts Applications: With R ExamplesBox, Jenkins, Reinsel (2008): Time Series Analysis:Forecasting and ControlLütkepohl (2005): Applied Time Series Econometrics.Hamilton (1994): Time Series Analysis.Lütkepohl (2006): New Introduction to Multiple Time SeriesAnalysisChatham (2003): The Analysis of Time Series: AnIntroductionNeusser (2010): Zeitreihenanalyse in denWirtschaftswissenschaften
7 / 212
![Page 8: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/8.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Examination
Evidence of academic achievements: Two hour writtenexam both for the univariate and multivariate partSchedule for the Univariate Exam: tba.
8 / 212
![Page 9: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/9.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Prerequisites
Basic Knowledge (ideas) of OLS, maximum likelihoodestimation, heteroscedasticity, autocorrelation.Some algebra
9 / 212
![Page 10: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/10.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Software
Where you have to pay:STATAEviewsMatlab (Student version available, about 80 Euro)
Free software:R (www.r-project.org)Jmulti (www.jmulti.org) (Based on the book by Lütkepohl(2005))
10 / 212
![Page 11: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/11.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Tools used in this lecture
standard approach (as you might expected)derivations using the whiteboard (not available in thescript!)live demonstrations (examples) using Excel, Matlab,Eviews, Stata and JMultilive programming using Matlab
11 / 212
![Page 12: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/12.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Outline
IntroductionLinear ModelsModeling ARIMA Processes: The Box-Jenkins ApproachPrediction (Forecasting)Nonstationarity (Unit Roots)Financial Time Series
12 / 212
![Page 13: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/13.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Goals
After the lecture you should be able to ...... identify time series characteristics and dynamics... build a time series model... estimate a model... check a model... do forecasts... understand financial time series
13 / 212
![Page 14: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/14.jpg)
Univariate Time Series Analysis
Organizational Details and Outline
Questions to keep in mind
General Question Follow-up QuestionsAll types of data
How are the variables de-fined?
What are the units of measurement? Do the data com-prise a sample? If so, how was the sample drawn?
What is the relationship be-tween the data and the phe-nomenon of interest?
Are the variables direct measurements of the phe-nomenon of interest, proxies, correlates, etc.?
Who compiled the data? Is the data provider unbiased? Does the provider pos-sess the skills and resources to enure data quality andintegrity?
What processes generatedthe data?
What theory or theories can account for the relationshipsbetween the variables in the data?
Time Series dataWhat is the frequency ofmeasurement
Are the variables measured hourly, daily monthly, etc.?How are gaps in the data (for example, weekends andholidays) handled?
What is the type of mea-surement?
Are the data a snapshot at a point in time, an averageover time, a cumulative value over time, etc.?
Are the data seasonally ad-justed?
If so, what is the adjustment method? Does this methodintroduce artifacts in the reported series?
14 / 212
![Page 15: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/15.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Table of content I1 Organizational Details and Outline
2 An (unconventional) introductionTime series CharacteristicsNecessity of (economic) forecastsComponents of time series dataSome simple filtersTrend extractionCyclical ComponentSeasonal ComponentIrregular ComponentSimple Linear Models
3 A more formal introduction
4 (Univariate) Linear ModelsNotation and Terminology
15 / 212
![Page 16: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/16.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Table of content IIStationarity of ARMA ProcessesIdentification Tools
16 / 212
![Page 17: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/17.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Goals and methods of time series analysis
The following section partly draws upon Levine, Stephan,Krehbiel, and Berenson (2002), Statistics for Managers.
17 / 212
![Page 18: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/18.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Goals and methods of time series analysis
understanding time series characteristics and dynamicsnecessity of (economic) forecasts (for policy)time series decomposition (trends vs. cycle)smoothing of time series (filtering out noise)
moving averagesexponential smoothing
18 / 212
![Page 19: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/19.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Time Series
A time series is timely ordered sequence of observations.We denote yt as an observation of a specific variable atdate t .A time series is list of observations denoted as{y1, y2, . . . , yT} or in short {yt}Tt=1.What are typical characteristics of times series?
19 / 212
![Page 20: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/20.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: GDP I80
9010
011
0G
DP
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1time
Germany: GDP (seasonal and workday-adjusted, Chain index)
20 / 212
![Page 21: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/21.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: GDP II-4
-20
2Q
uarte
rly G
DP
grow
th
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1time
Germany: Quarterly GDP growth
-10
-50
5Ye
arly
GD
P gr
owth
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1time
Germany: Yearly GDP growth
21 / 212
![Page 22: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/22.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: Retail Sales0
5010
015
0R
etai
l Sal
es -
Cha
in In
dex
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1time
Germany: Retail Sales - non-seasonal adjusted
22 / 212
![Page 23: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/23.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: Industrial Production20
4060
8010
012
0IP
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1time
Germany: Industrial Production (non-seasonal adjusted, Chain index)
23 / 212
![Page 24: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/24.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: Industrial Production-2
0-1
00
1020
30M
onth
ly IP
gro
wth
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1time
Germany: Monthly IP growth
-40
-20
020
40Ye
arly
IP g
row
th
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1time
Germany: Yearly GIP growth
24 / 212
![Page 25: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/25.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: The German DAX0
5000
1000
015
000
DAX
0 2000 4000 6000 8000Time
Level
-.06
-.04
-.02
0.0
2.0
4R
etur
n
0 2000 4000 6000 8000Time
Return
25 / 212
![Page 26: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/26.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Economic Time Series: Gold Price0
500
1000
1500
2000
Gol
d
0 2000 4000 6000 8000 10000Time
Level
-.1-.0
50
.05
Ret
urn
0 2000 4000 6000 8000 10000Time
Return
26 / 212
![Page 27: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/27.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Further Time Series: Sunspots0
5010
015
020
0Su
nspo
ts
1700 1800 1900 2000time
27 / 212
![Page 28: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/28.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Further Time Series: ECG4
4.5
55.
56
ECG
0 2000 4000 6000 8000 10000Time
28 / 212
![Page 29: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/29.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Further Time Series: Simulated Series: AR(1)-2
-10
12
3AR
0 20 40 60 80 100Time
29 / 212
![Page 30: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/30.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Further Time Series: Chaos or a real time series?-6
-4-2
02
4
1990m1 1995m1 2000m1 2005m1 2010m1 2015m1time
30 / 212
![Page 31: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/31.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Further Time Series: Chaos?-4
-20
24
0 20 40 60 80 100Time
31 / 212
![Page 32: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/32.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Time series Characteristics
Characteristics of Time series
TrendsPeriodicity (cyclicality)SeasonalityVolatility ClusteringNonlinearitiesChaos
32 / 212
![Page 33: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/33.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Necessity of (economic) forecasts
Necessity of (economic) Forecasts
For political actions and budget control governments needforecasts for macroeconomic variablesGDP, interest rates, unemployment rate, tax revenues etc.marketing need forecasts for sales related variables
future salesproduct demand (price dependent)changes in preferences of consumers
33 / 212
![Page 34: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/34.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Necessity of (economic) forecasts
Necessity of (economic) Forecasts
retail sales company need forecasts to optimizewarehousing and employment of stafffirms need to forecasts cash-flows in order to account ofilliquidity phases or insolvencyuniversity administrations needs forecasts of the number ofstudents for calculation of student fees, staff planning,space organizationmigration flowshouse prices
34 / 212
![Page 35: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/35.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Components of time series data
Time series decomposition
Time Series
Trend Cyclical
Seasonal Irregular
35 / 212
![Page 36: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/36.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Components of time series data
Time series decomposition
Classical additive decomposition:
yt = dt + ct + st + εt (1)
dt trend component (deterministic, almost constant overtime)ct cyclical component (deterministic, periodic, mediumterm horizons)st seasonal component (deterministic, periodic; more thanone possible)εt irregular component (stochastic, stationary)
36 / 212
![Page 37: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/37.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Components of time series data
Time series decomposition
Goal:Extraction of components dt , ct and st
The irregular component
εt = yt − dt − ct − st
should be stationary and ideally white noise.Main task is then to model the components appropriately.Data transformation maybe necessary to account forheteroscedasticity (e.g. log-transformation to stabilizeseasonal fluctuations)
37 / 212
![Page 38: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/38.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Components of time series data
Time series decomposition
The multiplicative model:
yt = dt · ct · st · εt (2)
will be treated in the tutorial.
38 / 212
![Page 39: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/39.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Simple Filters
series = signal + noise (3)
The statistician would says
series = fit + residual (4)
At a later stage:
series = model + errors (5)
⇒ mathematical function plus a probability distribution ofthe error term
39 / 212
![Page 40: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/40.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Linear Filters
A linear filter converts one times series (xT ) into another (yt ) bythe linear operation
yt =+s∑
r=−q
ar xt+r
where ar is a set of weights. In order to smooth local fluctuationone should chose the weight such that∑
ar = 1
40 / 212
![Page 41: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/41.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
The idea
yt = f (t) + εt (6)
We assume that f (t) and εt are well-behaved.Consider N observations at time tj which are reasonably closein time to ti . One possible smoother is
y∗ti = 1/N∑
ytj = 1/N∑
f (tj) + 1/N∑
εtj ≈ f (ti) + 1/N∑
εtj(7)
if εt ∼ N(0, σ2), the variance of the sum of the residuals isσ2/N2.The smoother is characterized by
span, the number of adjacent points included in thecalculationtype of estimator (median, mean, weighted mean etc.)
41 / 212
![Page 42: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/42.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average
Used for time series smoothing.Consists of a series of arithmetic means.Result depends on the window size L (number of includedperiods to calculate the mean).In order to smooth the cyclical component, L shouldexceed the cycle lengthL should be uneven (avoids another cyclical component)
42 / 212
![Page 43: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/43.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average
MA(yt ) =1
2q + 1
+q∑r=−q
yt+r
L = 2q + 1
where the weights are given by
ar =1
2q + 1
43 / 212
![Page 44: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/44.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average
Two-Sided MA:
MA(yt ) =1
2q + 1
+q∑r=−q
yt+r
One-sided MA:
MA(yt ) =1
q + 1
q∑r=0
yt−r
44 / 212
![Page 45: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/45.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average
Example: Moving Average (MA) over 3 PeriodsFirst MA term: MA2(3) = y1+y2+y3
3
Second MA term: MA3(3) = y2+y3+y43
45 / 212
![Page 46: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/46.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average
46 / 212
![Page 47: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/47.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average Example - TWO-sided20
4060
8010
0120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
IP
2040
6080
1001
201950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(3)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(5)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(7)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(9)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(11)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(25)
2040
6080
100
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(51)20
4060
8010
0
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(101)
⇒ the larger L the smoother and shorter the filtered series
47 / 212
![Page 48: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/48.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average Example - One-sided20
4060
8010
0120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
IP
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(3)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(5)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(7)20
4060
8010
0120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(9)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(11)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(25)
2040
6080
1001
20
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(51)
2040
6080
100
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
MA(101)
48 / 212
![Page 49: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/49.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Moving Average Example - Comparison of One- andtwo-sided
2040
6080
100
120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
two-sided MA(11) one-sided MA(11)
IP
2040
6080
100
120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
two-sided MA(51) one-sided MA(51)
IP
49 / 212
![Page 50: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/50.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
EXAMPLE
Generate a random time series (normally distributed) withT = 20
Quick and dirty: Moving Average with ExcelNice and Slow: Write a simple Matlab program forcalculating a moving average of order LAdditional Task: Increase the number of observations toT = 100, include a linear time trend and calculate differentMAsVariation: Include some outliers and see how thecalculations change.
50 / 212
![Page 51: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/51.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Exponential Smoothing
weighted moving averageslatest observation has the highest weight compared to theprevious periods
yt = wyt + (1− w)yt−1
Repeated substitution gives:
yt = wt−1∑s=0
(1− w)syt−s
⇒ that’s why it is called exponential smoothing, forecasts arethe weighted average of past observations where the weightsdecline exponentially with time.
51 / 212
![Page 52: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/52.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Exponential Smoothing
Is used for smoothing and short–term forecastingChoice of w :
subjective or through calibrationnumbers between 0 and 1Close to 0 for smoothing out unpleasant cyclical or irregularcomponentsClose to 1 for forecasting
52 / 212
![Page 53: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/53.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Exponential Smoothing
yt = wyt + (1− w)yt−1 w = 0.2
53 / 212
![Page 54: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/54.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Some simple filters
Exponential Smoothing20
4060
8010
012
0
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
IP
2040
6080
100
120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
w=0.05
2040
6080
100
120
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
w=0.220
4060
8010
012
0
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
w=0.95
54 / 212
![Page 55: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/55.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Trend Component
positive or negative trendobserved over a longer time horizonlinear vs. non–linear trendsmooth vs. non–smooth trends⇒ trend is ’unobserved’ in reality
55 / 212
![Page 56: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/56.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Trend Component: Example0
510
1520
0 50 100 150 200time
Linear Trend with cyclical component
0.5
11.
52
2.5
0 50 100 150 200time
Nonlinear Trend with cyclical component
56 / 212
![Page 57: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/57.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Why is trend extraction so important?
The case of detrending GDPtrend GDP is denoted as potential outputThe difference between trend and actual GDP is called theoutput gapIs an economy below or above the current trend? (Or is theoutput gap positive or negative?)⇒ consequences for economic policy (wages, prices etc.)Trend extraction can be highly controversial!
57 / 212
![Page 58: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/58.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Linear Trend Model
Year Time (xt ) Turnover (yt )05 1 206 2 507 3 208 4 209 5 710 6 6
yt = α + βxt
58 / 212
![Page 59: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/59.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Linear Trend Model
Estimation with OLS
yt = α + βxt = 1.4 + 0.743xt
Forecast for 2011:
y2011 = 1.4 + 0.743 · 7 = 6.6
59 / 212
![Page 60: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/60.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Quadratic Trend Model
Year Time (xt ) Time2 (x2t ) Turnover (yt )
05 1 1 206 2 4 507 3 9 208 4 16 209 5 25 710 6 36 6
yt = α + β1xt + β2x2t
60 / 212
![Page 61: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/61.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Quadratic Trend Model
yt = α + βxt + β2x2t = 3.4− 0.757143xt + 0.214286x2
t
Forecast for 2011:
y2011 = 3.4− 0.757143 · 7 + 0.214286 · 72 = 8.6
61 / 212
![Page 62: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/62.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Exponential Trend ModelYear Time (xt ) Turnover (yt )05 1 206 2 507 3 208 4 209 5 710 6 6
yt = αβxt1
⇒ Non-linear Least Squares (NLS) orLinearize the model and use OLS:
log yt = logα + log(β1)xt
⇒ ’relog’ the model62 / 212
![Page 63: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/63.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Exponential Trend Model
Estimation via NLS:
yt = α + β1xt
= 0.08 · 1.93xt
Forecast for 2011:
y2011 = 0.08 · 1.937 = 15.4
63 / 212
![Page 64: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/64.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Logarithmic Trend Model
Year Time (xt ) log(Time) Turnover (yt )05 1 log(1) 206 2 log(2) 507 3 log(3) 208 4 log(4) 209 5 log(5) 710 6 log(6) 6
Logarithmic Trend:yt = α + β1 log xt
64 / 212
![Page 65: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/65.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Logarithmic Trend Model
Estimation via OLS:
yt = α + β1 log xt = 1.934675 + 1.883489 · log yt
Forecast for 2011:
Y2011 = 1.934675 + 1.883489 · log(7) = 5.6
65 / 212
![Page 66: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/66.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Comparison of different trend models2
34
56
7
2005 2006 2007 2008 2009 2010
Turnover Linear TrendQuadratic Trend Exponential TrendLogarithmic Trend
66 / 212
![Page 67: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/67.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Detrending GDP60
7080
9010
011
0
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1
GDP Linear TrendQuadratic Trend Logarithmic Trend
67 / 212
![Page 68: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/68.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Which trend model to choose?Linear Trend model, if the first differences
yt − yt−1
are stationaryQuadratic trend model, if the second differences
(yt − yt−1)− (yt−1 − yt−2)
are stationaryLogarithmic trend model, if the relative differences
yt − yt−1
yt
are stationary68 / 212
![Page 69: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/69.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
The Hodrick-Prescott-Filter (HP)
The HP extracts a flexible trend. The filter is given by
minµt
T∑t=1
[(yt − µt )2 + λ
T−1∑t=2
{(µt+1 − µt )− (µt − µt−1)}2] (8)
where µt is the flexible trend and λ a smoothness parameterchosen by the researcher.
As λ approaches infinity we obtain a linear trend.Currently the most popular filter in economics.
69 / 212
![Page 70: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/70.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
The Hodrick-Prescott-Filter (HP)
How to choose λ?Hodrick-Prescot (1997) recommend:
λ =
100 for annual data1600 for quarterly data14400 for monthly data
(9)
Alternative: Ravn and Uhlig (2002)
70 / 212
![Page 71: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/71.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
The Hodrick-Prescott-Filter (HP)80
9010
011
0
1990m1 1995m1 2000m1 2005m1 2010m1 2015m1
IP λ=14,400λ=50,000 λ=1,000,000
71 / 212
![Page 72: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/72.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
The Hodrick-Prescott-Filter (HP)-1
5-1
0-5
05
10
1990m1 1995m1 2000m1 2005m1 2010m1 2015m1
λ=14,400 λ=50,000λ=1,000,000
72 / 212
![Page 73: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/73.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Problems with the HP-Filter
λ is a ’tuning’ parameterend of sample instability⇒ AR-forecasts
73 / 212
![Page 74: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/74.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Case study for German GDP: Where are we now?80
9010
011
0G
DP
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1time
Germany: GDP (seasonal and workday-adjusted, Chain index)
74 / 212
![Page 75: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/75.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
HP-Filter80
9010
011
0
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1
GDP GDP HP-filtered Trend
GDP and HP-Trend
-4-2
02
41990q1 1995q1 2000q1 2005q1 2010q1 2015q1
GDP Cycle
75 / 212
![Page 76: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/76.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
Can we test for a trend?
Yes and noIs the trend component significant?several trends can be significantTrend might be spuriousIs it plausible to have a trend in the data?A priori information by the researcherunit roots
76 / 212
![Page 77: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/77.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Trend extraction
EXAMPLE
Time series: Industrial Production in Germany(1991:01-2016:12)
Plot the time series and state which trend adjustmentmight be appropriatePrepare your data set in Excel and estimate various trendsin EviewsWhich trend would you choose?
77 / 212
![Page 78: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/78.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Cyclical Component
Cyclical Component
is not always present in time seriesIs the difference between the observed time series and theestimated trend
In economicscharacterizes the Business cycledifferent length of cycles (3-5 or 10-15 years)
78 / 212
![Page 79: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/79.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Cyclical Component
Cyclical Component: Example-4
-20
24
1990q1 1995q1 2000q1 2005q1 2010q1 2015q1
GDP Cycle
79 / 212
![Page 80: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/80.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Cyclical Component
Cyclical Component: Example II0
5010
015
020
0Su
nspo
ts
1700 1800 1900 2000time
80 / 212
![Page 81: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/81.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Cyclical Component
Cyclical Component: Example III4
4.5
55.
56
ECG
0 2000 4000 6000 8000 10000Time
81 / 212
![Page 82: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/82.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Cyclical Component
Can we test for a cyclical component?
Yes and nosee the trend sectionDoes a cycle make sense?
82 / 212
![Page 83: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/83.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Componentsimilar upswings and downswings in a fixed time intervalregular pattern, i.e. over a year
050
100
150
Ret
ail S
ales
- C
hain
Inde
x
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1time
Germany: Retail Sales - non-seasonal adjusted
83 / 212
![Page 84: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/84.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Types of Seasonality
A: yt = mt + St + εt
B: yt = mtSt + εt
C: yt = mtStεt
Model A is additive seasonal, Models B and C containsmultiplicative seasonal variation
84 / 212
![Page 85: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/85.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Types of Seasonality
if the seasonal effect is constant over the seasonal periods⇒ additive seasonality (Model A)if the seasonal effect is proportional to the mean⇒ multiplicative seasonality (Model A and B)in case of multiplicative seasonal models use thelogarithmic transformation to make the effect additive
85 / 212
![Page 86: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/86.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal AdjustmentSimplest Approach to seasonal adjustment:
Run the time series on a set of dummies without a constant(Assumes that the seasonal pattern is constant over time)the residuals of this regression are seasonal adjustedExample: Monthly data
yt =12∑
i=1
βiDi + εt
εt = yt −12∑
i=1
βDi
yt ,sa = εt + mean(yt )
The most well known seasonal adjustment procedure:CENSUS X12 ARIMA
86 / 212
![Page 87: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/87.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Adjustment: Dummy Regression Example80
100
120
140
1990m1 1995m1 2000m1 2005m1 2010m1
Actual Fitted-1
0-5
05
1015
1990m1 1995m1 2000m1 2005m1 2010m1
87 / 212
![Page 88: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/88.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Adjustment: Example80
100
120
140
1990m1 1995m1 2000m1 2005m1 2010m1
Retail Sales
9095
100
105
110
115
1990m1 1995m1 2000m1 2005m1 2010m1
Dummy Approach
9510
010
511
0
1990m1 1995m1 2000m1 2005m1 2010m1
ARIMA X1280
100
120
140
1990m1 1995m1 2000m1 2005m1 2010m1
Actual Dummy ApproachARIMA X12
Comparison
88 / 212
![Page 89: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/89.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Moving Averages
For monthly data one can employ the filter
SMA(yt ) =12yt−6 + yt−5 + yt−4 + . . .+ yt+6 + 1
2yt+6
12
or for quarterly data
SMA(yt ) =12yt−2 + yt−1 + yt + yt+1 + 1
2yt+2
4
Note: The weights add up to one!Standard moving average not applicable
89 / 212
![Page 90: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/90.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Moving Averages: Retail Sales Example0
5010
015
0
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
Retail Sales Monthly seasonal filter
90 / 212
![Page 91: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/91.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Differencing
seasonal effect can be eliminated using the a simple linearfilterin case of a monthly time series: ∆12yt = yt − yt−12
in case of a quarterly time series: ∆4yt = yt − yt−4
91 / 212
![Page 92: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/92.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Seasonal Differencing: Retail Sales Example-4
0-2
00
2040
1950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
Monthly Differences
-10
-50
510
151950m1 1960m1 1970m1 1980m1 1990m1 2000m1 2010m1
Yearly Differences
92 / 212
![Page 93: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/93.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
Can we test for seasonality?
Yes and noDoes seasonality makes sense?Compare the seasonal adjusted and unadjusted serieslook into the ARIMA X12 outputBe aware of changing seasonal patterns
93 / 212
![Page 94: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/94.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Seasonal Component
EXAMPLE
Time series: seasonally unadjusted Industrial Production inGermany (1991:01-2011:02)
Remove the seasonality by a moving seasonal filterTry the dummy approachFinally, use the ARIMAX12-ApproachStart the sample in 1991:01 and compare all filters with thefull sample
94 / 212
![Page 95: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/95.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Irregular Component
Irregular Component
erratic, non-systematic, random "residual" fluctuations dueto random shocks
in naturedue to human behavior
no observable iterations
95 / 212
![Page 96: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/96.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Irregular Component
Can we test for an irregular component?
YESseveral tests available whether the irregular component isa white noise or not
96 / 212
![Page 97: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/97.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
White Noise
A process {yt} is called white noise if
E(yt ) = 0γ(0) = σ2
γ(h) = 0 for |h| > 0
⇒ all yt ’s are uncorrelated. We write: {yt} ∼WN(0, σ2)
97 / 212
![Page 98: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/98.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
White Noise-3
-2-1
01
2
0 20 40 60 80 100
-3-2
-10
12
0 20 40 60 80 100
-3-2
-10
12
0 20 40 60 80 100
-2-1
01
23
0 20 40 60 80 100
98 / 212
![Page 99: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/99.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
White Noise-4
-20
2
0 20 40 60 80 100
sigma=1
-4-2
02
46
0 20 40 60 80 100
sigma=2
-40
-20
020
0 20 40 60 80 100
sigma=10-3
00-2
00-1
000
100
200
0 20 40 60 80 100
sigma=100
99 / 212
![Page 100: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/100.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Random Walk (with drift)
A simple random walk is given by
yt = yt−1 + εt
By adding a constant term
yt = c + yt−1 + εt
we get a random walk with drift. It follows that
yt = ct +t∑
j=1
εj
100 / 212
![Page 101: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/101.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Random Walk: Examples-2
0-1
00
1020
0 20 40 60 80 100
101 / 212
![Page 102: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/102.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Random Walk with Drift: Examples0
5010
015
0
0 20 40 60 80 100
102 / 212
![Page 103: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/103.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
EXAMPLE
Fun with Random WalksGenerate 50 different random walksPlot all random walksTry different variances and distributions
103 / 212
![Page 104: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/104.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Autoregressive processes
especially suitable for (short-run) forecastsutilizes autocorrelations of lower order
1st order: correlations of successive observations2nd order: correlations of observations with two periods inbetween
Autoregressive model of order p
yt = α + β1yt−1 + β2yt−2 + . . .+ βpyt−p + εt
104 / 212
![Page 105: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/105.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Autoregressive processesNumber of machines produced by a firm
Year Units2003 42004 32005 22006 32007 22008 22009 42010 6
⇒ Estimation of an AR model of order 2
yt = α + β1yt−1 + β2yt−2 + εt
105 / 212
![Page 106: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/106.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Autoregressive processes
Estimation Table:Year Constant yt yt−1 yt−22003 1 42004 1 3 42005 1 2 3 42006 1 3 2 32007 1 2 3 22008 1 2 2 32009 1 4 2 22010 1 6 4 2
⇒ OLSyt = 3.5 + 0.8125yt−1 − 0.9375yt−2
106 / 212
![Page 107: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/107.jpg)
Univariate Time Series Analysis
An (unconventional) introduction
Simple Linear Models
Autoregressive processes
Forecasting with an AR(2) model:
yt = 3.5 + 0.8125yt−1 − 0.9375yt−2
y2011 = 3.5 + 0.8125y2010 − 0.9375y2009
= 3.5 + 0.8125 · 6− 0.9375 · 4= 4.625
107 / 212
![Page 108: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/108.jpg)
Univariate Time Series Analysis
A more formal introduction
Table of content I1 Organizational Details and Outline
2 An (unconventional) introductionTime series CharacteristicsNecessity of (economic) forecastsComponents of time series dataSome simple filtersTrend extractionCyclical ComponentSeasonal ComponentIrregular ComponentSimple Linear Models
3 A more formal introduction
4 (Univariate) Linear ModelsNotation and Terminology
108 / 212
![Page 109: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/109.jpg)
Univariate Time Series Analysis
A more formal introduction
Table of content IIStationarity of ARMA ProcessesIdentification Tools
109 / 212
![Page 110: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/110.jpg)
Univariate Time Series Analysis
A more formal introduction
Stochastic Processes
A stochastic process can be described as ’a statisticalphenomenon that evolvoes in time according to probabilisticterms’.
110 / 212
![Page 111: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/111.jpg)
Univariate Time Series Analysis
A more formal introduction
Stochastic ProcessesLet yt be an index (t ∈ Z ) random variable.The sequence {yt}t∈Z is called a stochastic process.Stochastic processes can be studied both in the time andfrequency domain.⇒We focus on the time domain.For stochastic processes the expectation value, varianceand covariance are the theoretical counterparts to the timeseries mean, variance and covariance.A time series is a realization of a stochastic process.In order to characterize stochastic processes we have tofocus on stationary processes.An important class of stationary processes are linearARIMA (autoregressive integrated moving average)processes.
111 / 212
![Page 112: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/112.jpg)
Univariate Time Series Analysis
A more formal introduction
Stochastic Processes
most statistical problems are concerned with estimatingthe properties of a population from a samplethe latter one is typically determined by the investigator,including sample size and whether randomness isincorporated into the selection processtime series analysis is different, as it usually impossible tomake more than one observation at any given timeit is possible to increase the sample size by varying thelength of the observed time seriesbut there will be only a single outcome of the process anda single observation on the random variable at time t
112 / 212
![Page 113: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/113.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modeling
time series are sampled either with regular (equidistant) orirregular intervals (non-equidistant)regular time intervals: yearly, quarterly, monthly, weekly,daily, hourly, etc. (⇒ continuous flow)irregular intervals: transaction prices of stocks
113 / 212
![Page 114: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/114.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modeling
A time series {yt , t = . . .− 1,0,1, . . .} can be interpretedas a realisation of a stochastic processFor time series with finite first and second moments wedefine
mean function: µ(t) = E(yt )covariance function:
γ(t , t + h) = Cov(yt , yt+h)
= E[(yt − µ(t))(yt+h − µ(t))]
the Autocorrelation function: ρ(h) = γ(h)/γ(0) = γ(h)/σ2
114 / 212
![Page 115: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/115.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modeling
The concept of stationarity plays a central role in time seriesanalysis.
A time series {yt} is weakly stationary, if for all t :µ(t) = µ, i.e., it does not depend on t , andγ(t + h, t) = γ(h), depends only on h and not on t
This means, that for all h die time series {yt} moves in asimilar way as the "shifted" time series {yt+h}.
115 / 212
![Page 116: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/116.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modeling
Assuming that yt is weakly stationary, we define theAutocovariance function (ACVF) for lag h
γ(h) = γ(t , t − h)
and the autocorrelation function(ACF)
ρ(h) = γ(h)/γ(0) = Corr(yt , yt−h)
The ACF is a sequence of correlation with the followingcharacteristics
−1 ≤ ρ(h) ≤ 1 mit ρ(0) = 1.
116 / 212
![Page 117: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/117.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modeling
The ACVF has the following properties:γ(0) ≥ 0,|γ(h)| ≤ γ(0), for all hγ(h) = γ(−h), for all h
117 / 212
![Page 118: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/118.jpg)
Univariate Time Series Analysis
A more formal introduction
Basic Approach to time series modelingStep 1: Data inspection, data cleaning (exclusion ofoutliers), data transformation (e.g. seasonal or trendadjustment),Step 2: Choice of a specific model that accounts best forthe (adjusted) data at handStep 3: Specification and estimation of parameters of themodelStep 4: Check the estimated model, if necessary go backto step 3, 2, or 1Step 5: Use the model in practice
compact description of the datainterpretation of the data characteristicsinference, testing of hypotheses (in-sample)forecasting (out-of-sample)
118 / 212
![Page 119: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/119.jpg)
Univariate Time Series Analysis
A more formal introduction
Be careful!
Basic Assumption: Characteristics of a time series remainconstant also in the future.Forecasting with "mechanical" trend projections withoutconsidering experience and subjective elements("judgemental forecasts")
119 / 212
![Page 120: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/120.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Table of content I1 Organizational Details and Outline
2 An (unconventional) introductionTime series CharacteristicsNecessity of (economic) forecastsComponents of time series dataSome simple filtersTrend extractionCyclical ComponentSeasonal ComponentIrregular ComponentSimple Linear Models
3 A more formal introduction
4 (Univariate) Linear ModelsNotation and Terminology
120 / 212
![Page 121: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/121.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Table of content IIStationarity of ARMA ProcessesIdentification Tools
121 / 212
![Page 122: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/122.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Linear Difference Equations
Time series models can be represented or approximated by alinear difference equation. Consider the situation where arealization at time t , yt , is a linear function of the last prealizations of y and a random disturbance term, denoted by εt .
yt = α1yt−1 + α2yt−2 + · · ·+ αpyt−p + εt . (10)
⇒ AR(p)-Process
122 / 212
![Page 123: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/123.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The Lag Operator
The lag operator (also called backward shift operator), denotedby L, is an operator that shifts the time index backward by oneunit. Applying it to a variable at time t , we obtain the value ofthe variable at time t − 1, i.e.,
Lyt = yt−1.
Applying the lag operator twice amount to lagging the variabletwice, i.e., L2yt = L(Lyt ) = Lyt−1 = yt−2.
123 / 212
![Page 124: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/124.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The Lag Operator
More formally, the lag operator transforms one time series, say{xt}∞t=−∞, into another series, say {yt}∞t=−∞, where xt = yt−1.Raising L to a negative power, we obtain a delay (or lead)operator, i.e.,
L−kyt = yt+k .
124 / 212
![Page 125: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/125.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The Lag Operator
The following statements hold for the lag operator L
Lc = c for a constant c (11)(Lj + Li)yt = Ljyt + Liyt (distributive law) (12)
Li(Ljyt ) = Liyt−j (associative law) (13)aLyt = L(ayt ) = ayt−1 (14)
125 / 212
![Page 126: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/126.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The Difference Operator
The difference operator ∆ is used to express the differencebetween values of time series at different times. With ∆yt wedenote the first difference of yt , i.e.,
∆yt = yt − yt−1.
It follows that
∆2yt = ∆(∆yt ) = ∆(yt − yt−1)
= (yt − yt−1)− (yt−1 − yt−2) = yt − 2yt−1 + yt−2
etc. The difference operator can expressed in terms of the lagoperator by ∆ = 1− L. Hence, ∆2 = (1− L)2 = 1− 2L + L2
and, in general, ∆n = (1− L)n.
126 / 212
![Page 127: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/127.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Transforming the Expression of Time Series ModelsThe lag operator enables us to express higher–order differenceequations more compactly in form of polynomials in lagoperator L.For example, the difference equation
yt = α1yt−1 + α2yt−2 + α3yt−3 + c
can be written as
yt = α1Lyt + α2L2yt + α3L3yt + c,
(1− α1L− α2L2 − α3L3)yt = c
or, in short,
a(L)yt = c.127 / 212
![Page 128: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/128.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The Characteristic Equation
Replacing in polynomial a(L) lag operator L by variable λ, weobtain the characteristic equation associated with differenceequation (10):
a(λ) = 0. (15)
A value of λ which satisfies characteristic equation (15) iscalled a root of polynomial a(λ).⇒Will be important in later applications.
128 / 212
![Page 129: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/129.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Solving Difference Equations
Expression (15) represents the so-called coefficient form of acharacteristic equation, i.e.,
1− α1λ− · · · − αpλp = 0.
An alternative is the root form given by
(λ1 − λ)(λ2 − λ) · · · (λp − λ) =
p∏i=1
(λi − λ) = 0.
129 / 212
![Page 130: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/130.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Solving Difference Equations: An ExampleConsider the difference equation
yt =32
yt−1 −12
yt−2 + εt .
The characteristic equation in coefficient form is given by
1− 32λ+
12λ2 = 0
or2− 3λ+ 1λ2 = 0,
which can be written in root form as
(1− λ)(2− λ) = 0.
Here, λ1 = 1 and λ2 = 2 represent the set of possible solutionsfor λ satisfying the characteristic equation 1− 3
2λ+ 12λ
2 = 0.130 / 212
![Page 131: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/131.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Solving Difference Equations: An Example
Calculate the characteristic roots of the following differenceequations
yt = yt−1 − yt−2 + εt (16)yt = −yt−1 + yt−2 + εt (17)yt = 0.125yt−3 + εt (18)
131 / 212
![Page 132: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/132.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Autoregressive (AR) Processes
An autoregressive process of order p, or briefly an AR(p)process, is a process where realization yt is a weighted sum ofpast p realizations, i.e., yt−1, yt−2, . . . , yt−p, plus an additive,contemporaneous disturbance term, denoted by εt .The process can be represented by the p-th order differenceequation
yt = α1yt−1 + α2yt−2 + . . .+ αpyt−p + εt . (19)
132 / 212
![Page 133: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/133.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Autoregressive (AR) Processes
yt = α1yt−1 + α2yt−2 + . . .+ αpyt−p + εt . (20)
We assume that εt , t = 0,±1,±2 . . ., is a zero-mean,independently and identically distributed (iid) sequence with
E(εt ) = 0, E(εsεt ) =
{σ2, if s = t ,0, if s 6= t ,
(21)
for all t and s. Sequence (21) is called a zero–meanwhite–noise process, or simply white noise.
133 / 212
![Page 134: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/134.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Autoregressive (AR) Processes
Using the lag operator L, the AR(p) process (19) can beexpressed more compactly as
(1− α1L− α2L2 − . . .− αpLp)yt = εt
or
a(L)yt = εt , (22)
where the autoregressive polynomial a(L) is defined bya(L) = 1− α1L− α2L2 − . . .− αpLp.
134 / 212
![Page 135: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/135.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The mean of a stationary AR(1) process
yt = α0 + α1yt−1 + εt
Taking Expectations (E) we get
E(yt ) = α0 + α1E(yt−1) + E(εt )
E(yt ) = α0 + α1E(yt )
E(yt ) = µ =α0
1− α1
135 / 212
![Page 136: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/136.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The mean of a stationary AR(p) process
We the same technique one can obtain the mean of an AR(2)process
E(yt ) = µ =α0
1− α1 − α2
and an AR(p) process
E(yt ) = µ =α0
1− α1 − α2 − . . .− αp
136 / 212
![Page 137: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/137.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Examples
Calculate the mean of the following AR processes
yt = 0.5yt−1 + εt (23)yt = 0.5 + 0.5yt−1 + εt (24)yt = 0.5− 0.5yt−1 + εt (25)yt = 0.5 + 0.5yt−1 + 0.5yt−2 + εt (26)
137 / 212
![Page 138: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/138.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
AR Examples-4
-20
24
0 20 40 60 80 100
a=0.5
-20
24
6
0 20 40 60 80 100
a=0.5
-6-4
-20
2
0 20 40 60 80 100
a=0.95-2
.00e
+34
-1.5
0e+3
4-1
.00e
+34
-5.0
0e+3
30.
00e+
00
0 20 40 60 80 100
a=1.5
138 / 212
![Page 139: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/139.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Moving Average (MA) Processes
A moving average process of order q, denoted by MA(q), is theweighted sum of the preceding q lagged disturbances plus acontemporaneous disturbance term, i.e.,
yt = β0 + β1εt−1 + . . .+ βqεt−q + εt (27)
oryt = b(L)εt . (28)
Here b(L) = β0 + β1L + β2L2 + . . .+ βqLq denotes a movingaverage polynomial of degree q, and εt is again a zero-meanwhite noise process.
139 / 212
![Page 140: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/140.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
MA Examples-2
-10
12
3
0 20 40 60 80 100
b=0.5
-4-2
02
4
0 20 40 60 80 100
b=0.5
-3-2
-10
12
0 20 40 60 80 100
b=0.95-4
-20
24
0 20 40 60 80 100
b=1.5
140 / 212
![Page 141: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/141.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The mean of a stationary MA(q) process
yt = β0 + β1εt−1 + . . .+ βqεt−q + εt
Taking expectations we get
E(yt ) = µ = β0
becauseE(εt ) = E(εt−1) = . . . = E(εt−q) = 0
141 / 212
![Page 142: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/142.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Relationship between AR and MAConsider the AR(1) process
yt = α1yt−1 + εt
Repeated substitution yields
yt = α1(α1yt−2 + εt−1) + εt
= α21yt−2 + α1εt−1 + εt
= α21(α1yt−3 + εt−1) + α1εt−1 + εt
= . . .
=∞∑
j=1
αj1εt−j + εt
i.e., each stationary AR(1) process can be represented as anMA(∞) process.
142 / 212
![Page 143: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/143.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The mean of a stationary AR(q) process
Whiteboard
Alternative derivation of the mean of an stationary AR(1)process
yt = c + ayt−1 + εt (29)
with∣∣a∣∣ < 1.
143 / 212
![Page 144: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/144.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Relationship between AR and MA
For a general stationary AR(p) process
yt = α1yt−1 + α2yt−2 + . . .+ αpyt−p + εt
a(L)yt = εt
we have
yt = a(L)−1εt = φ(L)εt =∞∑
j=1
φjεt−j (30)
where φ(L) is an operator satisfying a(L)φ(L) = 1.
144 / 212
![Page 145: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/145.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Autoregressive Moving Average (ARMA) Processes
The AR and MA processes just discussed can be regarded asspecial cases of a mixed autoregressive moving averageprocess, in short, an ARMA(p,q) process. It is written as
yt = α1yt−1 + . . .+ αpyt−p + εt + β1εt−1 + . . .+ βqεt−q (31)
ora(L)yt = b(L)εt . (32)
Clearly, ARMA(p,0) and ARMA(0,q) processes correspond topure AR(p) and MA(q) processes, respectively.
145 / 212
![Page 146: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/146.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
The mean of a stationary ARMA(p,q) process
For
yt = α0 +α1yt−1 + . . .+αpyt−p +β1εt−1 + . . .+βqεt−q + εt (33)
we getE(yt ) = µ =
α0
1− α1 − α2 − . . .− αp
applying the previous arguments.
146 / 212
![Page 147: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/147.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Examples
Calculate the mean of the following ARMA processes
yt = 0.5εt−1 + εt (34)yt = 1500εt−1 + 0.5 + 0.75yt−1 + εt − 0.8εt−2 (35)yt = 0.5− 0.5yt−1 + 2εt−1 + 0.8εt−2 + εt (36)yt = yt−1 + 0.5εt−1 + εt (37)
147 / 212
![Page 148: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/148.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
ARMA Examples-4
-20
24
0 20 40 60 80 100
AR(1)
-2-1
01
23
0 20 40 60 80 100
MA(1)
-4-2
02
4
0 20 40 60 80 100
ARMA(1,1)
148 / 212
![Page 149: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/149.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
ARMA Processes With Exogenous Variables (ARMAXProcesses)
ARMA processes that also include current and/or lagged,exogenously determined variables are called ARMAXprocesses. Denoting the exogenous variable by yt , an ARMAXprocess has the form
a(L)yt = b(L)εt + g(L)xt . (38)
149 / 212
![Page 150: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/150.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Example: ARX-models for Forecasting
a(L)yt = g(L)xt + εt (39)
yt = α +
p∑i=1
βiyt−i +
q∑j=1
γjxt−j + εt (40)
For example: Forecasting German Industrial Production with itsown lagged values plus an exogenous indicator (e.g. the IfoBusiness Climate)⇒ Section about prediction
150 / 212
![Page 151: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/151.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Integrated ARMA (ARIMA) Processes
Very often we observe that the mean and/or variance ofeconomic time series increase over time. In this case, we saythe series are nonstationary. However, a series of the changesfrom one period to the next, i.e., the first differences, may havea mean and/or variance that do not change over time.⇒ Model the differenced series
151 / 212
![Page 152: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/152.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Integrated ARMA (ARIMA) Processes
An ARMA model for the d-th difference of a series rather thanthe original series is called an autoregressive integrated movingaverage process, or an ARIMA (p,d ,q), process and written as
a(L)∆dyt = b(L)εt . (41)
152 / 212
![Page 153: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/153.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Notation and Terminology
Further Aspects
Seasonal ARMA Processes
αs(Ls)(1− Ls)Dyt = βs(Ls)εt , (42)
ARMA Processes with deterministic Components:Adding a constant
a(L)yt = c + b(L)εt . (43)
Or a linear Trend
a(L)yt = c0 + c1t + b(L)εt .
153 / 212
![Page 154: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/154.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
The Concept of Stationarity
Stationarity is a property that guarantees that the essentialproperties of a time series remain constant over time. Animportant concept of stationarity is that of weak stationarity.Time series {yt}∞t=−∞ is said to be weakly stationary if:(1) the mean of yt is constant over time, i.e., E(yt ) = µ,|µ| <∞;
(2) the variance of yt is constant over time, i.e., Var(yt ) =γ0 <∞;
(3) the covariance of yt and yt−k does not vary over time, butmay depend on the lag k , i.e., Cov(yt , yt−k ) = γk , |γk | <∞.
⇒ A process is called strongly (strictly) stationary if the jointdistribution of (y1, ...yk ) is identical to that of (y1+t , ...yk+t ).
154 / 212
![Page 155: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/155.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(p) processes
An AR(p) is stationary if the absolute values of all the roots ofthe characteristic equation
α0 − α1λ− · · · − αpλp = 0.
are greater than 1 (with α0 = 1).This is in practice difficult to realize.What about forth order characteristic equations?Alternative: Employ the Schur Criterion
155 / 212
![Page 156: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/156.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(p) processes: The Schur Criterion
If the determinants
A1 =
∣∣∣∣α0 αpαp α0
∣∣∣∣ ,A2 =
∣∣∣∣∣∣∣∣α0 0 αp αp−1α1 α0 0 αpαp 0 α0 α1αp−1 αp 0 α0
∣∣∣∣∣∣∣∣ . . .
156 / 212
![Page 157: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/157.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(p) processes: The Schur Criterion
and
Ap =
∣∣∣∣∣∣∣∣∣∣∣∣∣∣∣∣
α0 0 . . . 0 αp αp−1 . . . α1α1 α0 . . . 0 0 αp . . . α2. . . . . . . . . . . . . . . . . . . . . . . .αp−1 αp−2 . . . α0 0 0 . . . αpαp 0 . . . 0 α0 α1 . . . αp−1αp−1 αp−1 . . . 0 0 α0 . . . αp−2. . . . . . . . . . . . . . . . . . . . .α1 α2 . . . αp 0 0 . . . α0
∣∣∣∣∣∣∣∣∣∣∣∣∣∣∣∣.
are all positive, then an AR(p) process is stationary.
157 / 212
![Page 158: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/158.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of an AR(1) Process
Consider the AR(1) process
yt = α1yt−1 + εt
The characteristic equation is
1− α1λ = 0
We have
A1 =
∣∣∣∣α0 αpαp α0
∣∣∣∣ =
∣∣∣∣ 1 −α1−α1 1
∣∣∣∣= 1− α2
1 > 0⇐⇒∣∣α1∣∣ < 1
158 / 212
![Page 159: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/159.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(p) processes: An AlternativeSchur Criterion
For the AR polynomial a(L) = 1− α1L− . . .− αpLp, the Schurcriterion requires the construction two lower-triangular Toeplitzmatrices, A1 and A2, whose first columns consist of the vectors(1,−α1,−α2, . . . ,−αp−1)′ and (−αp,−αp−1, . . . ,−α1)′,respectively, i.e.,
A1 =
1 0 · · · 0 0−α1 1 0
−α2 −α1. . .
...... 0
−αp−1 −αp−2 · · · −α1 1,
159 / 212
![Page 160: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/160.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(p) processes: An AlternativeSchur Criterion
A2 =
−αp 0 · · · 0 0−αp−1 −αp 0
−αp−2 −αp−1...
.... . . 0
−α1 −α2 · · · −αp−1 −αp
.
Then, the AR (p) process is covariance stationary if and only ifthe so-called Schur matrix, defined by
Sa = A1A′1 − A2A′2, (44)
is positive definite.
160 / 212
![Page 161: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/161.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(1) processes: An AlternativeSchur Criterion
Foryt = α1yt−1 + εt
we get A1 = [1] and A2 = [−α1]∣∣Sa∣∣ = 1 · 1′ − (−α1) · (−α1)′ = 1− α2
1 > 0⇐⇒∣∣α1∣∣ < 1
161 / 212
![Page 162: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/162.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of AR(2) processes: An AlternativeSchur Criterion
Foryt = α1yt−1 + α2yt−2 + εt
we get
A1 =
[1 0−α1 1
],A2 =
[−α2 0−α1 −α2
]
Sa =
[1− α2
2 −α1 − α2α1−α1 − α2α1 1− α2
2
]
162 / 212
![Page 163: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/163.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of an AR(2) Process
For an AR(2) process covariance stationarity requires that theAR coefficients satisfy
|α2| < 1,α2 + α1 < 1, (45)α2 − α1 < 1.
163 / 212
![Page 164: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/164.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of MA(q) Processes
Pure MA processes are always stationary, because it has noautoregressive roots.
164 / 212
![Page 165: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/165.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity of ARMA(p,q) Processes
The stationarity property of the mixed ARMA process
a(L)yt = b(L)εt (46)
does not dependent on the values of the MA parameters.Stationarity is a property that depends solely on the ARparameters.
165 / 212
![Page 166: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/166.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Stationarity: Examples
α1 α2 Stationary?AR(1) 0.5AR(1) -0.99AR(1) 1AR(1) 1.5AR(2) 0.5 0.4AR(2) 0.2 -0.9AR(2) 1.5 -0.5
⇒ Same conclusions for ARMA models with q MA lags witharbitrary parameters (βi ).
166 / 212
![Page 167: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/167.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Stationarity of ARMA Processes
Examples
Are the following process stationary? Employ theSchur-Criterion:
yt = 0.5yt−1 + εt (47)yt = 0.5 + 0.5yt−1 + εt (48)yt = 0.5− 0.5yt−1 + εt (49)yt = 0.5 + 0.5yt−1 + 0.5yt−2 + εt (50)yt = 0.5 + 0.5yt−1 + 0.5yt−2 − 0.8yt−3 + 0.5εt−1 + εt (51)
167 / 212
![Page 168: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/168.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Autocovariance and Autocorrelation Functions
How to determine the order of an ARMA(p,q) process?Useful tools are the
sample autocovariance function (SACovF)and its scaled counterpart sample autocorrelation function(SACF)
168 / 212
![Page 169: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/169.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) Process
Derive the Autocovariance Function for an AR(1) process.
yt = ayt−1 + εt , (52)
where εt is the usual white–noise process with E(ε2t ) = σ2.
169 / 212
![Page 170: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/170.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) ProcessConsider the stationary AR(1) process
yt = ayt−1 + εt , (53)
where εt is the usual white–noise process with E(ε2t ) = σ2.To obtain the variance γ0 = E(y2
t ), multiply both sides of (52) byyt ,
y2t = aytyt−1 + ytεt ,
and take expectations, i.e.,
E(y2t ) = aE(ytyt−1) + E(ytεt )
orγ0 = aγ1 + E(ytεt ).
170 / 212
![Page 171: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/171.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) Process
Thus, to specify γ0, we have to determine γ1 and E(ytεt ). Toobtain the latter quantity, substitute the RHS of (52) for yt ,
E(ytεt ) = E[(ayt−1 + εt )εt ]
= aE(yt−1εt ) + E(ε2t ).
Since yt−1 is independent of the future disturbances εt+i ,i = 0,1, . . ., E(yt−1εt ) = 0 and E(ε2t ) = σ2,
E(εtyt ) = σ2.
Therefore,γ0 = aγ1 + σ2. (54)
171 / 212
![Page 172: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/172.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) Process
To determine γ1 = E(ytyt−1), we basically repeat the aboveprocedure. Multiplying (52) by yt−1 and taking expectations onboth sides gives
E(ytyt−1) = aE(y2t−1) + E(yt−1εt ).
Using E(yt−1εt ) = 0 and the fact that stationarity implies thatE(y2
t−1) = E(y2t ) = γ0, we have
γ1 = aγ0. (55)
172 / 212
![Page 173: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/173.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) Process
Substituting (55) into (54) and solving for γ0 gives theexpression for the theoretical variance of an AR(1) process,which we derived in the previous section,
γ0 =σ2
1− a2 . (56)
It follows from (55) that
γ1 = aσ2
1− a2 . (57)
173 / 212
![Page 174: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/174.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACovF and ACF for an AR(1) Process
In fact, since
E(ytyt−k ) = aE(yt−1yt−k ) + E(εtyt−k ), k = 1,2, . . . ,
and E(εtyt−k ) = 0, for k = 1,2, . . ., first and higher-orderautocovariances are derived recursively by
γk = aγk−1, k = 1,2, . . . . (58)
It is obvious that the recursive relationship (58) holds also forthe autocorrelation function, ρk = γk/γ0, of the AR(1) process,i.e., ρk = aρk−1, for k = 1,2, . . . .
174 / 212
![Page 175: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/175.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACov and ACF for an ARMA(1,1) Process
Consider the stationary, zero-mean ARMA(1,1) process
yt = ayt−1 + εt + bεt−1, (59)
where εt is again an white–noise process with variance σ2.
175 / 212
![Page 176: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/176.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACov and ACF for an ARMA(1,1) Process
As in the previous example, multiplying (59) by yt and takingexpectations yields
γ0 = aγ1 + E[yt (εt + bεt−1)]. (60)
To determine E[yt (εt + bεt−1)], replace yt by the right hand sideof (59), i.e.,
E[yt (εt + bεt−1)] = E[(ayt−1 + εt + bεt−1)(εt + bεt−1)]
= E(ayt−1εt + ε2t + bεt−1εt + abyt−1εt−1
+bεtεt−1 + b2ε2t−1)
= σ2 + abσ2 + b2σ2.
176 / 212
![Page 177: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/177.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACov and ACF for an ARMA(1,1) Process
Taking the expectation operator inside the parentheses andnoting the fact that E(yt−1εt ) = E(εt−1εt ) = 0 andE(yt−1εt−1) = σ2, we have
E[yt (εt + bεt−1)] = (1 + ab + b2)σ2. (61)
Multiplying (59) by yt−1 and taking expectations gives
γ1 = E[ay2t−1 + yt−1(εt + bεt−1)]
= aγ0 + bσ2.
177 / 212
![Page 178: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/178.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACov and ACF for an ARMA(1,1) Process
Combining (60)–(62) and solving for γ0 gives us the formula forthe variance of an ARMA(1,1) process
γ0 =1 + 2ab + b2
1− a2 σ2. (62)
For the first order autocovariance we obtain from (59) and (60)
γ1 =
(a(1 + 2ab + b2)
1− a2 + b2)σ2
=(1 + ab)(a + b)
1− a2 σ2. (63)
178 / 212
![Page 179: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/179.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Deriving the ACov and ACF for an ARMA(1,1) Process
Higher–order autocovariances can be computed recursively by
γk = aγk−1, k = 2,3, . . . . (64)
179 / 212
![Page 180: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/180.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
Let yt be generated by the stationary ARMA (p,q) process
a(L)yt = b(L)εt , (65)
where εt is the usual white–noise process with E(εt ) = 0 andE(ε2t ) = σ2; and a(L) and b(L) are polynomials defined bya(L) = 1− α1L− . . .− αr Lr and b(L) = β0 + β1L + . . .+ βr Lr ,with r = max(p,q) and αi = 0 for i = p + 1,p + 2, . . . , r , if r > por βi = 0 for i = q + 1,q + 2, . . . , r , if r > q.
180 / 212
![Page 181: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/181.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
From the definition of the autocovariance, γk = E(ytyt−k ), itfollows that
γk = α1γk−1 + α2γk−2 + . . .+ αrγk−r (66)+E(β0εtyt−k + β1εt−1yt−k + . . .+ βr εt−r yt−k ), k = 0,1, . . . , r .
Replacing yt−k by its moving average representation,yt−k = b(L)/a(L)εt−k = c(L)εt−k , wherec(L) = c0 + c1L + c2L2 . . ., we obtain
E(εt−iyt−k ) =
{ci−kσ
2, if i = k , k + 1, . . . , r ,0, otherwise.
181 / 212
![Page 182: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/182.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
Defining γ = (γ0, γ1, . . . , γr )′, c = (c0, c1, . . . , cr )′ and using thefact that γk−i = γi−k , expression (66) can be rewritten in matrixterms as
γ = Maγ + Nbcσ2. (67)
The (r + 1)× (r + 1) matrix Ma is the sum of two matrices,Ma = Ta + Ha, with Ta denoting the lower-triangular Toeplitzmatrix
Ta =
0 0 · · · 0 0α1 0 0
α2 α1. . .
...... 0αr αr−1 · · · α1 0
,
182 / 212
![Page 183: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/183.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
and Ha is “almost" a Hankel matrix and given by
Ha =
0 α1 α2 · · · αr−1 αr0 α2 α3 · · · αr 0...
......
0 αr−1 αr 00 αr 0 · · · 0 00 0 0 · · · 0 0
183 / 212
![Page 184: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/184.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
Note that matrix Ha is not exactly Hankel due to the zeros in thefirst column. Finally, the Hankel matrix Nb is defined by
Nb =
β0 β1 · · · βr−1 βrβ1 β2 · · · βr 0...
...βr−1 βr 0βr 0 · · · 0 0
.
184 / 212
![Page 185: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/185.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
The initial autocovariances can be computed by
γ = (I −Ma)−1Nbcσ2. (68)
Since c = (I − Ta)−1b, a closed-form expression, relating theautocovariances of an ARMA process to its parameters αi , βi ,and σ2 is given by
γ = (I −Ma)−1Nb(I − Ta)−1bσ2. (69)
185 / 212
![Page 186: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/186.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
Note that (I − Ta)−1 always exists, since | I − Ta |= 1, and that
Nb(I − Ta)−1 = [(I − Ta)−1]′Nb,
since Nb is Hankel with zeros below the main counterdiagonaland (I − Ta)−1 is a lower-triangular Toeplitz matrix. Hence, (69)can finally be rewritten as
γ = [(I − T ′a)(I −Ma)]−1Nbbσ2. (70)
186 / 212
![Page 187: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/187.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
Note that for p < q = r only p + 1 equations have to be solvedsimultaneously. The corresponding system of equations isobtained by eliminating the last p − q rows in (67); andhigher–order autocovariances can be derived recursively by
γk =
{∑pi=1 αiγk−i + σ2∑q
j=k βjcj−k , if k = p + 1,p + 2, . . . ,q,∑pi=1 αiγk−i , if k = q + 1,q + 2, . . . .
(71)
187 / 212
![Page 188: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/188.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
For pure autoregressive processes expression (70) reduces to
γ = [(I − T ′a)(I −Ma)]−1s, (72)
where the (r + 1)× 1 vector s is defined bys = σ2(β0,0, . . . ,0)T . Thus, vector γ is given by the first columnof [(I − T ′a)(I −Ma)]−1 multiplied by σ2β0.
188 / 212
![Page 189: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/189.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Excursion: The AcovF for a general ARMA(p,q)process
In the case of a pure MA process, (70) simplifies to
γ = Nbbσ2, (73)
or
γk =
{σ2∑q
i=k βiβi−k , if k = 0,1, . . . ,q,0, if k > q.
(74)
189 / 212
![Page 190: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/190.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The AcovF of an ARMA(1,1) reconsidered
Consider again the ARMA(1,1) processyt = α1yt−1 + εt + β1εt−1 from Example 3.4.2. To computeγ = (γ0, γ1)′, we now apply formula (70). Matrices Ta, Ha, Nband vector b become:
Ta =
[0 0α1 0
], Ha =
[0 α10 0
], Nb =
[1 β1β1 0
], b =
[1β1
].
190 / 212
![Page 191: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/191.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The AcovF of an ARMA(1,1) reconsideredSimple matrix manipulations produce the desired result:
γ = [(I − T ′a)(I −Ma)]−1Nbbσ2
=
[1 + α2
1 −2α1−α1 1
]−1 [ 1 β1β1 0
] [1β1
]σ2
=1
1− α21
[1 2α1α1 1 + α2
1
] [1 + β2
1β1
]σ2
=σ2
1− a2
[1 + β2
1 + 2α1β1α1(1 + β2
1) + β1(1 + α21)
],
which coincides with results (62) and (63) in the previousexample.
191 / 212
![Page 192: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/192.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
An Example
Derive γ0 and γ1 using the stated procedure for the followingprocess
yt = 0.5yt−1 + εt (75)
with εt ∼ N(0,1).
192 / 212
![Page 193: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/193.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
An Example
Find γi for i = 0, . . .3 for the following process:
yt = 0.5yt−1 + 0.5εt−1 + εt (76)
with εt ∼ N(0,1).
193 / 212
![Page 194: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/194.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The Yule-Walker EquationsConsider the AR(p) process
yt = α1yt−1 + . . .+ αpyt−p + εt
Multiplying both sides with yt−j and taking expectations yields
E(ytyt−j) = α1E(yt−1yt−j) + . . .+ αpE(yt−pyt−j)
which gives rise to the following equation system
γ1 = α1γ0 + α2γ1 + . . .+ αpγp−1
γ2 = α1γ1 + α2γ0 + . . .+ αpγp−2
. . .
γp = α1γp−1 + α2γp−2 + . . .+ αpγ0
194 / 212
![Page 195: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/195.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The Yule-Walker Equations
Or in matrix notationγ = aΓ
with
Γ =
γ0 γ1 . . . γp−1γ1 γ0 . . . γp−2...
. . ....
γp−1 γp−2 . . . γ0
We obtain a similar structure for the autocorrelation function bydividing by γ0.
195 / 212
![Page 196: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/196.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Partial Autocorrelation Function
The partial autocorrelation function (PACF) represents anadditional tool for portraying the properties of an ARMAprocess. The definition of a partial correlation coefficient eludesto the difference between the PACF and the ACF. The ACFρk , k = 0,±1,±2, . . ., represents the unconditional correlationbetween yt and yt−k . By unconditional correlation we mean thecorrelation between yt and yt−k without taking the influence ofthe intervening variables yt−1, yt−2, . . . , yt−k+1 into account.
196 / 212
![Page 197: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/197.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Partial Autocorrelation Function
The PACF, denoted by αkk , k = 1,2, . . ., reflects the netassociation between yt and yt−k over and above theassociation of yt and yt−k which is due to their commonrelationship with the intervening variables yt−1, yt−2, . . . , yt−k+1.
197 / 212
![Page 198: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/198.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for an AR(1)
Consider the stationary AR(1) process
yt = α1yt−1 + εt
Given that yt and yt−2 are both correlated with yt−1, we wouldlike to know whether or not there is an additional associationbetween yt and yt−2 which goes beyond their commonassociation with yt−1.
198 / 212
![Page 199: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/199.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for an AR(1)
Let ρ12=Corr(yt , yt−1), ρ13=Corr(yt , yt−2) andρ23=Corr(yt−1, yt−2). The partial correlation between yt andyt−2 conditional on yt−1, denoted by ρ13,2, is
ρ13,2 =ρ13 − ρ12ρ23√
(1− ρ213)(1− ρ2
23).
199 / 212
![Page 200: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/200.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for an AR(1)
Considering an AR(1) process, we know that ρ12 = ρ23 = α1and ρ13 = ρ2 = α2
1. Hence, the partial autocorrelation betweenyt and yt−2, ρ13,2, is zero. Denoting the partial autocorrelationbetween yt and yt−k by αkk , it can be easily verified that for anyAR(1) process αkk = 0, for k = 2,3, . . . . Since there are nointervening variables between yt and yt−1, the first-order partialautocorrelation coefficient is equivalent to the first orderautocorrelation coefficient, i.e., α11 = ρ1. In particular for anAR(1) process we have α11 = α1.
200 / 212
![Page 201: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/201.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR process
Another way of interpreting the PACF is to view it as thesequence of the k -th autoregressive coefficients in a k -th orderautoregression. Letting αk` denote the `-th autoregressivecoefficient of an AR(k ) process, the Yule–Walker equations
ρ` = αk1ρ`−1 + · · ·+αk(k−1)ρ`−k+1 +αkkρ`−k , ` = 1,2, . . . , k ,(77)
201 / 212
![Page 202: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/202.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR process
ρ` = αk1ρ`−1 + · · ·+αk(k−1)ρ`−k+1 +αkkρ`−k , ` = 1,2, . . . , k ,(78)
give rise to the system of linear equations
1 ρ1 · · · ρk−1ρ1 1 ρk−2ρ2 ρ1 ρk−3...
...ρk−2 ρ1ρk−1 ρk−2 · · · 1
αk1αk2αk3
...αk(k−1)αkk
=
ρ1ρ2ρ3...
ρk−1ρk
or, in short,
Pkαk = ρk , k = 1,2, . . . . (79)
202 / 212
![Page 203: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/203.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR processUsing Cramér’s rule, to successively solve (79) for αkk ,k = 1,2 . . ., we have
αkk =| P∗k || Pk |
, k = 1,2, . . . , (80)
where matrix P∗k is obtained by replacing the last column ofmatrix Pk by vector ρk = (ρ1, ρ2, . . . , ρk )′, i.e.,
P∗k =
1 ρ1 · · · ρk−2 ρ1ρ1 1 ρk−3 ρ2ρ2 ρ1 ρk−4 ρ3...
......
ρk−2 1 ρk−1ρk−1 ρk−2 · · · ρ1 ρk
203 / 212
![Page 204: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/204.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR process
Applying (80), the first three terms of the PACF are given by
α11 =|ρ1||1|
= ρ1,
α22 =
∣∣∣∣ 1 ρ1ρ1 ρ2
∣∣∣∣∣∣∣∣ 1 ρ1ρ1 1
∣∣∣∣ =ρ2 − ρ2
1
1− ρ21,
204 / 212
![Page 205: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/205.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR process
α33 =
∣∣∣∣∣∣1 ρ1 ρ1ρ1 1 ρ2ρ2 ρ1 ρ3
∣∣∣∣∣∣∣∣∣∣∣∣1 ρ1 ρ2ρ1 1 ρ1ρ2 ρ1 1
∣∣∣∣∣∣=ρ3 + ρ1ρ2(ρ2 − 2)− ρ2
1(ρ3 − ρ1)
(1− ρ2)− (1− ρ2 − 2ρ21)
.
205 / 212
![Page 206: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/206.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a general AR process
From the Yule–Walker equations it is evident that | P∗k |= 0 foran AR process whose order is less than k , since the lastcolumn of matrix P∗k can always be obtained from a linearcombination of the first k − 1 (or less) columns of P∗k . Hence,the theoretical PACF of an AR(p) will generally be different fromzero for the first p terms and exactly zero for terms of higherorder. This property allows us to identify the order of a pure ARprocess from its PACF.
206 / 212
![Page 207: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/207.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a MA(1) process
Consider the MA(1) process yt = εt + β1εt−1. Its ACF is givenby
ρk =
{β1
1+β1, if k=1,
0, if k=2,3,. . . .
Applying (80), the first 4 terms of the PACF are:
α11 = ρ1, α22 = −ρ2
1
1− ρ21, (81)
α33 =ρ3
1
1− 2ρ21, α44 = −
ρ41
1− 3ρ21 + ρ4
1.
207 / 212
![Page 208: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/208.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
The PACF for a MA(1) process
In fact, the general expression for the PACF of an MA(1)process in terms of the MA coefficient β1 is
αkk = −(−β1)k (1− β2
1)
1− β2(k+1)1
.
⇒ PACF gradually dies out, in contrast to an AR process⇒ this allows us to identify processes by looking at itscorresponding ACF and PACF
208 / 212
![Page 209: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/209.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Characteristics of specific processes
Identification Functions:1 autocorrelation function (ACF), ρk ,2 partial autocorrelation function (PACF), αkk ,
209 / 212
![Page 210: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/210.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Characteristics of AR processes
ACF: The Yule–Walker equations
ρk = α1ρk−1 + α2ρk−2 + . . .+ αpρk−p, k = 1,2, . . .
imply that the ACF of a stationary AR process is generallydifferent from zero but gradually dies out as k approachesinfinity.PACF: The first p terms are generally different from zero;higher-order terms are identically zero.
210 / 212
![Page 211: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/211.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
Characteristics of MA ProcessesACF: We know that the ACF of an MA(q) process is givenby
γk =
{σ2∑q
i=k βiβi−k , if k = 0,1, . . . ,q0, if k > q,
which implies that the ACF is generally different from zeroup to lag q and equal to zero thereafter.PACF: The PACF is computed successively by
αkk =| P∗k || Pk |
, k = 1,2, . . . ,
with matrices P∗k and Pk defined in the Section before.Example 3.6.2 demonstrated the pattern of the PACF of anMA(1) process.
211 / 212
![Page 212: Univariate Time Series Analysis - LMU München · Univariate Time Series Analysis Univariate Time Series Analysis Klaus Wohlrabe1 and Stefan Mittnik 1 Ifo Institute for Economic Research,](https://reader034.fdocuments.in/reader034/viewer/2022051509/5aecbe067f8b9a66258efabc/html5/thumbnails/212.jpg)
Univariate Time Series Analysis
(Univariate) Linear Models
Identification Tools
ACF and PACF
ModelAR(p) MA(q) ARMA(p,q)
ACF tails off cuts off after q tails offPACF cuts off after p tails off tails off
Table: Patterns for Identifying ARMA Processes
212 / 212