Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.
-
Upload
hannah-hoffman -
Category
Documents
-
view
219 -
download
5
Transcript of Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.
![Page 1: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/1.jpg)
Advanced topics in Financial Econometrics
Bas Werker
Tilburg University, SAMSI fellow
![Page 2: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/2.jpg)
In which we will ...
... consider the modern theory ofasymptotic statistics à la Hájek/Le Cam,
with a special emphasis on financialeconometric applications, semiparametric
analysis, and rank based inference methods
![Page 3: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/3.jpg)
Contents
1. Introduction
2. Inference in parametric models
3. Semiparametric analysis for models with i.i.d. observations
4. Semiparametric time series models
5. Rank based statistics
6. Semiparametric efficiency of rank based inference
![Page 4: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/4.jpg)
Literature
Aad W. van der Vaart, “Asymptotic Statistics”, Cambridge University Press, 1998/2000
Reference (AS-x) is to Chapter x of this book
Various papers
![Page 5: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/5.jpg)
Introduction
![Page 6: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/6.jpg)
Contents
Consistency and asymptotic normality (AS-2,3)
M- and Z-estimators (AS-5)
Local alternatives and continguity (AS-6)
Local power of tests
![Page 7: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/7.jpg)
Stochastic convergence (AS-2)
Consider a sequence of -dimensional
random vectors
All random variables are (“for fixed sample
size”) defined on the same implicit probability
space
k
0nnX
![Page 8: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/8.jpg)
Weak convergence
Convergence of the distributions: for each
point where is continuous,
we have
as
Convergence in distribution/law
Notation
kx xXP
xXPxXP n
n
XXL
n
![Page 9: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/9.jpg)
Convergence in probability
Convergence of the random variables:
as , for all
Euclidean distance
Basic to the notion of consistency of estimators
Notation
0 XXP n
n 0
XXp
n
![Page 10: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/10.jpg)
Continuous mapping theorem
Let be a function which is continuous at
each point of a set for which ,
then
gC 1CXP
XgXgXXL
n
L
n
XgXgXXsa
n
sa
n
....
XgXgXXp
n
p
n
![Page 11: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/11.jpg)
o and O notation
Convenient short-hand notation and calculus
means bounded in
probability, i.e., for all there exists
such that
means
npn ROX
npn RoX
nn RX
0p
nn RX
0 0M
MRXP nnn
max
![Page 12: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/12.jpg)
Rules of calculus
Convenient rules
111
111
111
111
ppp
ppp
ppp
ppp
ooO
OOO
OoO
ooo
11
1
1
111
1
ppp
pnnp
pnnp
pp
oOo
ORRO
oRRo
Oo
![Page 13: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/13.jpg)
Delta method (AS-3)
Suppose that for numbers we have
Suppose is differentiable at
Then
nr
TTrL
nn
T
oTrTrL
pnnnn
'
1'
![Page 14: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/14.jpg)
Uniform Delta method
Suppose that for numbers and vectors
Suppose
Suppose is continuously differentiable in a neighborhood of
Then
nr
TTrL
nnn
T
oTrTrL
pnnnnnn
'
1'
n
n
![Page 15: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/15.jpg)
M-estimators
Define a statistic (“estimator”) for
observations as a maximizer ofnXX ,,1
n
iin Xm
nM
1
1
![Page 16: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/16.jpg)
Z-estimators
Define a statistic (“estimator”) for
observations as a solution of
Also called “Estimating equation”
Often, but not always, based on M-estimator
nXX ,,1
01
1
n
iin X
n
![Page 17: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/17.jpg)
Examples
Maximum likelihood
(Generalized) Method of Moments
Chi-square estimation
... “all” parametric inference
![Page 18: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/18.jpg)
Consistency
Uniform convergence of criterion function leads to consistency of M-estimators
“Approximate” maximization is sufficient
Theorem AS 5.7
Uniform convergence of criterion function leads to consistency of Z-estimators
![Page 19: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/19.jpg)
Asymptotic normality
Let us be given a Z-estimator
Suppose the Z-criterion satisfies
Suppose is differentiable with derivative at the zero of
Then, under some additional regularity,
0ˆ n
x
2121 xxx
XE 0V 0 XE
11ˆ
1
10 00 p
n
iin oX
nVn
![Page 20: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/20.jpg)
One-step estimators
A technical trick to reduce the conditions for
consistency and asymptotic normality of Z
estimators significantly
Starting from an initial root-n consistent
estimator , i.e., , we
consider the solution of the (linear) equation
n~ 1~
0 pn On
0~~~
nnnn
![Page 21: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/21.jpg)
Asymptotic normality
The previously derived asymptotic expansion/distribution holds now under the sole condition
1sup 0000
pnnMn
onn
![Page 22: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/22.jpg)
Discretization trick
The previous condition can be relaxed further by considering an initial discretized estimator, i.e., one which essentially only takes a finite number of possible values
Now, we only need, for all non-random
, that
1000 pnnnn onn nOn 10
![Page 23: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/23.jpg)
Contiguity (AS-6)
To understand the idea, consider a statistical model where we observe one variable from a distribution or
We want to test if the distribution is or
If and are orthogonal, this testing problem is trivial
Orthogonality: disjoint support
P QX
P
QP
Q
![Page 24: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/24.jpg)
Contiguity - 2
If and “have the same support”, i.e., are absolutely continuous, the problem is non-trivial (this is the interesting case)
Clearly, “good” tests should in that case be based on the likelihood ratio
QP
XdP
dQL
![Page 25: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/25.jpg)
Intermezzo
Radon-Nikodym derivatives always refer to the derivative defined for the part where dominates
As a consequence, expectations of Radon-Nikodym derivatives may be strictly smaller than one
QP
![Page 26: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/26.jpg)
Contiguity - definition
Contiguity the the asymptotic version of absolute continuity for sequences of probability measures
Definition: if
Definition: if both
and
nn QP 00: nnnnn APAQA
nn QP nn QP
nn QP
![Page 27: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/27.jpg)
Le Cam’s first lemma
The well known equivalence for absolute continuity translates in the obvious way to contiguity (AS Lemma 6.4)
The following are equivalent
PQ
00 dQdPQ 1dPdQEP
![Page 28: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/28.jpg)
Consistency
An estimator which is consistent under a (sequence of) probability (measures) is also consistent under a contiguous (sequence of) probability (measures) nQ
nP
![Page 29: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/29.jpg)
Le Cam’s third lemma
Change of probability measures using contiguous probabilities may be taken to the limit
See AS Theorem 6.6
It looks complicated, but is actually quite intuitive
![Page 30: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/30.jpg)
Local alternatives
The idea of contiguity is basic to the construction of local alternatives
In a sequence of statistical experiments with identical parameter space , asymptotic tests for versus are trivial
Non-trivial is versus
00 : H 11 : H
00 : H
n
hH 00 :
![Page 31: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/31.jpg)
Example
Consider the model where we observe i.i.d.
copies of a random variable
Denote
When are and contiguous?
What is the asymptotic distribution of he
sample average under ?
n 1,N
nn NP 1,
nn
P nP0
n
n
hP
0
![Page 32: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/32.jpg)
Inference in parametric models
![Page 33: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/33.jpg)
Contents
Local Asymptotic Normality (AS-7)
Optimal testing
Efficiency of estimators (AS-8)
Nuisance parameters and geometry
Limits of experiments (AS-9)
![Page 34: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/34.jpg)
Local Asymptotic Normality(AS-7) Local Asymptotic Normality (LAN) is the
formalization of a “regular” statistical experiment
The concept is a refinement of contiguity
“All” standard econometric models are LAN
![Page 35: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/35.jpg)
LAN - definition
A statistical model is identified as a sequence
of probability models
LAN holds if for each and every
sequence
nP
hhn
hIhhIhN
ohIhhdp
dP
TTL
pTnT
n
n
nhn
;2
1
12
1log
![Page 36: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/36.jpg)
Remarks
is called the central sequence and the equivalent of the derivative of the log-likelihood in classical statistics
is the Fisher information
The root-n rate can be any other, but this is the usual situation
n
I
![Page 37: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/37.jpg)
Terminology
The terminology derives from
with a single observation from
hIhXIhIdN
IhdN TT
2
1
;0
;log
1
1
X 1; IhN
![Page 38: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/38.jpg)
Examples
In models with i.i.d. observations, differentiability conditions on the densities lead to LAN
This is the so-called “differentiability in quadratic mean condition”
See AS Theorem 7.2
Regression, Probit/Logit, etc...
![Page 39: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/39.jpg)
Time series examples
LAN has also been shown to hold for
ARMA (Kreiss, 1987)
ARCH (Linton, 1993)
GARCH (Drost and Klaassen, 1997)
...
In all cases with the “obvious” central sequence
![Page 40: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/40.jpg)
Optimal testing in LAN experiments
Consider a (test) statistic in a LAN experiment that satisfies, under ,
An asymptotic size (under ) test is easily constructed
nT
Ic
cN
T TL
nn
2
;0
0
0
![Page 41: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/41.jpg)
Local power
Consider a sequence of alternatives
What’s the behavior of under ?
Le Cam’s third lemma: under
nhn 0nnT
Ic
c
hIh
hcN
T T
T
TL
nn
2
;
n
![Page 42: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/42.jpg)
Maximize local power
To maximize local power, we need to maximize
Hence take the central sequence evaluated at the null as statistic
Lagrange multiplier type
Use quadratic forms in multidimensional case
c
![Page 43: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/43.jpg)
Efficiency (AS-8)
We may also formalize the Cramér-Rao lower bound idea
Let’s first look at the asymptotic counterpart of an unbiased estimator
... which requires more than mere consistency
![Page 44: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/44.jpg)
Regular estimator
Consider an estimator for satisfying
under
How does this estimator behave under
?
00
00
0
;0
0ˆ0
IC
CN
n TL
nn
n̂
nhn 0
0
![Page 45: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/45.jpg)
Once more...
Le Cam’s third lemma, under ,
Which leads to the requirement
If not, estimator does not follow local shifts
Such an estimator is called “regular”
00
000
0
;0
ˆ0
IC
ChCN
n TTL
nn
n
IC 0
![Page 46: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/46.jpg)
Convolution theorem
For any regular estimator we have
The idea of regularity can be relaxed to general limiting distributions
In that case, we find
The latter result explains the name
1 I
L
MINL 1;0
![Page 47: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/47.jpg)
Efficient estimator
An estimator is therefore called efficient if
Note that this estimator is trivially regular
n̂
1ˆ 1p
nn oIn
![Page 48: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/48.jpg)
Minimax theorem
Theorem on asymptotic loss of any estimator (regular or not)
Only gives a bound for the asymptotic risk, no more distribution information
![Page 49: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/49.jpg)
Nuisance parameters
The Convolution theorem also leads to optimal estimators in case we have both a parametric of interest and a parametric as nuisance parameter
In that case we need to consider
II
IINn
n
;0
0~
![Page 50: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/50.jpg)
Efficient estimation
If one is only interested in estimating , one should consider just the upper part of
From the partitioned inverses formula, this is
n
n
II
II
1
nn IIIIII 111
![Page 51: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/51.jpg)
The geometry of inference with nuisance parameters Using the intuition that Fisher information
matrices are variances of central sequences, we find that the central sequence to use when there are nuisance parameters is the residual of the projection of the central sequence for the parameter of interest on the central sequences of the nuisance parameters
![Page 52: Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.](https://reader036.fdocuments.in/reader036/viewer/2022062619/55151cd7550346a87d8b4fec/html5/thumbnails/52.jpg)
Limits of experiments (AS-9)
The previous ideas can be extended to a general concept of “convergence of statistical experiments”
Crucial is an identical parameter space
LAN corresponds to a Guassian shift limit
Other limits are possible