Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon...
Transcript of Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon...
![Page 1: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/1.jpg)
Week 11: Causality with Unmeasured Confounding
Brandon Stewart1
Princeton
December 5 and 7, 2016
1These slides are heavily influenced by Matt Blackwell, Adam Glynn, JensHainmueller
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 1 / 155
![Page 2: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/2.jpg)
Where We’ve Been and Where We’re Going...
Last WeekI selection on observables and measured confounding
This WeekI Monday:
F natural experimentsF classical view of instrumental variables
I Wednesday:F modern view of instrumental variablesF regression discontinuity
The Following WeekI repeated observations
Long RunI causality with measured confounding → unmeasured confounding →
repeated data
Questions?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 2 / 155
![Page 3: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/3.jpg)
Where We’ve Been and Where We’re Going...
Last WeekI selection on observables and measured confounding
This WeekI Monday:
F natural experimentsF classical view of instrumental variables
I Wednesday:F modern view of instrumental variablesF regression discontinuity
The Following WeekI repeated observations
Long RunI causality with measured confounding → unmeasured confounding →
repeated data
Questions?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 2 / 155
![Page 4: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/4.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 3 / 155
![Page 5: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/5.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 3 / 155
![Page 6: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/6.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 7: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/7.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 8: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/8.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 9: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/9.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 10: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/10.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 11: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/11.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 12: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/12.jpg)
Unmeasured Confounding
Last week we considered cases of measured confounding
D
X
Y
In this case we block the backdoor path D ← X → Y by conditioningon X .
What happens in the general case where X is unobserved?
Under selection on unobservables we are going to need a differentapproach which we will talk about over the next two weeks.
No Free Lunch we can’t get something for nothing, we will neednew variables, new assumptions and new approaches.
Goal: give you a feel for what is possible, but note that you will needto do more research if you want to use one of these techniques.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 4 / 155
![Page 13: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/13.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 14: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/14.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 15: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/15.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 16: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/16.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 17: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/17.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 18: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/18.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 19: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/19.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 20: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/20.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 21: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/21.jpg)
Approaches to Unmeasured Confounding
Natural Experiments
(today)
Interrupted Time-Series
(today)
Instrumental Variables
(today and Wednesday)
Regression Discontinuity
(Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 22: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/22.jpg)
Approaches to Unmeasured Confounding
Natural Experiments (today)
Interrupted Time-Series (today)
Instrumental Variables (today and Wednesday)
Regression Discontinuity (Wednesday)
Bounding
Sensitivity Analysis
Front Door Adjustment
Synthetic Controls
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 5 / 155
![Page 23: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/23.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 6 / 155
![Page 24: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/24.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 6 / 155
![Page 25: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/25.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 26: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/26.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 27: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/27.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experiments
I we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 28: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/28.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t control
I nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 29: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/29.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we want
I not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 30: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/30.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparable
I valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 31: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/31.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 32: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/32.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 33: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/33.jpg)
Natural Experiments
Broadly speaking an “experiment” where the treatment is randomizedbut the randomization was not controlled by the researcher.
Trickier to analyze than regular experimentsI we ought to be suspicious of randomization we don’t controlI nature may not choose exactly the treatment we wantI not immediately obvious which groups are comparableI valid comparison may not estimate the causal effect of interest
When available, an excellent way to capitalize on randomness in theworld to make casual inferences.
See Dunning (2012) Natural Experiments in the Social Sciences
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 7 / 155
![Page 34: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/34.jpg)
Caution on terminology
It is worth nothing that the label “natural experiment” isperhaps unfortunate. As we shall see, the social and politicalforces that give rise to as-if random assignment of interventionsare not generally “natural” in the ordinary sense of that term.Second, natural experiments are observational studies, not trueexperiments, again, because they lack an experimentalmanipulation. In sum, natural experiments are neither naturalnor experiments.
—Dunning (2012) pg 16
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 8 / 155
![Page 35: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/35.jpg)
Natural Experiment Examples (True Randomization)
Randomness Focus CitationVietnam draft labor market Angrist 1990
randomized quotas female leadership in Indianvillage council presidencies
Chattopadhyay& Duflo 2004
randomized term lengths tenure in office on legisla-tive performance
Dal Bo & Rossi2010
lottery effect of winnings on polit-ical attitudes
Doherty, Green& Gerber 2006
randomized ballot order ballot order effects in CA Ho & Imai2008
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 9 / 155
![Page 36: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/36.jpg)
Natural Experiment Examples (True Randomization)
Randomness Focus CitationVietnam draft labor market Angrist 1990
randomized quotas female leadership in Indianvillage council presidencies
Chattopadhyay& Duflo 2004
randomized term lengths tenure in office on legisla-tive performance
Dal Bo & Rossi2010
lottery effect of winnings on polit-ical attitudes
Doherty, Green& Gerber 2006
randomized ballot order ballot order effects in CA Ho & Imai2008
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 9 / 155
![Page 37: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/37.jpg)
Natural Experiment Examples (As If Randomization)
Randomness Focus Citationchild abduction by LRA child soldering affecting
political participationBlattman 2008
election monitor assign-ment
international electionmonitoring on fraud
Hyde 2007
random shelling by drunksoldiers
indiscriminate violence onrebellion
Lyall 2009
hurricane study of friendship formu-lation
Phan andAiroldi 2015
2006 Israel-Hezbollah war stress on unborn babies Torche andShwed 2015
Snowden revelations reading behavior onwikipedia
Penney (2016)
terrorist attacks perception of immigrants Legewie 2013
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 10 / 155
![Page 38: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/38.jpg)
Questions to Ask Yourself
From Sekhon and Titiunik (2012)
1 “is the proposed treatment-control comparison guaranteed to be validby the assumed randomization?”
2 “if not, what is the comparison that is guaranteed by therandomization, and how does this comparison relate to thecomparison the researcher wishes to make?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 11 / 155
![Page 39: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/39.jpg)
Questions to Ask Yourself
From Sekhon and Titiunik (2012)
1 “is the proposed treatment-control comparison guaranteed to be validby the assumed randomization?”
2 “if not, what is the comparison that is guaranteed by therandomization, and how does this comparison relate to thecomparison the researcher wishes to make?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 11 / 155
![Page 40: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/40.jpg)
ExampleExample from Sekhon and Titiunik (2012) discussion of Ansolabehere,Snyder and Stewart (2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 12 / 155
![Page 41: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/41.jpg)
Pitfalls
We still really need theory to guide our thinking
Understanding the assignment and causal process is extremelyimportant (was this really random? is the treatment really what Iwant?)
The result only applies to a limited population that we may not care agreat deal about.
Be sure to verify that you “as-if-random” assignment is really random(e.g. placebo tests, balance tests)
Convincingly analyzing a natural experiment takes at least as muchcareful thought not less!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 13 / 155
![Page 42: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/42.jpg)
Pitfalls
We still really need theory to guide our thinking
Understanding the assignment and causal process is extremelyimportant (was this really random? is the treatment really what Iwant?)
The result only applies to a limited population that we may not care agreat deal about.
Be sure to verify that you “as-if-random” assignment is really random(e.g. placebo tests, balance tests)
Convincingly analyzing a natural experiment takes at least as muchcareful thought not less!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 13 / 155
![Page 43: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/43.jpg)
Pitfalls
We still really need theory to guide our thinking
Understanding the assignment and causal process is extremelyimportant (was this really random? is the treatment really what Iwant?)
The result only applies to a limited population that we may not care agreat deal about.
Be sure to verify that you “as-if-random” assignment is really random(e.g. placebo tests, balance tests)
Convincingly analyzing a natural experiment takes at least as muchcareful thought not less!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 13 / 155
![Page 44: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/44.jpg)
Pitfalls
We still really need theory to guide our thinking
Understanding the assignment and causal process is extremelyimportant (was this really random? is the treatment really what Iwant?)
The result only applies to a limited population that we may not care agreat deal about.
Be sure to verify that you “as-if-random” assignment is really random(e.g. placebo tests, balance tests)
Convincingly analyzing a natural experiment takes at least as muchcareful thought not less!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 13 / 155
![Page 45: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/45.jpg)
Pitfalls
We still really need theory to guide our thinking
Understanding the assignment and causal process is extremelyimportant (was this really random? is the treatment really what Iwant?)
The result only applies to a limited population that we may not care agreat deal about.
Be sure to verify that you “as-if-random” assignment is really random(e.g. placebo tests, balance tests)
Convincingly analyzing a natural experiment takes at least as muchcareful thought not less!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 13 / 155
![Page 46: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/46.jpg)
Reasons to Be Excited
Now that you know what to look for you may see more naturalexperiments out there
Exogenous randomization can help us make credible causal inferencesin places where we never could have run an experiment
It is often pretty easy to communicate these kinds of methods tonon-experts
Salganik (2017) argues that with always-on digital data collection wewill be in better shape moving forward to leverage naturalexperiments as the opportunities arise.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 14 / 155
![Page 47: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/47.jpg)
Reasons to Be Excited
Now that you know what to look for you may see more naturalexperiments out there
Exogenous randomization can help us make credible causal inferencesin places where we never could have run an experiment
It is often pretty easy to communicate these kinds of methods tonon-experts
Salganik (2017) argues that with always-on digital data collection wewill be in better shape moving forward to leverage naturalexperiments as the opportunities arise.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 14 / 155
![Page 48: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/48.jpg)
Reasons to Be Excited
Now that you know what to look for you may see more naturalexperiments out there
Exogenous randomization can help us make credible causal inferencesin places where we never could have run an experiment
It is often pretty easy to communicate these kinds of methods tonon-experts
Salganik (2017) argues that with always-on digital data collection wewill be in better shape moving forward to leverage naturalexperiments as the opportunities arise.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 14 / 155
![Page 49: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/49.jpg)
Reasons to Be Excited
Now that you know what to look for you may see more naturalexperiments out there
Exogenous randomization can help us make credible causal inferencesin places where we never could have run an experiment
It is often pretty easy to communicate these kinds of methods tonon-experts
Salganik (2017) argues that with always-on digital data collection wewill be in better shape moving forward to leverage naturalexperiments as the opportunities arise.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 14 / 155
![Page 50: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/50.jpg)
Reasons to Be Excited
Now that you know what to look for you may see more naturalexperiments out there
Exogenous randomization can help us make credible causal inferencesin places where we never could have run an experiment
It is often pretty easy to communicate these kinds of methods tonon-experts
Salganik (2017) argues that with always-on digital data collection wewill be in better shape moving forward to leverage naturalexperiments as the opportunities arise.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 14 / 155
![Page 51: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/51.jpg)
Interrupted Time Series
A simple construction often used with natural experiment is theInterrupted Time Series(ITS)
ITS designs convey the basic intuition that when an event abruptlyoccurs, we can compare results immediately before and immediatelyafterwards.
We can write this as a model:
Yt = f (t) + Dtβ + εt
The key identifying assumption is that the observed values of ytbefore the treatment status switches at t∗ can be used to specify f (t)for the rest of the series used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 15 / 155
![Page 52: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/52.jpg)
Interrupted Time Series
A simple construction often used with natural experiment is theInterrupted Time Series(ITS)
ITS designs convey the basic intuition that when an event abruptlyoccurs, we can compare results immediately before and immediatelyafterwards.
We can write this as a model:
Yt = f (t) + Dtβ + εt
The key identifying assumption is that the observed values of ytbefore the treatment status switches at t∗ can be used to specify f (t)for the rest of the series used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 15 / 155
![Page 53: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/53.jpg)
Interrupted Time Series
A simple construction often used with natural experiment is theInterrupted Time Series(ITS)
ITS designs convey the basic intuition that when an event abruptlyoccurs, we can compare results immediately before and immediatelyafterwards.
We can write this as a model:
Yt = f (t) + Dtβ + εt
The key identifying assumption is that the observed values of ytbefore the treatment status switches at t∗ can be used to specify f (t)for the rest of the series used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 15 / 155
![Page 54: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/54.jpg)
Interrupted Time Series
A simple construction often used with natural experiment is theInterrupted Time Series(ITS)
ITS designs convey the basic intuition that when an event abruptlyoccurs, we can compare results immediately before and immediatelyafterwards.
We can write this as a model:
Yt = f (t) + Dtβ + εt
The key identifying assumption is that the observed values of ytbefore the treatment status switches at t∗ can be used to specify f (t)for the rest of the series used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 15 / 155
![Page 55: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/55.jpg)
Interrupted Time Series
A simple construction often used with natural experiment is theInterrupted Time Series(ITS)
ITS designs convey the basic intuition that when an event abruptlyoccurs, we can compare results immediately before and immediatelyafterwards.
We can write this as a model:
Yt = f (t) + Dtβ + εt
The key identifying assumption is that the observed values of ytbefore the treatment status switches at t∗ can be used to specify f (t)for the rest of the series used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 15 / 155
![Page 56: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/56.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 16 / 155
![Page 57: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/57.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 16 / 155
![Page 58: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/58.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 59: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/59.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 60: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/60.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 61: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/61.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 62: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/62.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 63: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/63.jpg)
Motivating Instrumental Variables
We saw how to identify and estimate effects under no unmeasuredconfounding and just now when nature happens to randomize thetreatment we want.
Are we doomed if neither happens?
Instrumental variables (IV) allow us to exploit an exogenous source ofvariation that drives the treatment but does not otherwise affect theoutcome.
If we have an instrument, we can deal with unmeasured confoundingin the treatment-outcome relationship.
It is going to turn out that the same construction will let us deal withnon-compliance in experiments.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 17 / 155
![Page 64: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/64.jpg)
Graphical Model
Z D
U
Y
exclusion restriction
Z is the instrument, D is the treatment, and U is the unmeasuredconfounder
Exclusion restrictionI no common causes of the instrument and the outcomeI no direct or indirect effect of the instrument on the outcome not
through the treatment
First-stage relationship Z affects D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 18 / 155
![Page 65: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/65.jpg)
Graphical Model
Z D
U
Y
exclusion restriction
Z is the instrument, D is the treatment, and U is the unmeasuredconfounder
Exclusion restrictionI no common causes of the instrument and the outcomeI no direct or indirect effect of the instrument on the outcome not
through the treatment
First-stage relationship Z affects D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 18 / 155
![Page 66: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/66.jpg)
Graphical Model
Z D
U
Y
exclusion restriction
Z is the instrument, D is the treatment, and U is the unmeasuredconfounder
Exclusion restrictionI no common causes of the instrument and the outcomeI no direct or indirect effect of the instrument on the outcome not
through the treatment
First-stage relationship Z affects D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 18 / 155
![Page 67: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/67.jpg)
Graphical Model
Z D
U
Y
exclusion restriction
Z is the instrument, D is the treatment, and U is the unmeasuredconfounder
Exclusion restrictionI no common causes of the instrument and the outcomeI no direct or indirect effect of the instrument on the outcome not
through the treatment
First-stage relationship Z affects D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 18 / 155
![Page 68: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/68.jpg)
Some Examples
Angrist (1990): Draft lottery as an IV for military service (income asoutcome)
Acemoglu et al (2001): settler mortality as an IV for institutionalquality (GDP/capita as outcome)
Levitt (1997): being an election year as IV for police force size (crimeas outcome)
Miguel, Satayanath & Sergenti (2004): lagged rainfall as IV for GDPper capita effect (outcome is civil war onset).
Kern & Hainmueller (2009): having West German TV reception inEast Berlin as an instrument for West German TV watching (outcomeis support for the East German regime)
Nunn & Wantchekon (2011): historical distance of ethnic group tothe coast as a instrument for the slave raiding of that ethnic group(outcome are trust attitudes today)
Acharya, Blackwell, Sen (2015): cotton suitability as IV for proportionslave in 1860 (outcome is white attitudes today)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 19 / 155
![Page 69: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/69.jpg)
Core Idea
The world has randomized something just maybe not thething you want.
Subject to an exclusion restriction you may be able to get(approximately) what you want anyway.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 20 / 155
![Page 70: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/70.jpg)
Core Idea
The world has randomized something just maybe not thething you want.
Subject to an exclusion restriction you may be able to get(approximately) what you want anyway.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 20 / 155
![Page 71: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/71.jpg)
Core Idea
The world has randomized something just maybe not thething you want.
Subject to an exclusion restriction you may be able to get(approximately) what you want anyway.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 20 / 155
![Page 72: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/72.jpg)
Non-Compliance Motivation for Instrumental Variables
Problem
Often we cannot force subjects to take specific treatments
Units choosing to take the treatment may differ in unobservedcharacteristics from units that refrain from doing so
Example: Non-compliance in JTPA ExperimentNot Enrolled Enrolled Totalin Training in Training
Assigned to Control 3,663 54 3,717
Assigned to Training 2,683 4,804 7,487
Total 6,346 4,858 11,204
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 21 / 155
![Page 73: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/73.jpg)
Non-Compliance Motivation for Instrumental Variables
Problem
Often we cannot force subjects to take specific treatments
Units choosing to take the treatment may differ in unobservedcharacteristics from units that refrain from doing so
Example: Non-compliance in JTPA ExperimentNot Enrolled Enrolled Totalin Training in Training
Assigned to Control 3,663 54 3,717
Assigned to Training 2,683 4,804 7,487
Total 6,346 4,858 11,204
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 21 / 155
![Page 74: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/74.jpg)
Non-Compliance Motivation for Instrumental Variables
Problem
Often we cannot force subjects to take specific treatments
Units choosing to take the treatment may differ in unobservedcharacteristics from units that refrain from doing so
Example: Non-compliance in JTPA ExperimentNot Enrolled Enrolled Totalin Training in Training
Assigned to Control 3,663 54 3,717
Assigned to Training 2,683 4,804 7,487
Total 6,346 4,858 11,204
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 21 / 155
![Page 75: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/75.jpg)
Non-Compliance Motivation for Instrumental Variables
Problem
Often we cannot force subjects to take specific treatments
Units choosing to take the treatment may differ in unobservedcharacteristics from units that refrain from doing so
Example: Non-compliance in JTPA ExperimentNot Enrolled Enrolled Totalin Training in Training
Assigned to Control 3,663 54 3,717
Assigned to Training 2,683 4,804 7,487
Total 6,346 4,858 11,204
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 21 / 155
![Page 76: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/76.jpg)
Non-Compliance Motivation for Instrumental Variables
Problem
Often we cannot force subjects to take specific treatments
Units choosing to take the treatment may differ in unobservedcharacteristics from units that refrain from doing so
Example: Non-compliance in JTPA ExperimentNot Enrolled Enrolled Totalin Training in Training
Assigned to Control 3,663 54 3,717
Assigned to Training 2,683 4,804 7,487
Total 6,346 4,858 11,204
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 21 / 155
![Page 77: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/77.jpg)
Two Views on Instrumental Variables
1 Traditional Econometric FrameworkI Constant treatment effectsI Linearity in case of a multivalued treatment
2 Potential Outcome Model of IVI Heterogeneous treatment effectsI Focus in Local Average Treatment Effect (LATE)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 22 / 155
![Page 78: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/78.jpg)
Two Views on Instrumental Variables
1 Traditional Econometric FrameworkI Constant treatment effectsI Linearity in case of a multivalued treatment
2 Potential Outcome Model of IVI Heterogeneous treatment effectsI Focus in Local Average Treatment Effect (LATE)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 22 / 155
![Page 79: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/79.jpg)
Two Views on Instrumental Variables
1 Traditional Econometric FrameworkI Constant treatment effectsI Linearity in case of a multivalued treatment
2 Potential Outcome Model of IVI Heterogeneous treatment effectsI Focus in Local Average Treatment Effect (LATE)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 22 / 155
![Page 80: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/80.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 81: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/81.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 82: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/82.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 83: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/83.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 84: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/84.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 85: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/85.jpg)
The Problem (informal)
Suppose want to know the average effect of X on Y.
Two Problems:
1 We may not be able to measure all variables that affect both X and Y.
2 We may not be able to measure X without error.
Both of these conditions will induce bias in our effect estimates.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 23 / 155
![Page 86: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/86.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 87: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/87.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 88: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/88.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 89: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/89.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 90: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/90.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 91: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/91.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 92: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/92.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 93: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/93.jpg)
The Problem (formal)
Suppose that the classical “exogeneity” condition (E [U|X1, ...,Xk ] = 0)does not hold for the causally interpreted linear model:
Yi = β0 + β1Xi1 + ...+ βkXik + Ui
Ui ∼i .i .d N(0, σ2u).
This can happen for a number of reasons including:
omitted variables
measurement error in X
included variables (post-treatment or M-structures)
simultaneous equations (endogenous feedback loops)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 24 / 155
![Page 94: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/94.jpg)
A Potential Solution: Instrumental Variables (IV)
Yi = β0 + β1Xi + Ui
E [Ui |Xi ] 6= 0
Xi = γ0 + γ1Zi + Ui
E [Ui |Zi ] = 0
Cov [Xi ,Zi ] 6= 0
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 25 / 155
![Page 95: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/95.jpg)
A Potential Solution: Instrumental Variables (IV)
Yi = β0 + β1Xi + Ui
E [Ui |Xi ] 6= 0
Xi = γ0 + γ1Zi + Ui
E [Ui |Zi ] = 0
Cov [Xi ,Zi ] 6= 0
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 25 / 155
![Page 96: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/96.jpg)
A Potential Solution: Instrumental Variables (IV)
Yi = β0 + β1Xi + Ui
E [Ui |Xi ] 6= 0
Xi = γ0 + γ1Zi + Ui
E [Ui |Zi ] = 0
Cov [Xi ,Zi ] 6= 0
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 25 / 155
![Page 97: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/97.jpg)
A Potential Solution: Instrumental Variables (IV)
Yi = β0 + β1Xi + Ui
E [Ui |Xi ] 6= 0
Xi = γ0 + γ1Zi + Ui
E [Ui |Zi ] = 0
Cov [Xi ,Zi ] 6= 0
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 25 / 155
![Page 98: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/98.jpg)
Commonly Used Instrumental Variables
Assigned status in randomizedtrials with noncompliance
I the assigned versus enrolleddistinction you explored in thelalonde data
I “received” versus “read” themailing in the social pressureexperiment
Rainfall, earthquakes, ...
...
●
X●
Y
●
U
●
Z γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 26 / 155
![Page 99: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/99.jpg)
Commonly Used Instrumental Variables
Assigned status in randomizedtrials with noncompliance
I the assigned versus enrolleddistinction you explored in thelalonde data
I “received” versus “read” themailing in the social pressureexperiment
Rainfall, earthquakes, ...
...
●
X●
Y
●
U
●
Z γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 26 / 155
![Page 100: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/100.jpg)
Commonly Used Instrumental Variables
Assigned status in randomizedtrials with noncompliance
I the assigned versus enrolleddistinction you explored in thelalonde data
I “received” versus “read” themailing in the social pressureexperiment
Rainfall, earthquakes, ...
...
●
X●
Y
●
U
●
Z γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 26 / 155
![Page 101: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/101.jpg)
Commonly Used Instrumental Variables
Assigned status in randomizedtrials with noncompliance
I the assigned versus enrolleddistinction you explored in thelalonde data
I “received” versus “read” themailing in the social pressureexperiment
Rainfall, earthquakes, ...
...
●
X●
Y
●
U
●
Z γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 26 / 155
![Page 102: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/102.jpg)
Commonly Used Instrumental Variables
Assigned status in randomizedtrials with noncompliance
I the assigned versus enrolleddistinction you explored in thelalonde data
I “received” versus “read” themailing in the social pressureexperiment
Rainfall, earthquakes, ...
...
●
X●
Y
●
U
●
Z γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 26 / 155
![Page 103: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/103.jpg)
The IV Estimator
With our assumed model,
regressing X on Z identifies γ1
regressing Y on Z identifiesγ1 · β1 =
γ1·β1γ1
identifies γ1·β1γ1
= β1
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 27 / 155
![Page 104: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/104.jpg)
The IV Estimator
With our assumed model,
regressing X on Z identifies γ1
regressing Y on Z identifiesγ1 · β1 =
γ1·β1γ1
identifies γ1·β1γ1
= β1
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 27 / 155
![Page 105: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/105.jpg)
The IV Estimator
With our assumed model,
regressing X on Z identifies γ1
regressing Y on Z identifiesγ1 · β1 =
γ1·β1γ1
identifies γ1·β1γ1
= β1
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 27 / 155
![Page 106: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/106.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 107: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/107.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 108: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/108.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 109: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/109.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 110: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/110.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 111: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/111.jpg)
The Problem of Weak Instruments
Notice that the IV technique uses aratio γ1·β1
γ1= β1.
Dividing by zero (or near zero) makesthings blow up.
Therefore, if the instrument is weak(γ1 ≈ 0), and our estimates of γ1
and γ1 · β1 are not perfect, we canget inaccurate estimates of β1:
medium sample size ⇒ highvariance
small violations of assumptions⇒ large bias
●
X●
Y
●
U
●
Z
γ1 β1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 28 / 155
![Page 112: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/112.jpg)
Preview of Modern Approaches: Relaxing Constant Effects
Suppose we believe that the effectsof Z and X are different for differentunits.
Yi = β0i + β1iXi + Ui
Xi = γ0i + γ1iZi + Vi
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 29 / 155
![Page 113: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/113.jpg)
Preview of Modern Approaches: Relaxing Constant Effects
Suppose we believe that the effectsof Z and X are different for differentunits.
Yi = β0i + β1iXi + Ui
Xi = γ0i + γ1iZi + Vi
●
X●
Y
●
U
●
Z
γ1i β1i
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 29 / 155
![Page 114: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/114.jpg)
IV Estimator with Heterogeneous Effects
●
X●
Y
●
U
●
Z
γ1i β1i
regressing X on Z now onlyidentifies γ1
regressing Y on Z identifiesonly γ1 · β1
γ1 · β1 6= γ1 · β1
Therefore the IV estimator doesnot estimate even the average
β1 (γ1·β1γ16= β1)
With additional assumptions (γi1 ≥ 0for all i), the IV estimator identifies aweighted average effect of X on Yaccording the effects of Z on X .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 30 / 155
![Page 115: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/115.jpg)
IV Estimator with Heterogeneous Effects
●
X●
Y
●
U
●
Z
γ1i β1i
regressing X on Z now onlyidentifies γ1
regressing Y on Z identifiesonly γ1 · β1
γ1 · β1 6= γ1 · β1
Therefore the IV estimator doesnot estimate even the average
β1 (γ1·β1γ16= β1)
With additional assumptions (γi1 ≥ 0for all i), the IV estimator identifies aweighted average effect of X on Yaccording the effects of Z on X .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 30 / 155
![Page 116: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/116.jpg)
IV Estimator with Heterogeneous Effects
●
X●
Y
●
U
●
Z
γ1i β1i
regressing X on Z now onlyidentifies γ1
regressing Y on Z identifiesonly γ1 · β1
γ1 · β1 6= γ1 · β1
Therefore the IV estimator doesnot estimate even the average
β1 (γ1·β1γ16= β1)
With additional assumptions (γi1 ≥ 0for all i), the IV estimator identifies aweighted average effect of X on Yaccording the effects of Z on X .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 30 / 155
![Page 117: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/117.jpg)
IV Estimator with Heterogeneous Effects
●
X●
Y
●
U
●
Z
γ1i β1i
regressing X on Z now onlyidentifies γ1
regressing Y on Z identifiesonly γ1 · β1
γ1 · β1 6= γ1 · β1
Therefore the IV estimator doesnot estimate even the average
β1 (γ1·β1γ16= β1)
With additional assumptions (γi1 ≥ 0for all i), the IV estimator identifies aweighted average effect of X on Yaccording the effects of Z on X .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 30 / 155
![Page 118: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/118.jpg)
IV Estimator with Heterogeneous Effects
●
X●
Y
●
U
●
Z
γ1i β1i
regressing X on Z now onlyidentifies γ1
regressing Y on Z identifiesonly γ1 · β1
γ1 · β1 6= γ1 · β1
Therefore the IV estimator doesnot estimate even the average
β1 (γ1·β1γ16= β1)
With additional assumptions (γi1 ≥ 0for all i), the IV estimator identifies aweighted average effect of X on Yaccording the effects of Z on X .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 30 / 155
![Page 119: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/119.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 120: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/120.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 121: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/121.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)
I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 122: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/122.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 123: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/123.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 124: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/124.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 125: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/125.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 126: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/126.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 127: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/127.jpg)
Recall the Omitted variable bias
True model: Y = α0 + α1D + u2
I D is the treatment variable (e.g. training)I D may be endogenous so that Cov [D, u2] 6= 0
Recall that the OLS estimator for α1 is given by:
α1,OLS =Cov [Y ,D]
V [D]=
Cov [α0 + α1D + u2,D]
Cov [D,D]
α1,OLS =α1Cov [D,D] + Cov [D, u2]
Cov [D,D]
α1,OLS = α1 +Cov [D, u2]
Cov [D,D]
E [α1,OLS ] = α1 + E [Cov [D, u2]
Cov [D,D]]
so bias depends on correlation between u and D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 31 / 155
![Page 128: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/128.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 129: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/129.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 130: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/130.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 131: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/131.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 132: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/132.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 133: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/133.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0.
Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 134: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/134.jpg)
Instrumental Variable Estimator Assumptions
Imagine we have two equations:
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
I Z is our instrumental variable (e.g. randomized encouragement)I π1 is effect of Z on D
Instrumental Variable Assumptions:
1 π1 6= 0 so Z creates some variation in D(called first stage or relevance)
2 Z is exogenous meaning Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0. Thelatter is an exclusion restriction, it implies that the only reason why Zis correlated with Y is through the correlation between Z and D. SoZ has no independent effect on Y .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 32 / 155
![Page 135: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/135.jpg)
Instrumental Variable Estimator AssumptionsInstrumental Variables
• Example: JTPA
Offer to get Training Z
Earnings Y Training D
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 33 / 155
![Page 136: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/136.jpg)
Instrumental Variable Estimator Assumptions
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Based on these IV assumptions we can identify three effects:
1 The first stage effect: Effect of Z on D.
2 Reduced form or intent-to-treat effect: Effect of Z on Y .
3 The instrumental variable treatment effect: Effect of D on Y , usingonly the exogenous variation in D that is induced by Z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 34 / 155
![Page 137: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/137.jpg)
Instrumental Variable Estimator Assumptions
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Based on these IV assumptions we can identify three effects:
1 The first stage effect: Effect of Z on D.
2 Reduced form or intent-to-treat effect: Effect of Z on Y .
3 The instrumental variable treatment effect: Effect of D on Y , usingonly the exogenous variation in D that is induced by Z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 34 / 155
![Page 138: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/138.jpg)
Instrumental Variable Estimator Assumptions
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Based on these IV assumptions we can identify three effects:
1 The first stage effect: Effect of Z on D.
2 Reduced form or intent-to-treat effect: Effect of Z on Y .
3 The instrumental variable treatment effect: Effect of D on Y , usingonly the exogenous variation in D that is induced by Z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 34 / 155
![Page 139: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/139.jpg)
Instrumental Variable Estimator Assumptions
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Based on these IV assumptions we can identify three effects:
1 The first stage effect: Effect of Z on D.
2 Reduced form or intent-to-treat effect: Effect of Z on Y .
3 The instrumental variable treatment effect: Effect of D on Y , usingonly the exogenous variation in D that is induced by Z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 34 / 155
![Page 140: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/140.jpg)
Instrumental Variable Estimator Assumptions
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Based on these IV assumptions we can identify three effects:
1 The first stage effect: Effect of Z on D.
2 Reduced form or intent-to-treat effect: Effect of Z on Y .
3 The instrumental variable treatment effect: Effect of D on Y , usingonly the exogenous variation in D that is induced by Z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 34 / 155
![Page 141: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/141.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 142: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/142.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 143: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/143.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]
=Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 144: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/144.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 145: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/145.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 146: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/146.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 147: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/147.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]]
= π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 148: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/148.jpg)
First Stage Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
First stage effect: Z on D
π1 =Cov [D,Z ]
V [Z ]=
Cov [π0 + π1Z + u1,Z ]
Cov [Z ,Z ]
π1 =π1Cov [Z ,Z ] + Cov [Z , u1]
Cov [Z ,Z ]
π1 = π1 +Cov [Z , u1]
Cov [Z ,Z ]
E [π1] = π1 + E [Cov [Z , u1]
Cov [Z ,Z ]] = π1
π1 is consistent since Cov [u1,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 35 / 155
![Page 149: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/149.jpg)
First Stage Effect in JTPA
First stage effect: Z on D: π1 = Cov [D,Z ]V [Z ]R Code
> cov(d[,c("earnings","training","assignmt")])
earnings training assignmt
earnings 2.811338e+08 685.5254685 257.0625061
training 6.855255e+02 0.2456123 0.1390407
assignmt 2.570625e+02 0.1390407 0.221713
R Code> 0.1390407/0.2217139
[1] 0.6271177
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 36 / 155
![Page 150: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/150.jpg)
First Stage Effect in JTPAR Code
> summary(lm(training~assignmt,data=d))
Call:
lm(formula = training ~ assignmt, data = d)
Residuals:
Min 1Q Median 3Q Max
-0.64165 -0.01453 -0.01453 0.35835 0.98547
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.014528 0.006529 2.225 0.0261 *
assignmt 0.627118 0.007987 78.522 <2e-16 ***
---
Signif. codes: 0 *** 0.001 ** 0.01 * 0.05 . 0.1 1
Residual standard error: 0.398 on 11202 degrees of freedom
Multiple R-squared: 0.355, Adjusted R-squared: 0.355
F-statistic: 6166 on 1 and 11202 DF, p-value: < 2.2e-1
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 37 / 155
![Page 151: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/151.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 152: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/152.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 153: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/153.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 154: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/154.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 155: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/155.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2.
Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 156: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/156.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 157: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/157.jpg)
Reduced Form/Intent-to-treat Effect
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
Reduced Form/Intent-to-treat Effect: Z on Y : Plug first into second stage:
Y = α0 + α1(π0 + π1Z + u1) + u2
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Note that
γ1 =Cov [Y ,Z ]
Cov [Z ,Z ]=
Cov [γ0 + γ1Z + u3,Z ]
Cov [Z ,Z ]
E [γ1] = γ1 + E [Cov [Z , u3]
Cov [Z ,Z ]] = γ1
γ1 is consistent since Cov [u1,Z ] = 0 and Cov [u2,Z ] = 0 implies Cov [u3,Z ] = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 38 / 155
![Page 158: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/158.jpg)
Reduced Form/Intent-to-treat EffectR Code
> summary(lm(earnings~assignmt,data=d))
Call:
lm(formula = earnings ~ assignmt, data = d)
Residuals:
Min 1Q Median 3Q Max
-16200 -13803 -4817 8950 139560
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 15040.5 274.9 54.716 < 2e-16 ***
assignmt 1159.4 336.3 3.448 0.000567 ***
---
Signif. codes: 0 *** 0.001 ** 0.01 * 0.05 . 0.1 1
Residual standard error: 16760 on 11202 degrees of freedom
Multiple R-squared: 0.00106, Adjusted R-squared: 0.000971
F-statistic: 11.89 on 1 and 11202 DF, p-value: 0.000566
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 39 / 155
![Page 159: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/159.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 160: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/160.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 161: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/161.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 162: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/162.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1
=Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 163: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/163.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 164: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/164.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 165: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/165.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]
=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 166: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/166.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]=
α1 +Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 167: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/167.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 168: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/168.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] =
α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 169: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/169.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 170: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/170.jpg)
Instrumental Variable Effect: Wald Estimator
Second Stage:Y = α0 + α1D + u2
First Stage: D = π0 + π1Z + u1
IV assumptions: Cov [u1,Z ] = 0, π1 6= 0, and Cov [u2,Z ] = 0
IV Effect: X on Y using exogenous variation in D that is induced by Z . Recall
Y = (α0 + α1π0) + (α1π1)Z + (α1u1 + u2)
Y = γ0 + γ1Z + u3
where γ0 = α0 + α1π0, γ1 = α1π1, and u3 = α1u1 + u2. Given this, we can identify α1:
α1 =γ1
π1=
Effect of Z on Y
Effect of Z on D=
Cov [Y ,Z ]/Cov [Z ,Z ]
Cov [D,Z ]/Cov [Z ,Z ]=
Cov [Y ,Z ]
Cov [D,Z ]
α1 =Cov [α0 + α1D + u2,Z ]
Cov [D,Z ]=α1Cov [D,Z ] + Cov [u2,Z ]
Cov [D,Z ]= α1 +
Cov [u2,Z ]
Cov [D,Z ]
E [α1] = α1 + E [Cov [u2,Z ]
Cov [D,Z ]]
α1 is consistent if Cov [u2,Z ] = 0 but has a bias which decreases with instrument strength.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 40 / 155
![Page 171: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/171.jpg)
Instrumental Variable Effect: Wald Estimator
Instrumental Variable Effect: α1 = Effect of Z on YEffect of Z on D = Cov [Y ,Z ]
Cov [D,Z ]
R Code> cov(d[,c("earnings","training","assignmt")])
earnings training assignmt
earnings 2.811338e+08 685.5254685 257.0625061
training 6.855255e+02 0.2456123 0.1390407
assignmt 2.570625e+02 0.1390407 0.221713
R Code> 257.0625061/0.1390407
[1] 1848.829
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 41 / 155
![Page 172: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/172.jpg)
Instrumental Variable Effect: Two Stage Least Squares
The instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 173: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/173.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 174: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/174.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 175: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/175.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 176: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/176.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 177: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/177.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 178: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/178.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 179: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/179.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 180: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/180.jpg)
Instrumental Variable Effect: Two Stage Least SquaresThe instrumental variable estimator:
α1 =γ1
π1=
Cov [Y ,Z ]
Cov [D,Z ]
is numerically equivalent to the following two step procedure:
1 Fit first stage and obtain fitted values D = π0 + π1Z
2 Plug into second stage:
Y = α0 + α1D + u2
Y = α0 + α1(π0 + π1Z ) + u2
Y = (α0 + α1π0) + α1(π1Z ) + u2
α1 is solely identified based on variation in D that comes from Z
Point estimates from second regression are equivalent to IV estimator, the standard errorsare not quite correct since they ignore the estimation uncertainty in π0 and π1.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 42 / 155
![Page 181: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/181.jpg)
Instrumental Variable Effect: Two Stage Least Squares
R Code> training_hat <- lm(training~assignmt,data=d)$fitted
> summary(lm(earnings~training_hat,data=d))
Call:
lm(formula = earnings ~ training_hat, data = d)
Residuals:
Min 1Q Median 3Q Max
-16200 -13803 -4817 8950 139560
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 15013.6 281.3 53.375 < 2e-16 ***
training_hat 1848.8 536.2 3.448 0.000567 ***
---
Signif. codes: 0 *** 0.001 ** 0.01 * 0.05 . 0.1 1
Residual standard error: 16760 on 11202 degrees of freedom
Multiple R-squared: 0.00106, Adjusted R-squared: 0.000971
F-statistic: 11.89 on 1 and 11202 DF, p-value: 0.0005669
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 43 / 155
![Page 182: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/182.jpg)
Instrumental Variable Effect: Two Stage Least Squares
R Code> library(AER)
> summary(ivreg(earnings ~ training | assignmt,data = d))
Call:
ivreg(formula = earnings ~ training | assignmt, data = d)
Residuals:
Min 1Q Median 3Q Max
-16862 -13716 -4943 8834 140746
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 15013.6 280.6 53.508 < 2e-16 ***
training 1848.8 534.9 3.457 0.000549 ***
---
Residual standard error: 16720 on 11202 degrees of freedom
Multiple R-Squared: 0.00603, Adjusted R-squared: 0.005941
Wald test: 11.95 on 1 and 11202 DF, p-value: 0.0005491
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 44 / 155
![Page 183: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/183.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 184: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/184.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 185: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/185.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 186: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/186.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 187: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/187.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 188: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/188.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 189: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/189.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 190: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/190.jpg)
Judging the Credibility of IV Estimates
The probability limit of the IV estimator is given by:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
so to obtain consistent estimates the instrument Z must be:
Relevant: Cov(Z ,D) 6= 0 (testable)
I If Cov(Z ,D) is small, the instrument is weak. We get consistency inasymptotia, but in small (finite) samples we can get strong bias even ifinstrument is perfectly exogenous
Exogenous: Cov(Z , u2) = 0 (untestable)
I If Z has an independent effect on Y other than through D we haveCov(Z , u2) 6= 0 and estimates are inconsistent
I Even small violations can lead to significant large sample bias unlessinstruments are strong
Failure of either condition is a problem! But both conditions can be hard tosatisfy at the same time. There often is a tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 45 / 155
![Page 191: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/191.jpg)
Instrumental Variable Examples
Study Outcome Treatment Instrument
Angrist and Evans (1998)
Earnings More than 2 Children
Multiple Second Birth (Twins)
Angrist and Evans (1998)
Earnings More than 2 Children
First Two Children are Same Sex
Levitt (1997) Crime Rates Number of Policemen
Mayoral Elections
Angrist and Krueger (1991)
Earnings Years of Schooling Quarter of Birth
Angrist (1990) Earnings Veteran Status Vietnam Draft Lottery
Miguel, Satyanath and Sergenti (2004)
Civil War Onset GDP per capita Lagged Rainfall
Acemoglu, Johnson and Robinson (2001)
Economic performance
Current Institutions Settler Mortality in Colonial Times
Cleary and Barro (2006)
Religiosity GDP per capita Distance from Equator
_cons 14605.09 209.7698 69.62 0.000 14193.9 15016.27 training 2791.088 318.567 8.76 0.000 2166.64 3415.535 earnings Coef. Std. Err. t P>|t| [95% Conf. Interval]
Total 3.1495e+12 11203 281133832 Root MSE = 16711 Adj R-squared = 0.0067 Residual 3.1281e+12 11202 279245396 R-squared = 0.0068 Model 2.1435e+10 1 2.1435e+10 Prob > F = 0.0000 F( 1, 11202) = 76.76 Source SS df MS Number of obs = 11204
. reg earnings training
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 46 / 155
![Page 192: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/192.jpg)
Exogenous, but Weak Instruments
In contrast to OLS, the IV estimator is not unbiased in small (finite) sampleseven when instrument is perfectly exogenous
Because of sampling variability in first stage estimation of fitted values,some part of the correlation between errors in first and second stage seepsinto 2SLS estimates (correlation disappears in large samples)
Finite sample bias can be considerable (e.g., 20 - 30%), even when thesample size is over 100,000 if the instrument is weak
Relative bias of αD,IV versus αD,OLS is approximately 1/F where F is theF -statistic for testing H0: πZ = 0, i.e. partial effect of Z on D is zero (oragainst joint zero for multiple instruments)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 47 / 155
![Page 193: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/193.jpg)
Exogenous, but Weak Instruments
In contrast to OLS, the IV estimator is not unbiased in small (finite) sampleseven when instrument is perfectly exogenous
Because of sampling variability in first stage estimation of fitted values,some part of the correlation between errors in first and second stage seepsinto 2SLS estimates (correlation disappears in large samples)
Finite sample bias can be considerable (e.g., 20 - 30%), even when thesample size is over 100,000 if the instrument is weak
Relative bias of αD,IV versus αD,OLS is approximately 1/F where F is theF -statistic for testing H0: πZ = 0, i.e. partial effect of Z on D is zero (oragainst joint zero for multiple instruments)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 47 / 155
![Page 194: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/194.jpg)
Exogenous, but Weak Instruments
In contrast to OLS, the IV estimator is not unbiased in small (finite) sampleseven when instrument is perfectly exogenous
Because of sampling variability in first stage estimation of fitted values,some part of the correlation between errors in first and second stage seepsinto 2SLS estimates (correlation disappears in large samples)
Finite sample bias can be considerable (e.g., 20 - 30%), even when thesample size is over 100,000 if the instrument is weak
Relative bias of αD,IV versus αD,OLS is approximately 1/F where F is theF -statistic for testing H0: πZ = 0, i.e. partial effect of Z on D is zero (oragainst joint zero for multiple instruments)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 47 / 155
![Page 195: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/195.jpg)
Exogenous, but Weak Instruments
In contrast to OLS, the IV estimator is not unbiased in small (finite) sampleseven when instrument is perfectly exogenous
Because of sampling variability in first stage estimation of fitted values,some part of the correlation between errors in first and second stage seepsinto 2SLS estimates (correlation disappears in large samples)
Finite sample bias can be considerable (e.g., 20 - 30%), even when thesample size is over 100,000 if the instrument is weak
Relative bias of αD,IV versus αD,OLS is approximately 1/F where F is theF -statistic for testing H0: πZ = 0, i.e. partial effect of Z on D is zero (oragainst joint zero for multiple instruments)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 47 / 155
![Page 196: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/196.jpg)
Exogenous, but Weak Instruments
In contrast to OLS, the IV estimator is not unbiased in small (finite) sampleseven when instrument is perfectly exogenous
Because of sampling variability in first stage estimation of fitted values,some part of the correlation between errors in first and second stage seepsinto 2SLS estimates (correlation disappears in large samples)
Finite sample bias can be considerable (e.g., 20 - 30%), even when thesample size is over 100,000 if the instrument is weak
Relative bias of αD,IV versus αD,OLS is approximately 1/F where F is theF -statistic for testing H0: πZ = 0, i.e. partial effect of Z on D is zero (oragainst joint zero for multiple instruments)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 47 / 155
![Page 197: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/197.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 198: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/198.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 199: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/199.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 200: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/200.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 201: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/201.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 202: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/202.jpg)
Exogenous, but Weak Instruments
Adding instruments increases the relevance of the instrument set (increasesthe first stage F)
But too many instruments increases small sample bias (compared to fewinstruments) and also call into doubt the exclusion restrictions
Best to have single, strong instrument
There are more complex competitors to 2SLS:
I Limited Information Maximum Likelihood (LIML) estimationI Jackknife instrumental variablesI Imbens and Rosenbaum (2005) robust IV.
Small sample studies suggest that LIML and robust IV may be superior to2SLS in small samples (but remains open area of research)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 48 / 155
![Page 203: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/203.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 204: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/204.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 205: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/205.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 206: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/206.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 207: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/207.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 208: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/208.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 209: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/209.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 210: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/210.jpg)
Failure of Exogeneity
Note the probability limit:
plimαD,IV = αD +Corr(Z , u2)
Corr(Z ,D)
σu2
σD
In general we get inconsistent estimates if Corr(Z , u2) 6= 0. This largesample bias can often be considerable but is hard to quantify preciselybecause it depends on unobservables
If the instrument is stronger, large sample bias can be attenuated, but oftenmagnitude of Corr(Z , u2) dominates
The best we can often do is often to be skeptical and to make sureexogeneity is highly plausible in the setting to which we apply IV
Sensitivity analysis:
I Is the instrument plausibly exogenous or can it be easily predicted fromcovariates?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 49 / 155
![Page 211: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/211.jpg)
Failure of Exogeneity
Does a randomly assigned instrument Z always satisfy Cov(Z , u2) = 0?
No! Encouragement may still have independent effect on outcome otherthan through the treatment
When designing an encouragement experiment we need to be careful todesign encouragements so that they are relevant, but also narrowly targetedto only create variation in treatment intake
SUTVA may be a concern as well
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 50 / 155
![Page 212: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/212.jpg)
Failure of Exogeneity
Does a randomly assigned instrument Z always satisfy Cov(Z , u2) = 0?
No!
Encouragement may still have independent effect on outcome otherthan through the treatment
When designing an encouragement experiment we need to be careful todesign encouragements so that they are relevant, but also narrowly targetedto only create variation in treatment intake
SUTVA may be a concern as well
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 50 / 155
![Page 213: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/213.jpg)
Failure of Exogeneity
Does a randomly assigned instrument Z always satisfy Cov(Z , u2) = 0?
No! Encouragement may still have independent effect on outcome otherthan through the treatment
When designing an encouragement experiment we need to be careful todesign encouragements so that they are relevant, but also narrowly targetedto only create variation in treatment intake
SUTVA may be a concern as well
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 50 / 155
![Page 214: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/214.jpg)
Failure of Exogeneity
Does a randomly assigned instrument Z always satisfy Cov(Z , u2) = 0?
No! Encouragement may still have independent effect on outcome otherthan through the treatment
When designing an encouragement experiment we need to be careful todesign encouragements so that they are relevant, but also narrowly targetedto only create variation in treatment intake
SUTVA may be a concern as well
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 50 / 155
![Page 215: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/215.jpg)
Failure of Exogeneity
Does a randomly assigned instrument Z always satisfy Cov(Z , u2) = 0?
No! Encouragement may still have independent effect on outcome otherthan through the treatment
When designing an encouragement experiment we need to be careful todesign encouragements so that they are relevant, but also narrowly targetedto only create variation in treatment intake
SUTVA may be a concern as well
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 50 / 155
![Page 216: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/216.jpg)
General Words of Caution
These methods are not a panacea. Even if someone calls them a “naturalexperiment” that doesn’t actually make it like an experiment.
“The general lesson is once again the ultimate futility of tryingto avoid thinking about how and why things work”- Angus Deaton (2010)
“[there is a] risk [of] transforming the methodologic dream ofavoiding unmeasured confounding into a nightmare of conflictingbiased estimates”- Hernan and Robins (2006)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 51 / 155
![Page 217: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/217.jpg)
General Words of Caution
These methods are not a panacea. Even if someone calls them a “naturalexperiment” that doesn’t actually make it like an experiment.
“The general lesson is once again the ultimate futility of tryingto avoid thinking about how and why things work”- Angus Deaton (2010)
“[there is a] risk [of] transforming the methodologic dream ofavoiding unmeasured confounding into a nightmare of conflictingbiased estimates”- Hernan and Robins (2006)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 51 / 155
![Page 218: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/218.jpg)
General Words of Caution
These methods are not a panacea. Even if someone calls them a “naturalexperiment” that doesn’t actually make it like an experiment.
“The general lesson is once again the ultimate futility of tryingto avoid thinking about how and why things work”- Angus Deaton (2010)
“[there is a] risk [of] transforming the methodologic dream ofavoiding unmeasured confounding into a nightmare of conflictingbiased estimates”- Hernan and Robins (2006)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 51 / 155
![Page 219: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/219.jpg)
General Words of Caution
These methods are not a panacea. Even if someone calls them a “naturalexperiment” that doesn’t actually make it like an experiment.
“The general lesson is once again the ultimate futility of tryingto avoid thinking about how and why things work”- Angus Deaton (2010)
“[there is a] risk [of] transforming the methodologic dream ofavoiding unmeasured confounding into a nightmare of conflictingbiased estimates”- Hernan and Robins (2006)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 51 / 155
![Page 220: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/220.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 221: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/221.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 222: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/222.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 223: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/223.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 224: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/224.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 225: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/225.jpg)
Conclusion
IV works only under very specific circumstances(e.g. well designed encouragement design experiments)
Often, it will be difficult to find instruments that are both relevant (strongenough) and exogenous
Violations of assumptions can lead to large biases and estimation theory iscomplicated
So far, we have assumed constant treatment effects αD which seemsunrealistic in most settings. Often an instrument affects only asubpopulation of interest and we have little information about treatmenteffects for other units that may not be affected by the instrument at all.
Next time we’ll discuss modern IV with heterogeneous potential outcomes
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 52 / 155
![Page 226: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/226.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 53 / 155
![Page 227: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/227.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 53 / 155
![Page 228: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/228.jpg)
Fun With Coarsening Bias
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 54 / 155
![Page 229: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/229.jpg)
The Idea
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 55 / 155
![Page 230: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/230.jpg)
Design
Data: British Election Survey 1979-2010
Outcome: voting for conservative party in most recent election
Instrument: respondents turning 14 in 1947 or later who were affectedby the 1947 school leaving reform (increased age from 14 to 15)
Treatment: either years of schooling or coarsened indicator forcompleted high school or not
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 56 / 155
![Page 231: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/231.jpg)
Data
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 57 / 155
![Page 232: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/232.jpg)
Findings
Finding: Using the dichotomous version of the treatment inflates theresult by a factor of three
Suggestion: Use the linear version of the treatment (although see thearticle for more details!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 58 / 155
![Page 233: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/233.jpg)
Where We’ve Been and Where We’re Going...
Last WeekI selection on observables and measured confounding
This WeekI Monday:
F natural experimentsF classical view of instrumental variables
I Wednesday:F modern view of instrumental variablesF regression discontinuity
The Following WeekI repeated observations
Long RunI causality with measured confounding → unmeasured confounding →
repeated data
Questions?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 59 / 155
![Page 234: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/234.jpg)
Where We’ve Been and Where We’re Going...
Last WeekI selection on observables and measured confounding
This WeekI Monday:
F natural experimentsF classical view of instrumental variables
I Wednesday:F modern view of instrumental variablesF regression discontinuity
The Following WeekI repeated observations
Long RunI causality with measured confounding → unmeasured confounding →
repeated data
Questions?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 59 / 155
![Page 235: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/235.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 60 / 155
![Page 236: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/236.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 60 / 155
![Page 237: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/237.jpg)
Identification with Traditional Instrumental Variables
Two equations:I Y = γ + αD + ε (Second Stage)I D = τ + ρZ + η (First Stage)
Four Assumptions1 Exogeneity: Cov(Z , η) = 02 Exclusion: Cov(Z , ε) = 03 First Stage Relevance: ρ 6= 04 Homogeneity: α = Y1,i − Y0,i constant for all units i .
Or in the case of a multivalued treatment with s levels we assumeα = Ys,i − Ys−1,i .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 61 / 155
![Page 238: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/238.jpg)
Instrumental Variables and Potential Outcomes
Basic idea of IV:I Di not randomized, but Zi isI Zi only affects Yi through Di
Di now depends on Zi two potential treatments:Di (1) = Di (z = 1) and Di (0).
Outcome can depend on both the treatment and the instrument:Yi (d , z) is the outcome if unit i had received treatment Di = d andinstrument value Zi = z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 62 / 155
![Page 239: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/239.jpg)
Instrumental Variables and Potential Outcomes
Basic idea of IV:I Di not randomized, but Zi isI Zi only affects Yi through Di
Di now depends on Zi two potential treatments:Di (1) = Di (z = 1) and Di (0).
Outcome can depend on both the treatment and the instrument:Yi (d , z) is the outcome if unit i had received treatment Di = d andinstrument value Zi = z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 62 / 155
![Page 240: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/240.jpg)
Instrumental Variables and Potential Outcomes
Basic idea of IV:I Di not randomized, but Zi isI Zi only affects Yi through Di
Di now depends on Zi two potential treatments:Di (1) = Di (z = 1) and Di (0).
Outcome can depend on both the treatment and the instrument:Yi (d , z) is the outcome if unit i had received treatment Di = d andinstrument value Zi = z .
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 62 / 155
![Page 241: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/241.jpg)
Potential Outcome Model for Instrumental Variables
Definition (Instrument)
Zi : Binary instrument for unit i .
Zi =
{1 if unit i “encouraged” to receive treatment0 if unit i “encouraged” to receive control
Definition (Potential Treatments)
Dz indicates potential treatment status given Z = z
D1 = 1 encouraged to take treatment and takes treatment
Assumption
Observed treatments are realized as
D = Z · D1 + (1− Z ) · D0 so Di =
{D1i if Zi = 1D0i if Zi = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 63 / 155
![Page 242: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/242.jpg)
Potential Outcome Model for Instrumental Variables
Definition (Instrument)
Zi : Binary instrument for unit i .
Zi =
{1 if unit i “encouraged” to receive treatment0 if unit i “encouraged” to receive control
Definition (Potential Treatments)
Dz indicates potential treatment status given Z = z
D1 = 1 encouraged to take treatment and takes treatment
Assumption
Observed treatments are realized as
D = Z · D1 + (1− Z ) · D0 so Di =
{D1i if Zi = 1D0i if Zi = 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 63 / 155
![Page 243: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/243.jpg)
Key Assumptions in the Modern Approach
1 Exogeneity of the Instrument
2 Exclusion Restriction
3 First-stage relationship
4 Monotonicity
You may sometimes see assumptions 1 and 2 collapsed into an assumptioncalled something like “Ignorability of the Instrument”. I find it helpful toassess them separately though.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 64 / 155
![Page 244: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/244.jpg)
Key Assumptions in the Modern Approach
1 Exogeneity of the Instrument
2 Exclusion Restriction
3 First-stage relationship
4 Monotonicity
You may sometimes see assumptions 1 and 2 collapsed into an assumptioncalled something like “Ignorability of the Instrument”. I find it helpful toassess them separately though.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 64 / 155
![Page 245: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/245.jpg)
Key Assumptions in the Modern Approach
1 Exogeneity of the Instrument
2 Exclusion Restriction
3 First-stage relationship
4 Monotonicity
You may sometimes see assumptions 1 and 2 collapsed into an assumptioncalled something like “Ignorability of the Instrument”. I find it helpful toassess them separately though.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 64 / 155
![Page 246: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/246.jpg)
Key Assumptions in the Modern Approach
1 Exogeneity of the Instrument
2 Exclusion Restriction
3 First-stage relationship
4 Monotonicity
You may sometimes see assumptions 1 and 2 collapsed into an assumptioncalled something like “Ignorability of the Instrument”. I find it helpful toassess them separately though.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 64 / 155
![Page 247: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/247.jpg)
Key Assumptions in the Modern Approach
1 Exogeneity of the Instrument
2 Exclusion Restriction
3 First-stage relationship
4 Monotonicity
You may sometimes see assumptions 1 and 2 collapsed into an assumptioncalled something like “Ignorability of the Instrument”. I find it helpful toassess them separately though.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 64 / 155
![Page 248: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/248.jpg)
Assumption 1: Exogeneity of the Instrument
Essentially we need the instrument to be randomized:
[{Yi (d , z), ∀d , z},Di (1),Di (0)]⊥⊥Zi
We can weaken this to conditional ignorability. But why believeconditional ignorability for the instrument but not the treatment?
Best instruments are truly randomized.
This assumption alone gets us the intent-to-treat (ITT) effect:
E [Yi |Zi = 1]− E [Yi |Zi = 0] = E [Yi (Di (1), 1)− Yi (Di (0), 0)]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 65 / 155
![Page 249: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/249.jpg)
Assumption 1: Exogeneity of the Instrument
Essentially we need the instrument to be randomized:
[{Yi (d , z), ∀d , z},Di (1),Di (0)]⊥⊥Zi
We can weaken this to conditional ignorability. But why believeconditional ignorability for the instrument but not the treatment?
Best instruments are truly randomized.
This assumption alone gets us the intent-to-treat (ITT) effect:
E [Yi |Zi = 1]− E [Yi |Zi = 0] = E [Yi (Di (1), 1)− Yi (Di (0), 0)]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 65 / 155
![Page 250: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/250.jpg)
Assumption 1: Exogeneity of the Instrument
Essentially we need the instrument to be randomized:
[{Yi (d , z), ∀d , z},Di (1),Di (0)]⊥⊥Zi
We can weaken this to conditional ignorability. But why believeconditional ignorability for the instrument but not the treatment?
Best instruments are truly randomized.
This assumption alone gets us the intent-to-treat (ITT) effect:
E [Yi |Zi = 1]− E [Yi |Zi = 0] = E [Yi (Di (1), 1)− Yi (Di (0), 0)]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 65 / 155
![Page 251: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/251.jpg)
Assumption 1: Exogeneity of the Instrument
Essentially we need the instrument to be randomized:
[{Yi (d , z), ∀d , z},Di (1),Di (0)]⊥⊥Zi
We can weaken this to conditional ignorability. But why believeconditional ignorability for the instrument but not the treatment?
Best instruments are truly randomized.
This assumption alone gets us the intent-to-treat (ITT) effect:
E [Yi |Zi = 1]− E [Yi |Zi = 0] = E [Yi (Di (1), 1)− Yi (Di (0), 0)]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 65 / 155
![Page 252: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/252.jpg)
Assumption 2: Exclusion Restriction
The instrument has no direct effect on the outcome, once we fix thevalue of the treatment.
Yi (d , 1) = Yi (d , 0) for d = 0, 1
Given this exclusion restriction, we know that the potential outcomesfor each treatment status only depend on the treatment, not theinstrument:
Yi (1) ≡ Yi (1, 1) = Yi (1, 0)
Yi (0) ≡ Yi (0, 1) = Yi (0, 0)
Random assignment of the instrument is not sufficient for exclusion
NOT A TESTABLE ASSUMPTION
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 66 / 155
![Page 253: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/253.jpg)
Assumption 2: Exclusion Restriction
The instrument has no direct effect on the outcome, once we fix thevalue of the treatment.
Yi (d , 1) = Yi (d , 0) for d = 0, 1
Given this exclusion restriction, we know that the potential outcomesfor each treatment status only depend on the treatment, not theinstrument:
Yi (1) ≡ Yi (1, 1) = Yi (1, 0)
Yi (0) ≡ Yi (0, 1) = Yi (0, 0)
Random assignment of the instrument is not sufficient for exclusion
NOT A TESTABLE ASSUMPTION
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 66 / 155
![Page 254: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/254.jpg)
Assumption 2: Exclusion Restriction
The instrument has no direct effect on the outcome, once we fix thevalue of the treatment.
Yi (d , 1) = Yi (d , 0) for d = 0, 1
Given this exclusion restriction, we know that the potential outcomesfor each treatment status only depend on the treatment, not theinstrument:
Yi (1) ≡ Yi (1, 1) = Yi (1, 0)
Yi (0) ≡ Yi (0, 1) = Yi (0, 0)
Random assignment of the instrument is not sufficient for exclusion
NOT A TESTABLE ASSUMPTION
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 66 / 155
![Page 255: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/255.jpg)
Assumption 2: Exclusion Restriction
The instrument has no direct effect on the outcome, once we fix thevalue of the treatment.
Yi (d , 1) = Yi (d , 0) for d = 0, 1
Given this exclusion restriction, we know that the potential outcomesfor each treatment status only depend on the treatment, not theinstrument:
Yi (1) ≡ Yi (1, 1) = Yi (1, 0)
Yi (0) ≡ Yi (0, 1) = Yi (0, 0)
Random assignment of the instrument is not sufficient for exclusion
NOT A TESTABLE ASSUMPTION
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 66 / 155
![Page 256: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/256.jpg)
Assumption 3: First Stage Relationship
The instrument must have an effect on the treatment.
E [Di (1)− Di (0)] 6= 0
Implies thatI Cov(Di ,Zi ) 6= 0,I 0 < P(Z = 1) < 1I P(D1 = 1) 6= P(D0 = 1)
This is testable by regressing D on Z
Note that even a weak instrument can induce a lot of bias. Thus, forpractical sample sizes you need a strong first stage effect.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 67 / 155
![Page 257: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/257.jpg)
Assumption 3: First Stage Relationship
The instrument must have an effect on the treatment.
E [Di (1)− Di (0)] 6= 0
Implies thatI Cov(Di ,Zi ) 6= 0,I 0 < P(Z = 1) < 1I P(D1 = 1) 6= P(D0 = 1)
This is testable by regressing D on Z
Note that even a weak instrument can induce a lot of bias. Thus, forpractical sample sizes you need a strong first stage effect.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 67 / 155
![Page 258: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/258.jpg)
Assumption 3: First Stage Relationship
The instrument must have an effect on the treatment.
E [Di (1)− Di (0)] 6= 0
Implies thatI Cov(Di ,Zi ) 6= 0,I 0 < P(Z = 1) < 1I P(D1 = 1) 6= P(D0 = 1)
This is testable by regressing D on Z
Note that even a weak instrument can induce a lot of bias. Thus, forpractical sample sizes you need a strong first stage effect.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 67 / 155
![Page 259: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/259.jpg)
Assumption 3: First Stage Relationship
The instrument must have an effect on the treatment.
E [Di (1)− Di (0)] 6= 0
Implies thatI Cov(Di ,Zi ) 6= 0,I 0 < P(Z = 1) < 1I P(D1 = 1) 6= P(D0 = 1)
This is testable by regressing D on Z
Note that even a weak instrument can induce a lot of bias. Thus, forpractical sample sizes you need a strong first stage effect.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 67 / 155
![Page 260: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/260.jpg)
Assumption 4: Monotonicity
To allow for heterogenous effects we need to make a new assumptionabout the relationship between the instrument and the treatment.
Monotonicity says that the presence of the instrument never dissuadessomeone from taking the treatment:
Di (1)− Di (0) ≥ 0
Note if this holds in the opposite direction Di (1)− Di (0) ≤ 0, we canalways rescale Di to make the assumption hold.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 68 / 155
![Page 261: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/261.jpg)
Assumption 4: Monotonicity
To allow for heterogenous effects we need to make a new assumptionabout the relationship between the instrument and the treatment.
Monotonicity says that the presence of the instrument never dissuadessomeone from taking the treatment:
Di (1)− Di (0) ≥ 0
Note if this holds in the opposite direction Di (1)− Di (0) ≤ 0, we canalways rescale Di to make the assumption hold.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 68 / 155
![Page 262: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/262.jpg)
Assumption 4: Monotonicity
To allow for heterogenous effects we need to make a new assumptionabout the relationship between the instrument and the treatment.
Monotonicity says that the presence of the instrument never dissuadessomeone from taking the treatment:
Di (1)− Di (0) ≥ 0
Note if this holds in the opposite direction Di (1)− Di (0) ≤ 0, we canalways rescale Di to make the assumption hold.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 68 / 155
![Page 263: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/263.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 264: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/264.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 265: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/265.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 266: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/266.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 267: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/267.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 268: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/268.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 269: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/269.jpg)
Principal Strata
Following Angrist, Imbens, and Rubin (1996), we can define foursubpopulations (for cases with a binary treatment and a binaryinstrument):
Definition
Compliers: D1 > D0 (D0 = 0 and D1 = 1).
Always-takers: D1 = D0 = 1.
Never-takers: D1 = D0 = 0.
Defiers: D1 < D0 (D0 = 1 and D1 = 0).
Only one of the potential treatment indicators (D0,D1) is observed, so inthe general case we cannot identify which group any particular individualbelongs to
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 69 / 155
![Page 270: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/270.jpg)
Monotonicity means no defiers
Name Di (1) Di (0)
Always Takers 1 1Never Takers 0 0Compliers 1 0Defiers 0 1
We sometimes call assumption 4 no defiers because the monotonicityassumption rules out the existence of defiers.
This means we can now sometimes identify the subgroup
Anyone with Di = 1 when Zi = 0 must be an always-taker andanyone with Di = 0 when Zi = 1 must be a never-taker.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 70 / 155
![Page 271: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/271.jpg)
Monotonicity means no defiers
Name Di (1) Di (0)
Always Takers 1 1Never Takers 0 0Compliers 1 0Defiers 0 1
We sometimes call assumption 4 no defiers because the monotonicityassumption rules out the existence of defiers.
This means we can now sometimes identify the subgroup
Anyone with Di = 1 when Zi = 0 must be an always-taker andanyone with Di = 0 when Zi = 1 must be a never-taker.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 70 / 155
![Page 272: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/272.jpg)
Monotonicity means no defiers
Name Di (1) Di (0)
Always Takers 1 1Never Takers 0 0Compliers 1 0Defiers 0 1
We sometimes call assumption 4 no defiers because the monotonicityassumption rules out the existence of defiers.
This means we can now sometimes identify the subgroup
Anyone with Di = 1 when Zi = 0 must be an always-taker andanyone with Di = 0 when Zi = 1 must be a never-taker.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 70 / 155
![Page 273: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/273.jpg)
Local Average Treatment Effect (LATE)
Under these four assumptions, we can use the Wald estimator toestimate the local average treatment effect (LATE) or the complieraverage treatment effect (CATE).
This is the ATE among the compliers: those that take the treatmentwhen encouraged to do so.
That is, the LATE theorem (proof in the appendix), states that:
E [Yi |Zi = 1]− E [Yi |Zi = 0]
E [Di |Zi = 1]− E [Di |Zi = 0]= E [Yi (1)− Yi (0)|Di (1) > Di (0)]
This may seem mundane in that we have simply changed ourassumptions and not our estimation, but this fact was a massiveintellectual jump in our understanding of IV.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 71 / 155
![Page 274: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/274.jpg)
Local Average Treatment Effect (LATE)
Under these four assumptions, we can use the Wald estimator toestimate the local average treatment effect (LATE) or the complieraverage treatment effect (CATE).
This is the ATE among the compliers: those that take the treatmentwhen encouraged to do so.
That is, the LATE theorem (proof in the appendix), states that:
E [Yi |Zi = 1]− E [Yi |Zi = 0]
E [Di |Zi = 1]− E [Di |Zi = 0]= E [Yi (1)− Yi (0)|Di (1) > Di (0)]
This may seem mundane in that we have simply changed ourassumptions and not our estimation, but this fact was a massiveintellectual jump in our understanding of IV.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 71 / 155
![Page 275: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/275.jpg)
Local Average Treatment Effect (LATE)
Under these four assumptions, we can use the Wald estimator toestimate the local average treatment effect (LATE) or the complieraverage treatment effect (CATE).
This is the ATE among the compliers: those that take the treatmentwhen encouraged to do so.
That is, the LATE theorem (proof in the appendix), states that:
E [Yi |Zi = 1]− E [Yi |Zi = 0]
E [Di |Zi = 1]− E [Di |Zi = 0]= E [Yi (1)− Yi (0)|Di (1) > Di (0)]
This may seem mundane in that we have simply changed ourassumptions and not our estimation, but this fact was a massiveintellectual jump in our understanding of IV.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 71 / 155
![Page 276: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/276.jpg)
Local Average Treatment Effect (LATE)
Under these four assumptions, we can use the Wald estimator toestimate the local average treatment effect (LATE) or the complieraverage treatment effect (CATE).
This is the ATE among the compliers: those that take the treatmentwhen encouraged to do so.
That is, the LATE theorem (proof in the appendix), states that:
E [Yi |Zi = 1]− E [Yi |Zi = 0]
E [Di |Zi = 1]− E [Di |Zi = 0]= E [Yi (1)− Yi (0)|Di (1) > Di (0)]
This may seem mundane in that we have simply changed ourassumptions and not our estimation, but this fact was a massiveintellectual jump in our understanding of IV.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 71 / 155
![Page 277: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/277.jpg)
Who are the Compliers?
Study Outcome Treatment Instrument
Angrist and Evans (1998)
Earnings More than 2 Children
Multiple Second Birth (Twins)
Angrist and Evans (1998)
Earnings More than 2 Children
First Two Children are Same Sex
Levitt (1997) Crime Rates Number of Policemen
Mayoral Elections
Angrist and Krueger (1991)
Earnings Years of Schooling Quarter of Birth
Angrist (1990) Earnings Veteran Status Vietnam Draft Lottery
Miguel, Satyanath and Sergenti (2004)
Civil War Onset GDP per capita Lagged Rainfall
Acemoglu, Johnson and Robinson (2001)
Economic performance
Current Institutions Settler Mortality in Colonial Times
Cleary and Barro (2006)
Religiosity GDP per capita Distance from Equator
_cons 14605.09 209.7698 69.62 0.000 14193.9 15016.27 training 2791.088 318.567 8.76 0.000 2166.64 3415.535 earnings Coef. Std. Err. t P>|t| [95% Conf. Interval]
Total 3.1495e+12 11203 281133832 Root MSE = 16711 Adj R-squared = 0.0067 Residual 3.1281e+12 11202 279245396 R-squared = 0.0068 Model 2.1435e+10 1 2.1435e+10 Prob > F = 0.0000 F( 1, 11202) = 76.76 Source SS df MS Number of obs = 11204
. reg earnings training
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 72 / 155
![Page 278: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/278.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 279: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/279.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 280: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/280.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 281: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/281.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 282: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/282.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 283: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/283.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 284: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/284.jpg)
Is the LATE useful?
Once we allow for heterogeneous effects, all we can estimate with IVis the effect of treatment among compliers.
This is an unknown subset of the data.
I Treated units are a mix of always takers and compliers.I Control units are a mix of never takers and compliers.
Without further assumptions, τLATE 6= τATE .
Complier group depends on the instrument different IVs will leadto different estimands.
How much we care largely depends on our theory and what theinstrument is.
The traditional framework “cheats” by assuming that the effect isconstant, so it is the same for compliers and non-compliers.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 73 / 155
![Page 285: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/285.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 286: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/286.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 287: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/287.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 288: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/288.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 289: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/289.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 290: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/290.jpg)
Randomized trials with one-sided noncompliance
Will the LATE ever be equal to a usual causal quantity?
When non-compliance is one-sided, then the LATE is equal to theATT.
Think of a randomized experiment:
I Randomized treatment assignment = instrument (Zi )I Non-randomized actual treatment taken = treatment (Di )
One-sided noncompliance: only those assigned to treatment (control)can actually take the treatment (control). Or
Di (0) = 0∀i Pr[Di = 1|Zi = 0] = 0
Maybe this is because only those treated actually get pills or onlythey are invited to the job training location.
Note: this can be very difficult to do practically in many settings.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 74 / 155
![Page 291: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/291.jpg)
Benefits of one-sided noncomplianceOne-sided noncompliance no “always-takers” and since there are nodefiers,
Treated units must be compliers.
ATT is the same as the LATE.
Proof.E [Yi |Zi = 1]− E [Yi |Zi = 0] =E[Yi (0) + (Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)|Zi = 0]
(exclusion restriction + one-sided noncompliance)
=E[Yi (0)|Zi = 1] + E [(Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)|Zi = 0]
=E[Yi (0)] + E[(Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)]
(randomization)
=E[Yi (1)− Yi (0)|Di = 1,Zi = 1] Pr[Di = 1|Zi = 1]
(law of iterated expectations + binary treatment)
=E[Yi (1)− Yi (0)|Di = 1] Pr[Di = 1|Zi = 1]
(one-sided noncompliance)Noting that Pr[Di = 1|Zi = 0] = 0, then the Wald estimator is just the ATT:E [Yi |Zi=1]−E [Yi |Zi=0]
Pr[Di=1|Zi=1]= E [Yi (1)− Yi (0)|Di = 1] Thus, under the additional assumption of
one-sided compliance, we can estimate the ATT using the usual IV approach
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 75 / 155
![Page 292: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/292.jpg)
Benefits of one-sided noncomplianceOne-sided noncompliance no “always-takers” and since there are nodefiers,
Treated units must be compliers.
ATT is the same as the LATE.
Proof.E [Yi |Zi = 1]− E [Yi |Zi = 0] =E[Yi (0) + (Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)|Zi = 0]
(exclusion restriction + one-sided noncompliance)
=E[Yi (0)|Zi = 1] + E [(Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)|Zi = 0]
=E[Yi (0)] + E[(Yi (1)− Yi (0))Di |Zi = 1]− E[Yi (0)]
(randomization)
=E[Yi (1)− Yi (0)|Di = 1,Zi = 1] Pr[Di = 1|Zi = 1]
(law of iterated expectations + binary treatment)
=E[Yi (1)− Yi (0)|Di = 1] Pr[Di = 1|Zi = 1]
(one-sided noncompliance)Noting that Pr[Di = 1|Zi = 0] = 0, then the Wald estimator is just the ATT:E [Yi |Zi=1]−E [Yi |Zi=0]
Pr[Di=1|Zi=1]= E [Yi (1)− Yi (0)|Di = 1] Thus, under the additional assumption of
one-sided compliance, we can estimate the ATT using the usual IV approach
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 75 / 155
![Page 293: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/293.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 294: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/294.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 295: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/295.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 296: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/296.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 297: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/297.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 298: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/298.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 299: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/299.jpg)
Example: The Vietnam Draft Lottery (Angrist (1990))
Effect of military service on civilian earnings
Simple comparison between Vietnam veterans and non-veterans arelikely to be a biased measure
Angrist (1990) used draft-eligibility, determined by the Vietnam eradraft lottery, as an instrument for military service in Vietnam
Draft eligibility is random and affected the probability of enrollment
Estimate suggest a 15% negative effect of veteran status on earningsin the period 1981-1984 for white veterans born in 1950-51; althoughthe estimators are quite imprecise
This is only identified for compliers (i.e. those who if draft eligiblewould serve but otherwise would not)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 76 / 155
![Page 300: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/300.jpg)
Wald Estimates for Vietnam Draft Lottery (Angrist (1990))
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 77 / 155
![Page 301: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/301.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 302: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/302.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 303: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/303.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 304: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/304.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 305: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/305.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only.
For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 306: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/306.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 307: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/307.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 308: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/308.jpg)
Estimating the Size of the Complier Group
Since we never observe both potential treatment assignments for the sameunit, we cannot identify individual units as compliers
However, we can easily identify the proportion of compliers in the populationusing the first stage effect:
P(D1 > D0) = E [D1 − D0] = E [D1]− E [D0]
= E [D|Z = 1]− E [D|Z = 0]
Using a similar logic we can identify the proportion of compliers among thetreated or controls only. For example:
P(D1 > D0|D = 1) =P(Z = 1)(E [D|Z = 1]− E [D|Z = 0])
P(D = 1)
Note: this estimate is pinned down entirely by the assumptions ofmonotonicity and exogeneity
Abadie (2003) shows how to use covariate information to calculate othercharacteristics of the complier group (kappa weighting)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 78 / 155
![Page 309: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/309.jpg)
Size of Complier Group
~ ...... n V> ....
o ....
... - B" - .... ;::'11 ..... .... ::r::r ~.
.g(D(D~V o'Q;'l'I u ::+ 0 ~ II ;2-. 0 ~ ~
§ ~ 8...= II
~ f. -:::!
TABLE 4.4.2 Probabilities of compliance in instrumental variables studies
Compliance Probabilities Endogenous First Stage,
Source (1)
Variable (D) (2)
Instrument (z) (3)
Sample (4)
P[o= IJ (5)
P[ol > 00J (6)
Plz= lJ (7)
PIDI > DOlo = lJ (8)
PIDI >oOID=O] (9)
Angrist (1990) Veteran status Draft eligibility White men born in .267 .159 .534 .318 .101 1950 Non-white men born in .163 .060 .534 .197 .033 1950
Angrist and Evans More than two Twins at second Married women aged .381 .603 .008 .013 .966 (1998) children birth 21-35 with two or
more children in 1980 First two children .381 .060 .506 .080 .048 are same sex
Angrist and High school grad· Third- or fourth- Men born between .770 .016 .509 .011 .034 Krueger (1991) uate quarter birth 1930 and 1939 Acemoglu and High school grad· State requires 11 White men aged 40-49 .617 .037 .300 .018 .068 Angrisr (2000) uate or more years of
school attendance
Notes: The table computes the absolute and relative size of the complier population for a number of instrumental variables. The first stage, reported in column 6, gives the absolute size of the complier group. Columns 8 and 9 show the size of the complier population relative to the treated and untreated populations.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 79 / 155
![Page 310: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/310.jpg)
Falsification tests
Z D
U
Y
exclusion restriction
The exclusion restriction cannot be tested directly, but it can befalsified.
Falsification test Test the reduced form effect of Zi on Yi in situationswhere it is impossible or extremely unlikely that Zi could affect Di .
Because Zi can’t affect Di , then the exclusion restriction implies thatthis falsification test should have 0 effect.
Nunn & Wantchekon (2011): use distance to coast as an instrumentfor Africans, use distance to the coast in an Asian sample asfalsification test.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 80 / 155
![Page 311: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/311.jpg)
Falsification tests
Z D
U
Y
exclusion restriction
The exclusion restriction cannot be tested directly, but it can befalsified.
Falsification test Test the reduced form effect of Zi on Yi in situationswhere it is impossible or extremely unlikely that Zi could affect Di .
Because Zi can’t affect Di , then the exclusion restriction implies thatthis falsification test should have 0 effect.
Nunn & Wantchekon (2011): use distance to coast as an instrumentfor Africans, use distance to the coast in an Asian sample asfalsification test.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 80 / 155
![Page 312: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/312.jpg)
Falsification tests
Z D
U
Y
exclusion restriction
The exclusion restriction cannot be tested directly, but it can befalsified.
Falsification test Test the reduced form effect of Zi on Yi in situationswhere it is impossible or extremely unlikely that Zi could affect Di .
Because Zi can’t affect Di , then the exclusion restriction implies thatthis falsification test should have 0 effect.
Nunn & Wantchekon (2011): use distance to coast as an instrumentfor Africans, use distance to the coast in an Asian sample asfalsification test.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 80 / 155
![Page 313: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/313.jpg)
Falsification tests
Z D
U
Y
exclusion restriction
The exclusion restriction cannot be tested directly, but it can befalsified.
Falsification test Test the reduced form effect of Zi on Yi in situationswhere it is impossible or extremely unlikely that Zi could affect Di .
Because Zi can’t affect Di , then the exclusion restriction implies thatthis falsification test should have 0 effect.
Nunn & Wantchekon (2011): use distance to coast as an instrumentfor Africans, use distance to the coast in an Asian sample asfalsification test.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 80 / 155
![Page 314: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/314.jpg)
Nunn & Wantchekon falsification test
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 81 / 155
![Page 315: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/315.jpg)
Other Extensions to IV
Multiple instruments
Covariates and conditional ignorability
Overidentification tests (in constant effects)
Compliance modeling for weak instruments (see Fun With WeakInstruments)
Conditional effects and causal interaction models
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 82 / 155
![Page 316: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/316.jpg)
Other Extensions to IV
Multiple instruments
Covariates and conditional ignorability
Overidentification tests (in constant effects)
Compliance modeling for weak instruments (see Fun With WeakInstruments)
Conditional effects and causal interaction models
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 82 / 155
![Page 317: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/317.jpg)
Other Extensions to IV
Multiple instruments
Covariates and conditional ignorability
Overidentification tests (in constant effects)
Compliance modeling for weak instruments (see Fun With WeakInstruments)
Conditional effects and causal interaction models
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 82 / 155
![Page 318: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/318.jpg)
Other Extensions to IV
Multiple instruments
Covariates and conditional ignorability
Overidentification tests (in constant effects)
Compliance modeling for weak instruments (see Fun With WeakInstruments)
Conditional effects and causal interaction models
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 82 / 155
![Page 319: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/319.jpg)
Other Extensions to IV
Multiple instruments
Covariates and conditional ignorability
Overidentification tests (in constant effects)
Compliance modeling for weak instruments (see Fun With WeakInstruments)
Conditional effects and causal interaction models
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 82 / 155
![Page 320: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/320.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 321: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/321.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 322: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/322.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 323: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/323.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 324: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/324.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.
(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 325: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/325.jpg)
Classical Vs. Modern Instrumental Variables
We dropped the constant effects assumption, which is usuallyunrealistic.
We added a weaker monotonicity assumption.
We defined a set of subpopulations: compilers, always-takers,never-takers, defiers
We clarify that the effects are identified only for a particularsubpopulation — the “complier” subpopulation.(if constant effects happen to hold, effects for compliers are bydefinition same as for entire population.)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 83 / 155
![Page 326: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/326.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 327: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/327.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 328: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/328.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 329: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/329.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask
1 is the instrument weak?(does Z predict D)
2 is the instrument exogenous?(does Cov[u1,Z ] = 0])
3 does the exclusion restriction hold?(is there a path from Z to Y not through D)
4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 330: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/330.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)
2 is the instrument exogenous?(does Cov[u1,Z ] = 0])
3 does the exclusion restriction hold?(is there a path from Z to Y not through D)
4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 331: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/331.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])
3 does the exclusion restriction hold?(is there a path from Z to Y not through D)
4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 332: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/332.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)
4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 333: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/333.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 334: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/334.jpg)
Concluding Thoughts on Instrumental Variables
Strong assumptions but powerful results
Enormous care is required in the interpretation
Questions to Always Ask1 is the instrument weak?
(does Z predict D)2 is the instrument exogenous?
(does Cov[u1,Z ] = 0])3 does the exclusion restriction hold?
(is there a path from Z to Y not through D)4 do we believe monotonicity?5 do the assumptions identify an effect for the subpopulation of interest?
Be sure to evaluate all conditions and remember randomization of Zdoes not guarantee the exclusion restriction.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 84 / 155
![Page 335: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/335.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 85 / 155
![Page 336: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/336.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 85 / 155
![Page 337: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/337.jpg)
Regression Discontinuity
A different strategy where the core intuition is that identificationcomes in a discontinuity in treatment assignment
A widely applicable strategy in rule-based systems or allocations oflimited resources (e.g. administrative programs, elections, admissionsystems)
It is a fairly old idea, generally credited to education research byThistlethwaite and Campbell 1960 but with a dynamic and interestingrecent history (Hahn et al 2001 and Lee 2008 were big jumpsforward).
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 86 / 155
![Page 338: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/338.jpg)
Regression Discontinuity
A different strategy where the core intuition is that identificationcomes in a discontinuity in treatment assignment
A widely applicable strategy in rule-based systems or allocations oflimited resources (e.g. administrative programs, elections, admissionsystems)
It is a fairly old idea, generally credited to education research byThistlethwaite and Campbell 1960 but with a dynamic and interestingrecent history (Hahn et al 2001 and Lee 2008 were big jumpsforward).
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 86 / 155
![Page 339: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/339.jpg)
Regression Discontinuity
A different strategy where the core intuition is that identificationcomes in a discontinuity in treatment assignment
A widely applicable strategy in rule-based systems or allocations oflimited resources (e.g. administrative programs, elections, admissionsystems)
It is a fairly old idea, generally credited to education research byThistlethwaite and Campbell 1960 but with a dynamic and interestingrecent history (Hahn et al 2001 and Lee 2008 were big jumpsforward).
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 86 / 155
![Page 340: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/340.jpg)
Setup
The basic idea behind RDDs:
I Xi is a forcing variable.I Treatment assignment is determined by a cutoff in Xi .
Di = 1{Xi > c} so Di =
{Di = 1 if Xi > cDi = 0 if Xi < c
Xi can be related to the potential outcomes and so comparing treatedand untreated units does not provide causal estimates
assume relationship between X and the potential outcomes Y1 andY0 is smooth around the threshold discontinuity created by thetreatment to estimate the effect of D on Y at the threshold
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 87 / 155
![Page 341: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/341.jpg)
Setup
The basic idea behind RDDs:I Xi is a forcing variable.
I Treatment assignment is determined by a cutoff in Xi .
Di = 1{Xi > c} so Di =
{Di = 1 if Xi > cDi = 0 if Xi < c
Xi can be related to the potential outcomes and so comparing treatedand untreated units does not provide causal estimates
assume relationship between X and the potential outcomes Y1 andY0 is smooth around the threshold discontinuity created by thetreatment to estimate the effect of D on Y at the threshold
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 87 / 155
![Page 342: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/342.jpg)
Setup
The basic idea behind RDDs:I Xi is a forcing variable.I Treatment assignment is determined by a cutoff in Xi .
Di = 1{Xi > c} so Di =
{Di = 1 if Xi > cDi = 0 if Xi < c
Xi can be related to the potential outcomes and so comparing treatedand untreated units does not provide causal estimates
assume relationship between X and the potential outcomes Y1 andY0 is smooth around the threshold discontinuity created by thetreatment to estimate the effect of D on Y at the threshold
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 87 / 155
![Page 343: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/343.jpg)
Setup
The basic idea behind RDDs:I Xi is a forcing variable.I Treatment assignment is determined by a cutoff in Xi .
Di = 1{Xi > c} so Di =
{Di = 1 if Xi > cDi = 0 if Xi < c
Xi can be related to the potential outcomes and so comparing treatedand untreated units does not provide causal estimates
assume relationship between X and the potential outcomes Y1 andY0 is smooth around the threshold discontinuity created by thetreatment to estimate the effect of D on Y at the threshold
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 87 / 155
![Page 344: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/344.jpg)
Setup
The basic idea behind RDDs:I Xi is a forcing variable.I Treatment assignment is determined by a cutoff in Xi .
Di = 1{Xi > c} so Di =
{Di = 1 if Xi > cDi = 0 if Xi < c
Xi can be related to the potential outcomes and so comparing treatedand untreated units does not provide causal estimates
assume relationship between X and the potential outcomes Y1 andY0 is smooth around the threshold discontinuity created by thetreatment to estimate the effect of D on Y at the threshold
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 87 / 155
![Page 345: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/345.jpg)
Graphical Illustration
1600 1800 2000 2200 2400
0.0
0.2
0.4
0.6
0.8
1.0
X_i
D_i X_i = c
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 88 / 155
![Page 346: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/346.jpg)
Graphical Illustration
1700 1800 1900 2000 2100 2200 2300
1900
020
000
2100
022
000
2300
024
000
X_i
Y_i
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
●
●
●
●
X_i = c
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 88 / 155
![Page 347: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/347.jpg)
Graphical Illustration
1700 1800 1900 2000 2100 2200 2300
1900
020
000
2100
022
000
2300
0
X_i
Y_i
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
X_i = c
LATE = E[Y_1−Y_0|X=c]
E[Y_1|X,D=1]E[Y_0|X,D=1]E[Y_1|X,D=0]E[Y_0|X,D=0]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 88 / 155
![Page 348: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/348.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 349: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/349.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 350: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/350.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 351: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/351.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 352: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/352.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 353: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/353.jpg)
Design
Sharp RD: treatment assignment is a deterministic function of theforcing variable and the threshold.
Key assumption: no compliance problems (deterministic)
At the threshold, c , we only see treated units and below the thresholdc − ε, we only see control values:
P(Di = 1|Xi = c) = 1
P(Di = 1|Xi = c − ε) = 0
Intuitively, we are interested in the discontinuity in the outcome atthe discontinuity in the treatment assignment.
We want to investigate the behavior of the outcome around thethreshold: limx↓c E [Yi |Xi = x ]− limx↑c E [Yi |Xi = x ]
Under certain assumptions, this quantity identifies the ATE at thethreshold: τSRD = E [Yi (1)− Yi (0)|Xi = c]
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 89 / 155
![Page 354: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/354.jpg)
Identification
Identification Assumption
1 Y1,Y0⊥⊥D|X (trivially met)
2 0 < P(D = 1|X = x) < 1 (always violated in Sharp RDD)
3 E [Y1|X ,D] and E [Y0|X ,D] are continuous in X around the threshold X = c(individuals have imprecise control over X around the threshold)
Identification ResultThe treatment effect is identified at the threshold as:
αSRDD = E [Y1 − Y0|X = c]
= E [Y1|X = c]− E [Y0|X = c]
= limx↓c
E [Y1|X = x ]− limx↑c
E [Y0|X = x ]
Without further assumptions αSRDD is only identified at the threshold.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 90 / 155
![Page 355: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/355.jpg)
Extrapolation and smoothness
Remember the quantity of interest here is the effect at the threshold:
τSRD = E [Yi (1)− Yi (0)|Xi = c]
= E [Yi (1)|Xi = c]− E [Yi (0)|Xi = c]
But we don’t observe E [Yi (0)|Xi = c] ever due to the design, sowe’re going to extrapolate from E [Yi (0)|Xi = c − ε].
Extrapolation, even at short distances, requires smoothness in thefunctions we are extrapolating.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 91 / 155
![Page 356: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/356.jpg)
Extrapolation and smoothness
Remember the quantity of interest here is the effect at the threshold:
τSRD = E [Yi (1)− Yi (0)|Xi = c]
= E [Yi (1)|Xi = c]− E [Yi (0)|Xi = c]
But we don’t observe E [Yi (0)|Xi = c] ever due to the design, sowe’re going to extrapolate from E [Yi (0)|Xi = c − ε].
Extrapolation, even at short distances, requires smoothness in thefunctions we are extrapolating.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 91 / 155
![Page 357: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/357.jpg)
Extrapolation and smoothness
Remember the quantity of interest here is the effect at the threshold:
τSRD = E [Yi (1)− Yi (0)|Xi = c]
= E [Yi (1)|Xi = c]− E [Yi (0)|Xi = c]
But we don’t observe E [Yi (0)|Xi = c] ever due to the design, sowe’re going to extrapolate from E [Yi (0)|Xi = c − ε].
Extrapolation, even at short distances, requires smoothness in thefunctions we are extrapolating.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 91 / 155
![Page 358: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/358.jpg)
What can go wrong?
If the potential outcomes change at the discontinuity for reasonsother than the treatment, then smoothness will be violated.
For instance, if people sort around threshold, then you might getjumps other than the one you care about.
If things other than the treatment change at the threshold, then thatmight cause discontinuities in the potential outcomes.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 92 / 155
![Page 359: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/359.jpg)
What can go wrong?
If the potential outcomes change at the discontinuity for reasonsother than the treatment, then smoothness will be violated.
For instance, if people sort around threshold, then you might getjumps other than the one you care about.
If things other than the treatment change at the threshold, then thatmight cause discontinuities in the potential outcomes.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 92 / 155
![Page 360: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/360.jpg)
What can go wrong?
If the potential outcomes change at the discontinuity for reasonsother than the treatment, then smoothness will be violated.
For instance, if people sort around threshold, then you might getjumps other than the one you care about.
If things other than the treatment change at the threshold, then thatmight cause discontinuities in the potential outcomes.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 92 / 155
![Page 361: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/361.jpg)
What can go wrong?
If the potential outcomes change at the discontinuity for reasonsother than the treatment, then smoothness will be violated.
For instance, if people sort around threshold, then you might getjumps other than the one you care about.
If things other than the treatment change at the threshold, then thatmight cause discontinuities in the potential outcomes.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 92 / 155
![Page 362: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/362.jpg)
Example: Electronic Voting (Hidalgo 2012)
Electorate (1996)
1998
Bla
nk a
nd In
valid
Vot
es (%
of T
otal
Vot
es)
10
20
30
40
50
60
70
20000 40000 60000
Figure 6: The effect of electronic voting on the percent of null and blank votes. Each dot is a polling station. Pollingstations to the left of the vertical black line used paper ballots and polling stations to the right used electronic voting.The black horizontal line is the conditional mean of the outcome estimated with a loess regression.
the discontinuity, except among municipalities with less than a 1996 electorate of about 10,000. The stability of the
conditional expectation over such a large range of the data suggests that the treatment effect at Ej = 40500 may apply
to municipalities far from the threshold.
Formal treatment effect estimates on null and blank votes—separately and together—are reported in the left panel
of figure 7. Focusing on the local linear regression estimates, the effect of the shift in voting technology lowered null
vote rates by an estimated 13.5 percentage points, blank votes by an estimated 10 percentage points, thus increasing
the number of votes affecting political outcomes by about 23 percentage points. This number amounts to about a 34%
increase in the size of the electorate casting valid votes. While null votes were somewhat more affected than blank
votes, the similarity between the two estimates is surprising. A blank vote, in the Brazilian system, is supposed to be
an affirmative choice intended by the voter. A null vote, on the other hand, is a residual category (an “undervote”,
to use the American parlance) for when the voter fails to register any preference at all. Thus, one might expect that
electronic voting would affect null votes much more than blank votes, but these estimates belie that expectation. These
estimates suggest that a large percent of blank votes were actually mistakenly cast or counted.
For comparison, treatment effect estimates on invalid votes for all other offices are reported in the right panel of
figure 7. Electronic voting lowers invalid vote rates for all other offices, though estimates are smaller in magnitude.
22
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 93 / 155
![Page 363: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/363.jpg)
Other Recent RDD Examples
class size on student achievementI Angrist and Lavy 1999
wage increase on performance of mayorsFerraz and Finan 2011; Gagliarducci and Nannicini 2013
colonial institutions on development outcomesDell 2009
length of postpartum hospital stays on mother and infant mortalityAlmond and Doyle 2009
naturalization on political integration of immigrantsHainmueller and Hangartner 2015
financial aid offers on college enrollmentVan der Klaauw 2002
access to Angel funding on growth of start-upsKerr, Lerner and Schoar 2010
RDD that exploits “close” elections is workhorse model for electoral research:Lee, Moretti and Butler 2004, DiNardo and Lee 2004, Hainmueller and Kern 2008, Leigh 2008,Pettersson-Lidbom 2008, Broockman 2009, Butler 2009, Dal Bo, Dal Bo and Snyder 2009, Eggers andHainmueller 2009, Ferreira and Gyourko 2009, Uppal 2009, 2010, Cellini, Ferreira and Rothstein 2010, Gerberand Hopkins 2011, Trounstine 2011, Boas and Hidalgo 2011, Folke and Snyder Jr. 2012, and Gagliarducci andPaserman 2012
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 94 / 155
![Page 364: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/364.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 365: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/365.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 366: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/366.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 367: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/367.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 368: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/368.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 369: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/369.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 370: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/370.jpg)
General estimation strategy
The main goal in RD is to estimate the limits of various CEFs such as:
limx↑c
E [Yi |Xi = x ]
It turns out that this is a hard problem because we want to estimatethe regression at a single point and that point is a boundary point.
As a result, the usual kinds of nonparametric estimators performpoorly (polynomials and kernels are particularly bad)
In general, we are going to have to choose some way of estimatingthe regression functions around the cutpoint.
Using the entire sample on either side will obviously lead to biasbecause those values that are far from the cutpoint are clearlydifferent than those nearer to the cutpoint.
→ restrict our estimation to units close to the threshold.
Local linear regression is a good way to go: see rdrobust package inR (Calonico et al 2015)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 95 / 155
![Page 371: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/371.jpg)
Misconceptions
Continuity of the potential outcomes does not imply localrandomization
This has caused a lot of confusion in the literature particularly intesting with background covariates
Local statistical independence does not imply exclusion restriction(i.e. forcing variable not directly affecting the outcome)
If you are doing an RDD: be sure to do balance checks and sensitivitychecks (read-up on best practices first!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 96 / 155
![Page 372: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/372.jpg)
Misconceptions
Continuity of the potential outcomes does not imply localrandomization
This has caused a lot of confusion in the literature particularly intesting with background covariates
Local statistical independence does not imply exclusion restriction(i.e. forcing variable not directly affecting the outcome)
If you are doing an RDD: be sure to do balance checks and sensitivitychecks (read-up on best practices first!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 96 / 155
![Page 373: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/373.jpg)
Misconceptions
Continuity of the potential outcomes does not imply localrandomization
This has caused a lot of confusion in the literature particularly intesting with background covariates
Local statistical independence does not imply exclusion restriction(i.e. forcing variable not directly affecting the outcome)
If you are doing an RDD: be sure to do balance checks and sensitivitychecks (read-up on best practices first!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 96 / 155
![Page 374: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/374.jpg)
Misconceptions
Continuity of the potential outcomes does not imply localrandomization
This has caused a lot of confusion in the literature particularly intesting with background covariates
Local statistical independence does not imply exclusion restriction(i.e. forcing variable not directly affecting the outcome)
If you are doing an RDD: be sure to do balance checks and sensitivitychecks (read-up on best practices first!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 96 / 155
![Page 375: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/375.jpg)
Misconceptions
Continuity of the potential outcomes does not imply localrandomization
This has caused a lot of confusion in the literature particularly intesting with background covariates
Local statistical independence does not imply exclusion restriction(i.e. forcing variable not directly affecting the outcome)
If you are doing an RDD: be sure to do balance checks and sensitivitychecks (read-up on best practices first!)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 96 / 155
![Page 376: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/376.jpg)
Local Randomization vs. Continuity (Sekhon and Titiunik2016)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 97 / 155
![Page 377: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/377.jpg)
Fuzzy RD
With fuzzy RD, the treatment assignment is no longer a deterministicfunction of the forcing variable, but there is still a discontinuity in theprobability of treatment at the threshold:
Assumption FRD
limx↓c
Pr[Di = 1|Xi = x ] 6= limx↑c
Pr[Di = 1|Xi = x ]
In the sharp RD, this is also true, but it further required the jump inprobability to be from 0 to 1.
Fuzzy RD is often useful when the a threshold encouragesparticipation in program, but does not actually force units toparticipate.
Sound familiar? Fuzzy RD is just IV!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 98 / 155
![Page 378: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/378.jpg)
Fuzzy RD
With fuzzy RD, the treatment assignment is no longer a deterministicfunction of the forcing variable, but there is still a discontinuity in theprobability of treatment at the threshold:
Assumption FRD
limx↓c
Pr[Di = 1|Xi = x ] 6= limx↑c
Pr[Di = 1|Xi = x ]
In the sharp RD, this is also true, but it further required the jump inprobability to be from 0 to 1.
Fuzzy RD is often useful when the a threshold encouragesparticipation in program, but does not actually force units toparticipate.
Sound familiar? Fuzzy RD is just IV!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 98 / 155
![Page 379: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/379.jpg)
Fuzzy RD
With fuzzy RD, the treatment assignment is no longer a deterministicfunction of the forcing variable, but there is still a discontinuity in theprobability of treatment at the threshold:
Assumption FRD
limx↓c
Pr[Di = 1|Xi = x ] 6= limx↑c
Pr[Di = 1|Xi = x ]
In the sharp RD, this is also true, but it further required the jump inprobability to be from 0 to 1.
Fuzzy RD is often useful when the a threshold encouragesparticipation in program, but does not actually force units toparticipate.
Sound familiar? Fuzzy RD is just IV!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 98 / 155
![Page 380: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/380.jpg)
Fuzzy RD
With fuzzy RD, the treatment assignment is no longer a deterministicfunction of the forcing variable, but there is still a discontinuity in theprobability of treatment at the threshold:
Assumption FRD
limx↓c
Pr[Di = 1|Xi = x ] 6= limx↑c
Pr[Di = 1|Xi = x ]
In the sharp RD, this is also true, but it further required the jump inprobability to be from 0 to 1.
Fuzzy RD is often useful when the a threshold encouragesparticipation in program, but does not actually force units toparticipate.
Sound familiar? Fuzzy RD is just IV!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 98 / 155
![Page 381: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/381.jpg)
Fuzzy RD is IV
Forcing variable is an instrument: affects Yi , but only through Di (atthe threshold)
Let Di (x) be the potential value of treatment when we set the forcingvariable to x , for some small neighborhood around c.
Di (x) = 1 if unit i would take treatment when Xi was x
Di (x) = 0 if unit i would take control when Xi was x
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 99 / 155
![Page 382: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/382.jpg)
Fuzzy RD is IV
Forcing variable is an instrument: affects Yi , but only through Di (atthe threshold)
Let Di (x) be the potential value of treatment when we set the forcingvariable to x , for some small neighborhood around c.
Di (x) = 1 if unit i would take treatment when Xi was x
Di (x) = 0 if unit i would take control when Xi was x
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 99 / 155
![Page 383: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/383.jpg)
Fuzzy RD is IV
Forcing variable is an instrument: affects Yi , but only through Di (atthe threshold)
Let Di (x) be the potential value of treatment when we set the forcingvariable to x , for some small neighborhood around c.
Di (x) = 1 if unit i would take treatment when Xi was x
Di (x) = 0 if unit i would take control when Xi was x
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 99 / 155
![Page 384: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/384.jpg)
Fuzzy RD is IV
Forcing variable is an instrument: affects Yi , but only through Di (atthe threshold)
Let Di (x) be the potential value of treatment when we set the forcingvariable to x , for some small neighborhood around c.
Di (x) = 1 if unit i would take treatment when Xi was x
Di (x) = 0 if unit i would take control when Xi was x
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 99 / 155
![Page 385: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/385.jpg)
Fuzzy RD assumptions
Assumption 2: Monotoncity
There exists ε such that Di (c + e) ≥ Di (c − e) for all 0 < e < ε
No one is discouraged from taking the treatment by crossing the threshold.
Assumption 3: Local Exogeneity of Forcing Variable
In a neighborhood of c,{τi ,Di (x)}⊥⊥Xi
Basically, in an ε-ball around c , the forcing variable is randomly assigned.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 100 / 155
![Page 386: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/386.jpg)
Fuzzy RD assumptions
Assumption 2: Monotoncity
There exists ε such that Di (c + e) ≥ Di (c − e) for all 0 < e < ε
No one is discouraged from taking the treatment by crossing the threshold.
Assumption 3: Local Exogeneity of Forcing Variable
In a neighborhood of c,{τi ,Di (x)}⊥⊥Xi
Basically, in an ε-ball around c , the forcing variable is randomly assigned.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 100 / 155
![Page 387: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/387.jpg)
Fuzzy RD assumptions
Assumption 2: Monotoncity
There exists ε such that Di (c + e) ≥ Di (c − e) for all 0 < e < ε
No one is discouraged from taking the treatment by crossing the threshold.
Assumption 3: Local Exogeneity of Forcing Variable
In a neighborhood of c,{τi ,Di (x)}⊥⊥Xi
Basically, in an ε-ball around c , the forcing variable is randomly assigned.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 100 / 155
![Page 388: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/388.jpg)
Fuzzy RD assumptions
Assumption 2: Monotoncity
There exists ε such that Di (c + e) ≥ Di (c − e) for all 0 < e < ε
No one is discouraged from taking the treatment by crossing the threshold.
Assumption 3: Local Exogeneity of Forcing Variable
In a neighborhood of c,{τi ,Di (x)}⊥⊥Xi
Basically, in an ε-ball around c , the forcing variable is randomly assigned.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 100 / 155
![Page 389: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/389.jpg)
Example: Early Release Program (HDC)
Prison system in many countries is faced with overcrowding and highrecidivism rates after release.
Early discharge of prisoners on electronic monitoring has become apopular policy
Difficult to estimate impact of early release program on futurecriminal behavior: best behaved inmates are usually the ones to bereleased early
Marie (2008) considers Home Detention Curfew (HDC) scheme inEngland and Wales:
Fuzzy RDD: Only offenders sentenced to more than three months (88days) in prison are eligible for HDC, but not all those with longersentences are offered HDC
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 101 / 155
![Page 390: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/390.jpg)
Example: Early Release Program (HDC)
Prison system in many countries is faced with overcrowding and highrecidivism rates after release.
Early discharge of prisoners on electronic monitoring has become apopular policy
Difficult to estimate impact of early release program on futurecriminal behavior: best behaved inmates are usually the ones to bereleased early
Marie (2008) considers Home Detention Curfew (HDC) scheme inEngland and Wales:
Fuzzy RDD: Only offenders sentenced to more than three months (88days) in prison are eligible for HDC, but not all those with longersentences are offered HDC
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 101 / 155
![Page 391: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/391.jpg)
Example: Early Release Program (HDC)
Prison system in many countries is faced with overcrowding and highrecidivism rates after release.
Early discharge of prisoners on electronic monitoring has become apopular policy
Difficult to estimate impact of early release program on futurecriminal behavior: best behaved inmates are usually the ones to bereleased early
Marie (2008) considers Home Detention Curfew (HDC) scheme inEngland and Wales:
Fuzzy RDD: Only offenders sentenced to more than three months (88days) in prison are eligible for HDC, but not all those with longersentences are offered HDC
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 101 / 155
![Page 392: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/392.jpg)
Example: Early Release Program (HDC)
Prison system in many countries is faced with overcrowding and highrecidivism rates after release.
Early discharge of prisoners on electronic monitoring has become apopular policy
Difficult to estimate impact of early release program on futurecriminal behavior: best behaved inmates are usually the ones to bereleased early
Marie (2008) considers Home Detention Curfew (HDC) scheme inEngland and Wales:
Fuzzy RDD: Only offenders sentenced to more than three months (88days) in prison are eligible for HDC, but not all those with longersentences are offered HDC
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 101 / 155
![Page 393: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/393.jpg)
Example: Early Release Program (HDC)
Prison system in many countries is faced with overcrowding and highrecidivism rates after release.
Early discharge of prisoners on electronic monitoring has become apopular policy
Difficult to estimate impact of early release program on futurecriminal behavior: best behaved inmates are usually the ones to bereleased early
Marie (2008) considers Home Detention Curfew (HDC) scheme inEngland and Wales:
Fuzzy RDD: Only offenders sentenced to more than three months (88days) in prison are eligible for HDC, but not all those with longersentences are offered HDC
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 101 / 155
![Page 394: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/394.jpg)
Example: Early Release Program (HDC)
11
Table 2: Descriptive Statistics for Prisoners Released by Length of Sentence and HDC and Non HDC Discharges
and +/-7 Days Around Discontinuity Threshold
Panel A - Released +/- 7 Days of 3 Months (88 Days) Cut-off: Discharge Type Non HDC HDC Total Percentage Female 10.5 9.7 10.3 Mean Age at Release 28.9 30.7 29.3 Percentage Incarcerated for Violence 19.8 18.2 19.4 Mean Number Previous Offences 9.5 5.7 8.7 Recidivism within 12 Months 54.6 28.1 48.8 Sample Size 18,928 5,351 24,279 Panel B - Released +/- 7 Days of 3 Months (88 Days) Cu-off: Day of Release around Cut-off - 7 Days + 7 Days Total Percentage Female 11 10.2 10.3 Mean Age at Release 28.8 29.4 29.3 Percentage Incarcerated for Violence 17.1 19.7 19.4 Mean Number Previous Offences 9.1 8.6 8.7 Recidivism within 12 Months 56.8 47.9 48.8 Percentage Released on HDC 0 24.4 22 Sample Size 2,333 21,946 24,279
As we are interested in what occurs near the 88 days cut-off for eligibility, Table
2 shows descriptive characteristics for prisoners discharged a week before or a week after
this duration. Again we note in Panel A that difference in number of previous offences
and recidivism are very large between HDC and non HDC discharges. However we see
in Panel B this difference is much smaller for those characteristics but there is a 24.4
difference in the proportion treated with HDC a week before and after the threshold. This
is reassuring as it gives a first indication that on either side of the cut-off individuals have
relatively similar observable characteristics, one of the assumptions of the RDD
methodology. Although the sample size pre-threshold is much smaller than post-
threshold, it is still much larger than what is used in most research implementing RDD
thanks to the very large size of the data used.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 102 / 155
![Page 395: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/395.jpg)
Example: Early Release Program (HDC)
12
As discussed above, we need to illustrate the discontinuity of HDC treatment
graphically and also continuity of covariates which could influence the recidivism
outcome. Figure 1 begins this by plotting the proportion of prisoners discharged on HDC
with respect to the length of their sentence**. After the 88 time limit the jump of 24.4
percent jump afore mentioned in proportion treated is clearly visible and highly
significant.
Figure 1: Proportion Discharged on HDC by Sentence Length
Discontinuity in ProportionDischarged on HDC,Cut-off Point at 88 DaysDifference = .244 (.003)
0.0
5.1
.15
.2.2
5.3
0 30 60 88 120 160 180
Pro
porti
on D
isch
arge
d on
HD
C
Sentence Length (Days)
**All the graphs are local polynomials with a 7 day bandwidths to be comparable to our chosen window around the threshold for RDD estimations.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 102 / 155
![Page 396: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/396.jpg)
Example: Early Release Program (HDC)
13
Figure 2: Mean Number of Previous Offence by Sentence Length
810
12
0 30 60 90 120 150 180
Mea
n N
umbe
r of P
revi
ous
Offe
nces
Sentence Length (Days)
Figure 3: Mean Age at Discharge by Sentence Length
2728
2930
31
0 30 60 90 120 150 180
Mea
n A
ge w
hen
Dis
char
ged
Sentence Length (Days)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 102 / 155
![Page 397: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/397.jpg)
Example: Early Release Program (HDC)
14
Figure 2 shows the mean number of previous offences by sentence length.
Although the criminal history of prisoners is very different across the discharge period,
the graph is very smooth around the HDC release threshold. This reinforces the validity
of carrying out an RDD estimation of HDC as the number of previous offences could be
strong selection criteria for scheme participation but is continuous around our assignment
variable.
Figure 3 considers the mean age when released on sentence length. Again the
graph is very continuous and the very small gap of the lines around the cut-off is not
statistically significant. This again, as with Figure 2, points to a relatively random
distribution of observable characteristics around the threshold which further validates the
use of RDD.
Figure 4: Recidivism within 1 Year by Sentence Length
Apparent DiscontinuityIn Proportion RecidivismAt 88 Days Cut-off PointDifference = -.089 (.011)
.45
.5.5
5.6
0 30 60 90 120 150 180
Pro
porti
on R
ecid
ivis
m w
ithin
1 Y
ear
Sentence Length (Days)
Finally, Figure 4 plots the rate of recidivism within 12 months of release by
length of sentence. This graphical representation of the changes of our outcome variable
of interests exhibits a striking jump around the 88 day threshold. This gap corresponds to
a significant 8.9 percentage point lower re-offending rate of prisoners discharged one
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 102 / 155
![Page 398: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/398.jpg)
Example: Early Release Program (HDC)
18
Table 4: RDD Estimates of HDC Impact on Recidivism – Around Threshold
Dependent Variable = Recidivism Within 12 Months
Estimation on Individuals Discharged
+/- 7 Days of 88 Days Threshold
(1) (2) (3)
Estimated Discontinuity of HDC Participation at Threshold ( HDC+– HDC- )
.243 (.009)
.223 (.009)
.243 (.003)
Estimated Difference in Recidivism Around Threshold ( Rec+– Rec- )
-.089 (.011)
-.059 (.009)
-.044 (.014)
Estimated Effect of HDC on Recidivism Participation (Rec+– Rec- )/ (HDC+– HDC- )
-.366 (.044)
-.268 (.044)
-.181 (n.a.)
Controls No Yes No
PSM No No Yes
Sample Size 24,279 24,279 24,279 Note: Robust standard errors in parenthesis. The estimation is based on individuals released between 89 and 180 days. The controls included in column (2) are: gender, age, number previous offences, month and year of release dummies, and the type of crime incarcerated for (8 types). The propensity score matching in column (3) is based on calculating propensity scores for each individual using the same variables as the controls in the previous model.
Since controlling for observable characteristics does affect our estimate, we can go
further and implement mix both PSM and RDD methodologies to obtain even more
robust policy estimators. This is what we do in column (3) of Table 4. The main change
now is that the difference in recidivism rates between prisoners discharged pre and post
cut-off is significantly smaller at -4.4 percent. Consequently we can calculate that HDC
participation reduces recidivism by about 18 percent‡‡. This is very close to our preferred
estimated impact from the OLS with PSM above and we therefore conclude that being
released early on electronic monitoring from prison appears to reduce recidivism
probability by between 18 and 19 percentage points.
‡‡ This is to our knowledge the first time that PSM and RDD have been combined to estimate a causal effect and there is therefore no simple methodology to obtain standard errors for this estimate. The reason is that we are not able here to run a local IV as before to generate the standard error. We however believe that the .181 coefficient is significant in view of the .044 standard errors in columns (1) and (2) and are working on a way to compute it precisely in the near future.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 102 / 155
![Page 399: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/399.jpg)
Example: Teamwork
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●●
●
●
●
●
●●
●
●
●
●
●
●
●●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
● ●
●
●●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●●
●
● ●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
● ●
●●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●●
●●
●●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●●
●
●
●
●
●
●●
●● ●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
●
●●
●
●
●
●
●
●
●●
●
●●
●
●
●
●
●
●
●
●
●●
●
●
●
−0.4
0.0
0.4
0.8
−0.2 −0.1 0.0Year 1 Accuracy (Centered Decision Score)
Year
2 A
ccur
acy
(Mea
n S
td. S
core
)
●
●
Qualified, Declined InvitationSuperforecaster (accepted invitation)
Treatment
●
●
Did Not Qualify for Super−Team InvitationQualified/Received Super−Team Invitation
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 103 / 155
![Page 400: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/400.jpg)
Regression Discontinuity Conclusions
Key idea is to exploit an arbitrary assignment rule to identify a causalquantity.
Remember that we are only identifying an effect at the boundary.
There are many other nuances to estimation and choosing anappropriate bandwidth for the comparison- be sure to read morebefore trying this at home.
There is an interesting literature on geographic regressiondiscontinuity designs as well. These are harder but can be useful!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 104 / 155
![Page 401: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/401.jpg)
Regression Discontinuity Conclusions
Key idea is to exploit an arbitrary assignment rule to identify a causalquantity.
Remember that we are only identifying an effect at the boundary.
There are many other nuances to estimation and choosing anappropriate bandwidth for the comparison- be sure to read morebefore trying this at home.
There is an interesting literature on geographic regressiondiscontinuity designs as well. These are harder but can be useful!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 104 / 155
![Page 402: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/402.jpg)
Regression Discontinuity Conclusions
Key idea is to exploit an arbitrary assignment rule to identify a causalquantity.
Remember that we are only identifying an effect at the boundary.
There are many other nuances to estimation and choosing anappropriate bandwidth for the comparison- be sure to read morebefore trying this at home.
There is an interesting literature on geographic regressiondiscontinuity designs as well. These are harder but can be useful!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 104 / 155
![Page 403: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/403.jpg)
Regression Discontinuity Conclusions
Key idea is to exploit an arbitrary assignment rule to identify a causalquantity.
Remember that we are only identifying an effect at the boundary.
There are many other nuances to estimation and choosing anappropriate bandwidth for the comparison- be sure to read morebefore trying this at home.
There is an interesting literature on geographic regressiondiscontinuity designs as well. These are harder but can be useful!
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 104 / 155
![Page 404: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/404.jpg)
Conclusion
This week we covered approaches to unmeasured confounding
The trick is to exploit some other feature (No Free Lunch!)
Now that you have seen a few examples, hopefully you can be on thelookout for your own research.
We talked about natural experiments, instrumental variables andregression discontinuity
Next week we will talk about more designs for unmeasuredconfounding.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 105 / 155
![Page 405: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/405.jpg)
Conclusion
This week we covered approaches to unmeasured confounding
The trick is to exploit some other feature (No Free Lunch!)
Now that you have seen a few examples, hopefully you can be on thelookout for your own research.
We talked about natural experiments, instrumental variables andregression discontinuity
Next week we will talk about more designs for unmeasuredconfounding.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 105 / 155
![Page 406: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/406.jpg)
Conclusion
This week we covered approaches to unmeasured confounding
The trick is to exploit some other feature (No Free Lunch!)
Now that you have seen a few examples, hopefully you can be on thelookout for your own research.
We talked about natural experiments, instrumental variables andregression discontinuity
Next week we will talk about more designs for unmeasuredconfounding.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 105 / 155
![Page 407: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/407.jpg)
Conclusion
This week we covered approaches to unmeasured confounding
The trick is to exploit some other feature (No Free Lunch!)
Now that you have seen a few examples, hopefully you can be on thelookout for your own research.
We talked about natural experiments, instrumental variables andregression discontinuity
Next week we will talk about more designs for unmeasuredconfounding.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 105 / 155
![Page 408: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/408.jpg)
Conclusion
This week we covered approaches to unmeasured confounding
The trick is to exploit some other feature (No Free Lunch!)
Now that you have seen a few examples, hopefully you can be on thelookout for your own research.
We talked about natural experiments, instrumental variables andregression discontinuity
Next week we will talk about more designs for unmeasuredconfounding.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 105 / 155
![Page 409: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/409.jpg)
Next Week
Causality with Repeated Data
ReadingI Angrist and Pishke Chapter 5 Parallel Worlds: Fixed Effects,
Differences-in-Differences and Panel DataI Optional: Imai and Kim “When Should We Use Linear Fixed Effects
Regression Models for Causal Inference with Longitudinal Data”I Optional: Angrist and Pishke Chapter 6 Regression Discontinuity
DesignsI Optional: Morgan and Winship Chapter 11 Repeated Observations and
the Estimation of Causal Effects
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 106 / 155
![Page 410: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/410.jpg)
References
Abadie, Alberto. ”Semiparametric instrumental variable estimation of treatmentresponse models.” Journal of econometrics 113, no. 2 (2003): 231-263.
Angrist, Joshua D., and Jrn-Steffen Pischke. Mostly harmless econometrics: Anempiricist’s companion. Princeton university press, 2008.
Morgan, Stephen L., and Christopher Winship. Counterfactuals and causalinference. Cambridge University Press, 2014.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 107 / 155
![Page 411: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/411.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 108 / 155
![Page 412: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/412.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 108 / 155
![Page 413: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/413.jpg)
Fun with Extremists
Hall, Andrew. “What Happens When Extremists WinPrimaries?” 2015. American Political Science Review.
I’m grateful to Andy Hall for sharing the following slides with me.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 109 / 155
![Page 414: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/414.jpg)
Fun with Extremists
Hall, Andrew. “What Happens When Extremists WinPrimaries?” 2015. American Political Science Review.
I’m grateful to Andy Hall for sharing the following slides with me.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 109 / 155
![Page 415: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/415.jpg)
What are the Effects of Extremists Winning Primaries?
“...getting a general-election candidate who canwin is the only thing we care about.”
—Nat’l Republican Senatorial Committee
vs.
“The road to hell is paved with electablecandidates.” —Conservative Blogger
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 110 / 155
![Page 416: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/416.jpg)
What are the Effects of Extremists Winning Primaries?
“...getting a general-election candidate who canwin is the only thing we care about.”
—Nat’l Republican Senatorial Committee
vs.
“The road to hell is paved with electablecandidates.” —Conservative Blogger
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 110 / 155
![Page 417: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/417.jpg)
There is a tradeoff between ideology and electability:
Evaluates how the preferences of primary voters mapto legislature.
Shows how general elections react to moderates vs.extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 111 / 155
![Page 418: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/418.jpg)
There is a tradeoff between ideology and electability:
Evaluates how the preferences of primary voters mapto legislature.
Shows how general elections react to moderates vs.extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 111 / 155
![Page 419: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/419.jpg)
There is a tradeoff between ideology and electability:
Evaluates how the preferences of primary voters mapto legislature.
Shows how general elections react to moderates vs.extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 111 / 155
![Page 420: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/420.jpg)
Findings: Elections Strongly Prefer Moderates
In the U.S. House, 1980–2010:
Extremist causes 38 percentage-point decrease in winprobability on average.
On average, roll-call voting farther away from primaryvoters when they nominate extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 112 / 155
![Page 421: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/421.jpg)
Findings: Elections Strongly Prefer Moderates
In the U.S. House, 1980–2010:
Extremist causes 38 percentage-point decrease in winprobability on average.
On average, roll-call voting farther away from primaryvoters when they nominate extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 112 / 155
![Page 422: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/422.jpg)
Findings: Elections Strongly Prefer Moderates
In the U.S. House, 1980–2010:
Extremist causes 38 percentage-point decrease in winprobability on average.
On average, roll-call voting farther away from primaryvoters when they nominate extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 112 / 155
![Page 423: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/423.jpg)
Findings: Elections Strongly Prefer Moderates
In the U.S. House, 1980–2010:
Extremist causes 38 percentage-point decrease in winprobability on average.
On average, roll-call voting farther away from primaryvoters when they nominate extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 112 / 155
![Page 424: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/424.jpg)
Elections Select Moderate Extremists
Primary voters cannot force in extremists.
House elections choose moderates, but constrained bycandidate pool.
Argument of broader research project: candidate entrykey to electing extremist legislators.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 113 / 155
![Page 425: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/425.jpg)
Elections Select Moderate Extremists
Primary voters cannot force in extremists.
House elections choose moderates, but constrained bycandidate pool.
Argument of broader research project: candidate entrykey to electing extremist legislators.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 113 / 155
![Page 426: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/426.jpg)
Elections Select Moderate Extremists
Primary voters cannot force in extremists.
House elections choose moderates, but constrained bycandidate pool.
Argument of broader research project: candidate entrykey to electing extremist legislators.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 113 / 155
![Page 427: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/427.jpg)
Elections Select Moderate Extremists
Primary voters cannot force in extremists.
House elections choose moderates, but constrained bycandidate pool.
Argument of broader research project: candidate entrykey to electing extremist legislators.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 113 / 155
![Page 428: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/428.jpg)
Empirical Approach
Quantity of interest: effect of extremist nominees
Ideal experiment: randomly assign districts extremistor moderate nominees.
Compare elections and roll-call voting in “treated”districts vs. “control” districts.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 114 / 155
![Page 429: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/429.jpg)
Empirical Approach
Quantity of interest: effect of extremist nominees
Ideal experiment: randomly assign districts extremistor moderate nominees.
Compare elections and roll-call voting in “treated”districts vs. “control” districts.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 114 / 155
![Page 430: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/430.jpg)
Empirical Approach
Quantity of interest: effect of extremist nominees
Ideal experiment: randomly assign districts extremistor moderate nominees.
Compare elections and roll-call voting in “treated”districts vs. “control” districts.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 114 / 155
![Page 431: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/431.jpg)
Empirical Approach
Quantity of interest: effect of extremist nominees
Ideal experiment: randomly assign districts extremistor moderate nominees.
Compare elections and roll-call voting in “treated”districts vs. “control” districts.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 114 / 155
![Page 432: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/432.jpg)
Obstacle to Estimating Effects of Extremist Nominees
Selection Bias.
Districts choose extremist nominees because theyprefer them.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 115 / 155
![Page 433: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/433.jpg)
Obstacle to Estimating Effects of Extremist Nominees
Selection Bias.
Districts choose extremist nominees because theyprefer them.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 115 / 155
![Page 434: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/434.jpg)
Obstacle to Estimating Effects of Extremist Nominees
Selection Bias.
Districts choose extremist nominees because theyprefer them.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 115 / 155
![Page 435: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/435.jpg)
Close Primaries Offer Variation in Nominee Type
Regression discontinuity design (RDD) in primaryelections.
Districts with moderate/extremist nominee otherwiseidentical in expectation.
Key assumption for RDD: no sorting
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 116 / 155
![Page 436: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/436.jpg)
Close Primaries Offer Variation in Nominee Type
Regression discontinuity design (RDD) in primaryelections.
Districts with moderate/extremist nominee otherwiseidentical in expectation.
Key assumption for RDD: no sorting
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 116 / 155
![Page 437: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/437.jpg)
Close Primaries Offer Variation in Nominee Type
Regression discontinuity design (RDD) in primaryelections.
Districts with moderate/extremist nominee otherwiseidentical in expectation.
Key assumption for RDD: no sorting
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 116 / 155
![Page 438: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/438.jpg)
Close Primaries Offer Variation in Nominee Type
Regression discontinuity design (RDD) in primaryelections.
Districts with moderate/extremist nominee otherwiseidentical in expectation.
Key assumption for RDD: no sorting
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 116 / 155
![Page 439: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/439.jpg)
“Extremists” Defined
M
Dem Primary Rep Primary
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 117 / 155
![Page 440: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/440.jpg)
“Extremists” Defined
M
Dem Primary Rep Primary
“Moderate”“Extremist”
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 118 / 155
![Page 441: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/441.jpg)
“Extremists” Defined
M
Dem Primary Rep Primary
“Moderate” “Extremist”
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 119 / 155
![Page 442: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/442.jpg)
“Extremists” Defined
M
Dem Primary Rep Primary
Moderate? Extremist?
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 120 / 155
![Page 443: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/443.jpg)
“Extremists” Defined
M
“Moderate”“Extremist”
Calculate distance between moderate and extremist.
Use races where distance is at or above the median distance.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 121 / 155
![Page 444: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/444.jpg)
“Extremists” Defined
M
“Moderate”“Extremist”
Calculate distance between moderate and extremist.
Use races where distance is at or above the median distance.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 121 / 155
![Page 445: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/445.jpg)
“Extremists” Defined
M
“Moderate”“Extremist”
Calculate distance between moderate and extremist.
Use races where distance is at or above the median distance.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 121 / 155
![Page 446: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/446.jpg)
Quick Example: Robbie Wills vs. Joyce Elliott
vs.
Joyce Elliott: -0.33 Robbie Wills: -0.07
Wills sent out mailer calling Elliott an “extremist” who was“unelectable.”
Elliott won close runoff primary and lost general election 62% to38%.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 122 / 155
![Page 447: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/447.jpg)
Quick Example: Robbie Wills vs. Joyce Elliott
vs.
Joyce Elliott: -0.33 Robbie Wills: -0.07
Extre
mist
Moder
ate
Wills sent out mailer calling Elliott an “extremist” who was“unelectable.”
Elliott won close runoff primary and lost general election 62% to38%.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 123 / 155
![Page 448: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/448.jpg)
Quick Example: Robbie Wills vs. Joyce Elliott
vs.
Joyce Elliott: -0.33 Robbie Wills: -0.07
Extre
mist
Moder
ate
Wills sent out mailer calling Elliott an “extremist” who was“unelectable.”
Elliott won close runoff primary and lost general election 62% to38%.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 123 / 155
![Page 449: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/449.jpg)
Quick Example: Robbie Wills vs. Joyce Elliott
vs.
Joyce Elliott: -0.33 Robbie Wills: -0.07
Extre
mist
Moder
ate
Wills sent out mailer calling Elliott an “extremist” who was“unelectable.”
Elliott won close runoff primary and lost general election 62% to38%.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 123 / 155
![Page 450: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/450.jpg)
Estimating the RD: Effects of Extremist Nominations
Yit = β0 + β1Extremist Primary Winit + f (Vit) + εit
Vit ≡ extremist candidate’s vote-share winning margin.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 124 / 155
![Page 451: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/451.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
N=233
![Page 452: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/452.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
ModerateNominees
![Page 453: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/453.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
ExtremistNominees
![Page 454: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/454.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
N=233
![Page 455: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/455.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●●
●
●
●
●●
●
●●
●
●
●
● ●
● ●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
ExtremistsWho Lose General
ModeratesWho Lose General
![Page 456: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/456.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
N=233
![Page 457: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/457.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●●
●
● ●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
N=233
![Page 458: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/458.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
Extreme Candidate Primary Election Winning Margin
Gen
eral
Ele
ctio
n V
ote
Sha
re
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●●
●
● ●
●
●
●
●
●
●
●
●
●
0.4
0.6
0.8
−0.2 −0.1 0 0.1 0.2
N=233
![Page 459: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/459.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●●
●
●
●
●
●
●
![Page 460: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/460.jpg)
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●●
●
●
●
●
●
●
Vote−sharedecrease:
−0.09
![Page 461: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/461.jpg)
Large Electoral Penalty to Nominating Extremist
●
●●
●
●●
−1
−0.5
0
5% BandwidthLocal Linear
N=84
All DataCubicN=253
IK Bandwidth=9.69%Local Kernel
N=149
95% Confidence Intervals From Max of Robust and Conventional Standard Errors
E
ffect
on
Pro
b of
Vic
tory
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 126 / 155
![Page 462: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/462.jpg)
Large Electoral Penalty to Nominating Extremist
●
●●
●
●●
−1
−0.5
0
5% BandwidthLocal Linear
N=84
All DataCubicN=253
IK Bandwidth=9.69%Local Kernel
N=149
95% Confidence Intervals From Max of Robust and Conventional Standard Errors
E
ffect
on
Pro
b of
Vic
tory
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 126 / 155
![Page 463: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/463.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
1 Penalty makes other party more likely to win seat.
2 Extremist offers more extreme roll-call voting.
Knowing general election prefers moderates not sufficientto understand tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 127 / 155
![Page 464: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/464.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
1 Penalty makes other party more likely to win seat.
2 Extremist offers more extreme roll-call voting.
Knowing general election prefers moderates not sufficientto understand tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 127 / 155
![Page 465: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/465.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
1 Penalty makes other party more likely to win seat.
2 Extremist offers more extreme roll-call voting.
Knowing general election prefers moderates not sufficientto understand tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 127 / 155
![Page 466: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/466.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
1 Penalty makes other party more likely to win seat.
2 Extremist offers more extreme roll-call voting.
Knowing general election prefers moderates not sufficientto understand tradeoff.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 127 / 155
![Page 467: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/467.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
Ideology
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 128 / 155
![Page 468: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/468.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
Ideology
Win
Pro
bab
ility
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 129 / 155
![Page 469: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/469.jpg)
How Does Penalty to Extremists Affect Roll-Calls?
Ideology
Win
Pro
bab
ility
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 130 / 155
![Page 470: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/470.jpg)
Effect of Extremists on Roll-Call Voting
●
Effe
ct o
n R
oll−
Cal
l Vot
ing
●
−1.0
−0.5
0.0
0.5
1.0
Terms Downstream
● Democratic PrimariesRepublican Primaries
0 1 2 3 4
MoreConservative
MoreLiberal
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 131 / 155
![Page 471: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/471.jpg)
Effect of Extremists on Roll-Call Voting
●
●
●●
●
Effe
ct o
n R
oll−
Cal
l Vot
ing
●
●●
●
●
−1.0
−0.5
0.0
0.5
1.0
Terms Downstream
● Democratic PrimariesRepublican Primaries
0 1 2 3 4
MoreConservative
MoreLiberal
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 132 / 155
![Page 472: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/472.jpg)
Summary
Primary voters do not make legislature more extremeby forcing in extreme candidates.
The general election is a huge force for moderation.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 133 / 155
![Page 473: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/473.jpg)
Summary
Primary voters do not make legislature more extremeby forcing in extreme candidates.
The general election is a huge force for moderation.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 133 / 155
![Page 474: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/474.jpg)
Summary
Primary voters do not make legislature more extremeby forcing in extreme candidates.
The general election is a huge force for moderation.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 133 / 155
![Page 475: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/475.jpg)
Elections: A Limited Force For Moderation
U.S. House elections select “moderate extremists.”
Argument: Differential entry of extremist candidatesforces voters to elect extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 134 / 155
![Page 476: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/476.jpg)
Elections: A Limited Force For Moderation
U.S. House elections select “moderate extremists.”
Argument: Differential entry of extremist candidatesforces voters to elect extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 134 / 155
![Page 477: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/477.jpg)
Elections: A Limited Force For Moderation
U.S. House elections select “moderate extremists.”
Argument: Differential entry of extremist candidatesforces voters to elect extremists.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 134 / 155
![Page 478: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/478.jpg)
Fun With Related Work
Hall and Snyder. 2013. Candidate Ideology and Electoral Success. WorkingPaper.
Eggers, Andrew, Anthony Fowler, Jens Hainmueller, Andrew B. Hall, and JamesM. Snyder, Jr. On the Validity of the Regression Discontinuity Design forEstimating Electoral Effects: Evidence From Over 40,000 Close Races.American Journal of Political Science, 2015.
Hall, Andrew B. “What Happens When Extremists Win Primaries?” AmericanPolitical Science Review. 2015.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 135 / 155
![Page 479: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/479.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 136 / 155
![Page 480: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/480.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 136 / 155
![Page 481: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/481.jpg)
Fun With Weak Instruments
Ratkovic, Marc, and Yuki Shiraito. Strengthening Weak Instruments byModeling Compliance. Working Paper.(Thanks to Yuki Shiraito for sharing these slides with me)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 137 / 155
![Page 482: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/482.jpg)
Example: Endogeneity of Institution and Growth
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Endogeneity Bias
Confounding biasConfounding bias
YiGDP
DiInstitutions
Yi and Di have direct causaleffects on each other
Ordinary least squares biased
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 138 / 155
![Page 483: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/483.jpg)
Example: Endogeneity of Institution and Growth
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Endogeneity Bias
Confounding biasConfounding bias
YiGDP
DiInstitutions
Yi and Di have direct causaleffects on each other
Ordinary least squares biased
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 138 / 155
![Page 484: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/484.jpg)
Solution of Acemoglu et.al. (2001)
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Instrumental Variable Analysis
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Exploiting exogeneity of Zi
Validity: Settlers chose to buildstronger (non-extractive)institutions in places they wantedto live
Exclusion: But early settlermortality rate does not affectGDP directly
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 139 / 155
![Page 485: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/485.jpg)
Solution of Acemoglu et.al. (2001)
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Instrumental Variable Analysis
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Exploiting exogeneity of Zi
Validity: Settlers chose to buildstronger (non-extractive)institutions in places they wantedto live
Exclusion: But early settlermortality rate does not affectGDP directly
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 139 / 155
![Page 486: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/486.jpg)
Solution of Acemoglu et.al. (2001)
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Instrumental Variable Analysis
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Exploiting exogeneity of Zi
Validity: Settlers chose to buildstronger (non-extractive)institutions in places they wantedto live
Exclusion: But early settlermortality rate does not affectGDP directly
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 139 / 155
![Page 487: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/487.jpg)
Addressing Endogeneity
−2
−1
01
23
4
● ● OLS
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 140 / 155
![Page 488: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/488.jpg)
Addressing Endogeneity
−2
−1
01
23
4
● ●
●
OLS
TSLS
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 141 / 155
![Page 489: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/489.jpg)
Problem: Bootstrapped Confidence Interval
−2
−1
01
23
4
● ●
● ●
OLS
TSLS
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 142 / 155
![Page 490: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/490.jpg)
Problem: Weak Instruments
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Non-Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Non-compliers: For somecountries, early settler mortalityrate did not affect institutions
Weak Instrument: If manynon-compliers in data,
βIV =Cov(Yi ,Di )
Cov(Di ,Zi )︸ ︷︷ ︸≈0
Arbitrarily misleading estimates
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 143 / 155
![Page 491: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/491.jpg)
Problem: Weak Instruments
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Non-Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Non-compliers: For somecountries, early settler mortalityrate did not affect institutions
Weak Instrument: If manynon-compliers in data,
βIV =Cov(Yi ,Di )
Cov(Di ,Zi )︸ ︷︷ ︸≈0
Arbitrarily misleading estimates
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 143 / 155
![Page 492: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/492.jpg)
Problem: Weak Instruments
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Non-Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Non-compliers: For somecountries, early settler mortalityrate did not affect institutions
Weak Instrument: If manynon-compliers in data,
βIV =Cov(Yi ,Di )
Cov(Di ,Zi )︸ ︷︷ ︸≈0
Arbitrarily misleading estimates
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 143 / 155
![Page 493: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/493.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 494: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/494.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 495: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/495.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 496: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/496.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 497: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/497.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 498: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/498.jpg)
Solution: Complier Instrumental Variable Estimation
Matching Returns a Balanced Subset of the Data (Ti⊥⊥Xi )Compliers
Confounding biasConfounding bias
YiGDP
DiInstitutions
ZiSettler
Mortality
Want to focus on observationswhere Zi moves Di , compliers
Can’t observe who are compliers
Estimate latent variable indicatingcompliance
Strengthen the instrumentthrough upweighting compliers
Connect finite mixture modeling ofcompliance with weak instrumentproblem (Hirano et.al. 2000)
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 144 / 155
![Page 499: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/499.jpg)
IV as Simultaneous Equations
Standard model
Di = Z>i δ + X>i θ + ηi (First Stage)
Yi = D>i β + X>i γ + εi (Second Stage)
where, for a simple random sample of i ∈ {1, 2, . . . ,N}
Yi : Outcome
Di : Endogenous
Zi : Instrument
Xi : Covariates
εi , ηi : Normal errors
Cov(εi , ηi ) 6= 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 145 / 155
![Page 500: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/500.jpg)
IV as Simultaneous Equations
Standard model
Di = Z>i δ + X>i θ + ηi (First Stage)
Yi = D>i β + X>i γ + εi (Second Stage)
where, for a simple random sample of i ∈ {1, 2, . . . ,N}
Yi : Outcome
Di : Endogenous
Zi : Instrument
Xi : Covariates
εi , ηi : Normal errors
Cov(εi , ηi ) 6= 0
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 145 / 155
![Page 501: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/501.jpg)
CIV as Simultaneous EquationsCIV model
Pr(Ci = 1) = Φ(W>
i α)
(Compliance Model)
Di =
{δC0 + Z>i δ + X>i θ + ηi ; Ci = 1
δNC0 + X>i θ + ηi ; Ci = 0
(First Stage)
Yi = D>i β + X>i γ + εi (Second Stage)
where, for a simple random sample of i ∈ {1, 2, . . . ,N}Ci : Indicator for complier (unobserved)
Wi : Covariates for compliance
Φ: Normal CDF
εi , ηi : Normal errors
Maximization not straightforward
Gibbs sampler
ECM algorithm in paper
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 146 / 155
![Page 502: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/502.jpg)
CIV as Simultaneous EquationsCIV model
Pr(Ci = 1) = Φ(W>
i α)
(Compliance Model)
Di =
{δC0 + Z>i δ + X>i θ + ηi ; Ci = 1
δNC0 + X>i θ + ηi ; Ci = 0
(First Stage)
Yi = D>i β + X>i γ + εi (Second Stage)
where, for a simple random sample of i ∈ {1, 2, . . . ,N}Ci : Indicator for complier (unobserved)
Wi : Covariates for compliance
Φ: Normal CDF
εi , ηi : Normal errors
Maximization not straightforward
Gibbs sampler
ECM algorithm in paper
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 146 / 155
![Page 503: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/503.jpg)
CIV as Simultaneous EquationsCIV model
Pr(Ci = 1) = Φ(W>
i α)
(Compliance Model)
Di =
{δC0 + Z>i δ + X>i θ + ηi ; Ci = 1
δNC0 + X>i θ + ηi ; Ci = 0
(First Stage)
Yi = D>i β + X>i γ + εi (Second Stage)
where, for a simple random sample of i ∈ {1, 2, . . . ,N}Ci : Indicator for complier (unobserved)
Wi : Covariates for compliance
Φ: Normal CDF
εi , ηi : Normal errors
Maximization not straightforward
Gibbs sampler
ECM algorithm in paper
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 146 / 155
![Page 504: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/504.jpg)
Revisiting Acemoglu, Johnson, and Robinson (2001)
Causal effect of property rights on economic growth
Outcome: 1995 GDP, logged per capita
Endogenous variable: Risk of property expropriation
Instrument: Mortality rate of European colonizers
Covariates: Latitude (absolute value); former French colony (0/1) orBritish colony (0/1); proportion citizens who are Catholic, Muslim,and neither; whether the country has a French legal origin (0/1)
N=64
CIV for
Strengthening a weak instrument
Characterizing compliers
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 147 / 155
![Page 505: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/505.jpg)
Revisiting Acemoglu, Johnson, and Robinson (2001)
Causal effect of property rights on economic growth
Outcome: 1995 GDP, logged per capita
Endogenous variable: Risk of property expropriation
Instrument: Mortality rate of European colonizers
Covariates: Latitude (absolute value); former French colony (0/1) orBritish colony (0/1); proportion citizens who are Catholic, Muslim,and neither; whether the country has a French legal origin (0/1)
N=64
CIV for
Strengthening a weak instrument
Characterizing compliers
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 147 / 155
![Page 506: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/506.jpg)
Revisiting Acemoglu, Johnson, and Robinson (2001)
Causal effect of property rights on economic growth
Outcome: 1995 GDP, logged per capita
Endogenous variable: Risk of property expropriation
Instrument: Mortality rate of European colonizers
Covariates: Latitude (absolute value); former French colony (0/1) orBritish colony (0/1); proportion citizens who are Catholic, Muslim,and neither; whether the country has a French legal origin (0/1)
N=64
CIV for
Strengthening a weak instrument
Characterizing compliers
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 147 / 155
![Page 507: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/507.jpg)
Causal Estimates
−2
−1
01
23
4
● ●
● ●
OLS
TSLS
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 148 / 155
![Page 508: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/508.jpg)
Causal Estimates
−2
−1
01
23
4
● ●
● ●
●●
OLS
TSLSCIV
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 149 / 155
![Page 509: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/509.jpg)
Causal Estimates
−2
−1
01
23
4
● ●
● ●
●●
● ●
● ●
OLS
TSLSCIV
RANK
JACK
Est
imat
ed C
ausa
l Effe
ct
95% Confidence/Credible IntervalBootstrapped 95% Confidence Interval
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 150 / 155
![Page 510: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/510.jpg)
Compliance, by Colonizer
●
●
●●
●
●
●
●
●●
British French Other
0.2
0.4
0.6
0.8
1.0
Com
plia
nce
Pro
babi
lity,
Pos
terio
r M
ean
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 151 / 155
![Page 511: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/511.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers2 Upweights the compliers
→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 512: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/512.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problem
I Weak instruments1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers2 Upweights the compliers
→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 513: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/513.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers2 Upweights the compliers
→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 514: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/514.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers2 Upweights the compliers
→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 515: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/515.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation
1 Estimates latent compliance status→ Characterize who are the compliers
2 Upweights the compliers→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 516: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/516.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers
2 Upweights the compliers→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 517: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/517.jpg)
Fun With Conclusion
They propose CIV as a solution to the weak instrument problemI Weak instruments
1 Many non-compliers in data2 Arbitrarily misleading estimates
I Complier Instrumental Variable estimation1 Estimates latent compliance status
→ Characterize who are the compliers2 Upweights the compliers
→ Strengthens the instrument
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 152 / 155
![Page 518: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/518.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 153 / 155
![Page 519: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/519.jpg)
1 Approaches to Unmeasured Confounding
2 Natural Experiments
3 Traditional Instrumental Variables
4 Fun with Coarsening Bias
5 Modern Approaches to Instrumental Variables
6 Regression Discontinuity
7 Fun with Extremists
8 Fun With Weak Instruments
9 Appendix
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 153 / 155
![Page 520: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/520.jpg)
Proof of the LATE theorem
Under the exclusion restriction and randomization,
E [Yi |Zi = 1] = E [Yi (0) + (Yi (1)− Yi (0))Di |Zi = 1]
= E [Yi (0) + (Yi (1)− Yi (0))Di (1)] (randomization)
The same applies to when Zi = 0, so we have
E [Yi |Zi = 0] = E [Yi (0) + (Yi (1)− Yi (0))Di (0)]
Thus, E [Yi |Zi = 1]− E [Yi |Zi = 0] =
E [(Yi (1)− Yi (0))(Di (1)− Di (0))]
=E [(Yi (1)− Yi (0))(1)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
+E [(Yi (1)− Yi (0))(−1)|Di (1) < Di (0)] Pr[Di (1) < Di (0)]
=E [Yi (1)− Yi (0)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
The third equality comes from monotonicity: with this assumption,Di (1) < Di (0) never occurs.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 154 / 155
![Page 521: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/521.jpg)
Proof of the LATE theorem
Under the exclusion restriction and randomization,
E [Yi |Zi = 1] = E [Yi (0) + (Yi (1)− Yi (0))Di |Zi = 1]
= E [Yi (0) + (Yi (1)− Yi (0))Di (1)] (randomization)
The same applies to when Zi = 0, so we have
E [Yi |Zi = 0] = E [Yi (0) + (Yi (1)− Yi (0))Di (0)]
Thus, E [Yi |Zi = 1]− E [Yi |Zi = 0] =
E [(Yi (1)− Yi (0))(Di (1)− Di (0))]
=E [(Yi (1)− Yi (0))(1)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
+E [(Yi (1)− Yi (0))(−1)|Di (1) < Di (0)] Pr[Di (1) < Di (0)]
=E [Yi (1)− Yi (0)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
The third equality comes from monotonicity: with this assumption,Di (1) < Di (0) never occurs.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 154 / 155
![Page 522: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/522.jpg)
Proof of the LATE theorem
Under the exclusion restriction and randomization,
E [Yi |Zi = 1] = E [Yi (0) + (Yi (1)− Yi (0))Di |Zi = 1]
= E [Yi (0) + (Yi (1)− Yi (0))Di (1)] (randomization)
The same applies to when Zi = 0, so we have
E [Yi |Zi = 0] = E [Yi (0) + (Yi (1)− Yi (0))Di (0)]
Thus, E [Yi |Zi = 1]− E [Yi |Zi = 0] =
E [(Yi (1)− Yi (0))(Di (1)− Di (0))]
=E [(Yi (1)− Yi (0))(1)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
+E [(Yi (1)− Yi (0))(−1)|Di (1) < Di (0)] Pr[Di (1) < Di (0)]
=E [Yi (1)− Yi (0)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
The third equality comes from monotonicity: with this assumption,Di (1) < Di (0) never occurs.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 154 / 155
![Page 523: Week 11: Causality with Unmeasured ConfoundingWeek 11: Causality with Unmeasured Confounding Brandon Stewart1 Princeton December 5 and 7, 2016 1These slides are heavily in uenced by](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0e1d617e708231d43daf01/html5/thumbnails/523.jpg)
Proof (continued)
E [Yi |Zi = 1]− E [Yi |Zi = 0] = E [Yi (1)− Yi (0)|Di (1) > Di (0)] Pr[Di (1) > Di (0)]
We can use the same argument for the denominator:
E [Di |Zi = 1]− E [Di |Zi = 0] = E [Di (1)− Di (0)]
= Pr[Di (1) > Di (0)]
Dividing these two expressions through gives the LATE.
Stewart (Princeton) Week 11: Unmeasured Confounding December 5 and 7, 2016 155 / 155