Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
How to Make Causal Inferences with Time-Series ...
Search
Matthew Blackwell
April 13, 2013
Science
2
200
How to Make Causal Inferences with Time-Series Cross-Sectional Data
Matthew Blackwell
April 13, 2013
Tweet
Share
Other Decks in Science
See All in Science
マウス肝炎ウイルス感染の遺伝子発現へのテンソル分解の適用によるSARS-CoV-2感染関連重要ヒト遺伝子と有効な薬剤の同定
tagtag
0
120
MoveItを使った産業用ロボット向け動作作成方法の紹介 / Introduction to creating motion for industrial robots using MoveIt
ry0_ka
0
500
Healthcare Innovation through Business Entrepreneurship
clintwinters
0
230
Ignite の1年間の軌跡
ktombow
0
130
Machine Learning for Materials (Challenge)
aronwalsh
0
300
モンテカルロDCF法による事業価値の算出(モンテカルロ法とベイズモデリング) / Business Valuation Using Monte Carlo DCF Method (Monte Carlo Simulation and Bayesian Modeling)
ikuma_w
0
170
Explanatory material
yuki1986
0
310
Online Feedback Optimization
floriandoerfler
0
2.2k
局所保存性・相似変換対称性を満たす機械学習モデルによる数値流体力学
yellowshippo
1
280
安心・効率的な医療現場の実現へ ~オンプレAI & ノーコードワークフローで進める業務改革~
siyoo
0
250
ウェブ・ソーシャルメディア論文読み会 第25回: Differences in misinformation sharing can lead to politically asymmetric sanctions (Nature, 2024)
hkefka385
0
110
ガウス過程回帰とベイズ最適化
nearme_tech
PRO
1
440
Featured
See All Featured
Measuring & Analyzing Core Web Vitals
bluesmoon
7
490
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Adopting Sorbet at Scale
ufuk
77
9.4k
Gamification - CAS2011
davidbonilla
81
5.3k
Reflections from 52 weeks, 52 projects
jeffersonlam
351
20k
What's in a price? How to price your products and services
michaelherold
246
12k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Statistics for Hackers
jakevdp
799
220k
Embracing the Ebb and Flow
colly
86
4.7k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
800
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
29
9.5k
Designing for humans not robots
tammielis
253
25k
Transcript
How to Make Causal Inferences with Time-Series Cross-Sectional Data Matthew
Blackwell University of Rochester Adam Glynn Harvard University
How to Make Causal Inferences with Time-Series Cross-Sectional Data
How to Make Causal Inferences with Time-Series Cross-Sectional Data Very
Carefully.
How to Make Causal Inferences with Time-Series Cross-Sectional Data Using
weights.
ۺ˞ ۢ˞ ۹˞ ۢ ۹ ۺ
What is the effect of A on Y? ۺ˞ ۢ˞
۹˞ ۢ ۹ ۺ
What is the effect of A on Y? contemporaneous ۺ˞
ۢ˞ ۹˞ ۢ ۹ ۺ
What is the effect of A on Y? treatment history
ۺ˞ ۢ˞ ۹˞ ۢ ۹ ۺ
Shouldn't we have more notation?
ۢ ۢ Ɛ ۢ Treatment history
Shouldn't we have more notation?
ۢ ۢ Ɛ ۢ Treatment history
Shouldn't we have more notation? Specific instance of a treatment history ۼ ۼ Ɛ ۼ
ۢ ۢ Ɛ ۢ Treatment history
ۺ ۼ Potential outcomes Shouldn't we have more notation? Specific instance of a treatment history ۼ ۼ Ɛ ۼ
The effect of history
The effect of history ণ ۼ ۼƓ
ۦ=ۺ ۼ ˞ ۺ ۼƓ ? Average Treatment History Effect
The effect of history ণ ۼ ۼƓ
ۦ=ۺ ۼ ˞ ۺ ۼƓ ? Average Treatment History Effect ATHE
The effect of history ণ ۼ ۼƓ
ۦ=ۺ ۼ ˞ ۺ ۼƓ ? Average Treatment History Effect 1 1 1 1 1 1 1 ATHE
The effect of history ণ ۼ ۼƓ
ۦ=ۺ ۼ ˞ ۺ ۼƓ ? Average Treatment History Effect 1 1 1 1 1 1 1 0 0 0 0 0 0 0 vs ATHE
The effect of history
The effect of history Blip Effect ণ۽ ۼ ˞
ۦ=ۺ ۼ ˞ ˞ ۺ ۼ ˞ ?
The effect of history 1 0 0 0 0 0
0 0 vs 0 0 0 0 0 0 Blip Effect ণ۽ ۼ ˞ ۦ=ۺ ۼ ˞ ˞ ۺ ۼ ˞ ?
The effect of history 1 0 0 0 0 0
0 0 vs 0 0 0 0 0 0 Blip Effect ণ۽ ۼ ˞ ۦ=ۺ ۼ ˞ ˞ ۺ ۼ ˞ ?
The effect of history 1 0 0 0 0 vs
0 0 0 1 1 1 Blip Effect ণ۽ ۼ ˞ ۦ=ۺ ۼ ˞ ˞ ۺ ۼ ˞ ? 1 1 1
The effect of history 1 0 vs 1 1 1
Blip Effect ণ۽ ۼ ˞ ۦ=ۺ ۼ ˞ ˞ ۺ ۼ ˞ ? 1 1 1 1 1 1 1 1 1
The effect of history
The effect of history Contemporaneous Effect of Treatment ণ
ۦ=ণ۽ ۼ ˞ ?
The effect of history Contemporaneous Effect of Treatment ণ
ۦ=ণ۽ ۼ ˞ ? CET
The effect of history 1 0 vs Contemporaneous Effect of
Treatment ণ ۦ=ণ۽ ۼ ˞ ? CET
The effect of history 1 0 vs Contemporaneous Effect of
Treatment ণ ۦ=ণ۽ ۼ ˞ ? CET Marginalize over the past
TSCS data under sequential ignorability Treatment is unrelated to the
potential outcomes ...conditional on the covariate history. ۺ ۼ е е ۢ ^۹ ۺ ˞ ۢ ܃˞ ۼ ˞
How conditioning leads you astray
How conditioning leads you astray ...for some questions.
How conditioning leads you astray ...for some questions. ۺ
૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
...for some questions. ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
...for some questions. We “fix” these ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
...for some questions. We “fix” these ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
We “fix” these ...for some questions. ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
...for some questions. ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
এ૾ ...for some questions. ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
এ૾ ? ? ? ? ? ? ...for some questions. ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
ۺ˞ ۢ˞ ۢ ۹ ۺ How conditioning leads you astray
এ૾ ? ? ? ? ? ? ...for some questions. CET: (1,0) vs (0,0) ATHE: (0,1) vs (0,0) ATHE: (1,1) vs (0,0) এ૾ ̪ এଁ ̪ এ૾ এଁ ۺ ૿ ۢ ଁ ۹ ଂ ۺ˞ ଃ ۢ˞
How weighting can help
ۺ˞ ۢ˞ ۢ ۹ ۺ How weighting can help
ۺ˞ ۢ˞ ۢ ۹ ۺ How weighting can help ۸܃
ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ?
ۺ˞ ۢ˞ ۢ ۹ ۺ How weighting can help ۸܃
ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ? We weight to create balance
ۺ˞ ۢ˞ ۢ ۹ ۺ How weighting can help We
weight to create balance ۸܃ ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ?
ۺ˞ ۢ˞ ۢ ۹ ۺ How weighting can help ۸܃
ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ? Unconfounded No posttreatment bias
How weighting can help
How weighting can help ۦ=ۺ ۼ ۼ˞ ?
ۦ۸ =ۺ ^ۢ ۼ ۢ˞ ۼ˞ ? ૿ ۼ ଁ ۼ˞
How weighting can help ۦ=ۺ ۼ ۼ˞ ?
ۦ۸ =ۺ ^ۢ ۼ ۢ˞ ۼ˞ ? ૿ ۼ ଁ ۼ˞ WLS
How weighting can help ۦ=ۺ ۼ ۼ˞ ?
ۦ۸ =ۺ ^ۢ ۼ ۢ˞ ۼ˞ ? ૿ ۼ ଁ ۼ˞ WLS CET: (1,0) vs (0,0) ATHE: (0,1) vs (0,0) ATHE: (1,1) vs (0,0) এ૾ ଁ ଁ
The Long Arm of the Democratic Peace?
The Long Arm of the Democratic Peace? Democracy in year
t War in year t
The Long Arm of the Democratic Peace? Democracy in year
t War in year t Democratic Peace Literature
The Long Arm of the Democratic Peace? Democracy in year
t War in year t Democratic Peace Literature History of Democracy
The Long Arm of the Democratic Peace? Democracy in year
t War in year t Democratic Peace Literature History of Democracy Can we estimate this?
%FQFOEFOU WBSJBCMF %JTQVUF #,5 .JTTQFDJĕFE *158 .PEFM $VNVMBUJWF .PEFM .4.
%FNPDSBDZ #MJQ ˞૿ଅˣˣˣ ૿ଅ૿ $VNVMBUJWF %FNPDSBDZ ˞૿૿૿ ˞૿૿ଃˣˣˣ ૿૿ଁ ૿૿ଂ (SPXUI ˞ଂଇଂଆˣˣˣ ˞ଃଂଅ૿ˣˣˣ 0CTFSWBUJPOT ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ /PUF ˣQ ˣˣQ ˣˣˣQ Revisiting Beck, Katz, and Tucker (1998)
%FQFOEFOU WBSJBCMF %JTQVUF #,5 .JTTQFDJĕFE *158 .PEFM $VNVMBUJWF .PEFM .4.
%FNPDSBDZ #MJQ ˞૿ଅˣˣˣ ૿ଅ૿ $VNVMBUJWF %FNPDSBDZ ˞૿૿૿ ˞૿૿ଃˣˣˣ ૿૿ଁ ૿૿ଂ (SPXUI ˞ଂଇଂଆˣˣˣ ˞ଃଂଅ૿ˣˣˣ 0CTFSWBUJPOT ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ /PUF ˣQ ˣˣQ ˣˣˣQ Revisiting Beck, Katz, and Tucker (1998)
Democracy in year t War in year t Economic Growth
in year t History of Democracy Misspecification of an ATHE Time-Varying Confounder
%FQFOEFOU WBSJBCMF %JTQVUF #,5 .JTTQFDJĕFE *158 .PEFM $VNVMBUJWF .PEFM .4.
%FNPDSBDZ #MJQ ˞૿ଅˣˣˣ ૿ଅ૿ $VNVMBUJWF %FNPDSBDZ ˞૿૿૿ ˞૿૿ଃˣˣˣ ૿૿ଁ ૿૿ଂ (SPXUI ˞ଂଇଂଆˣˣˣ ˞ଃଂଅ૿ˣˣˣ 0CTFSWBUJPOT ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ ଁ૿ ଃଃଇ /PUF ˣQ ˣˣQ ˣˣˣQ Revisiting Beck, Katz, and Tucker (1998)
TSCS data under unmeasured confounding
TSCS data under unmeasured confounding ۺ܃ ۼ е е
ۢ܃ ^۹ ܃ ۢ ܃˞ ۼ ˞ ۶
TSCS data under unmeasured confounding Treatment is unrelated to the
potential outcomes ۺ܃ ۼ е е ۢ܃ ^۹ ܃ ۢ ܃˞ ۼ ˞ ۶
TSCS data under unmeasured confounding Treatment is unrelated to the
potential outcomes ...conditional on the covariate history ۺ܃ ۼ е е ۢ܃ ^۹ ܃ ۢ ܃˞ ۼ ˞ ۶
TSCS data under unmeasured confounding Treatment is unrelated to the
potential outcomes ...conditional on the covariate history ۺ܃ ۼ е е ۢ܃ ^۹ ܃ ۢ ܃˞ ۼ ˞ ۶ ...and a time-fixed unmeasured confounder.
How unit-specific weighting can help
How unit-specific weighting can help ۺ˞ ۢ˞ ۢ ۹ ۺ
۶
How unit-specific weighting can help ۺ˞ ۢ˞ ۢ ۹ ۺ
۶ ۸܃ ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ۶?
How unit-specific weighting can help ۺ˞ ۢ˞ ۢ ۹ ۺ
۶ ۸܃ ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ۶? Weighting balances the treatment groups.
ۺ˞ ۢ˞ ۢ ۹ ۺ How unit-specific weighting can help
۶ ۸܃ ಿ ܍ 2T=ۢ܃܍ ^ۢ˞ ۹ ۺ˞ ۶?
A weighting approach to fixed effects
A weighting approach to fixed effects 1 Estimate unit-specific probability
of treatment over time and construct weights.
A weighting approach to fixed effects 1 Estimate unit-specific probability
of treatment over time and construct weights. 2 Estimate a pooled outcome model with unit-specific weights
k-order sequential ignorability
k-order sequential ignorability ۺ܃ ۼ е е ۢ܃ ^۹
܃̂˞܅ ۢ ܃˞̂˞܅ ۼ ˞̂˞܅ ۶
k-order sequential ignorability Only the last k periods matter. ۺ܃
ۼ е е ۢ܃ ^۹ ܃̂˞܅ ۢ ܃˞̂˞܅ ۼ ˞̂˞܅ ۶
Blip effect: (1,0) vs (0,0) Time periods Blip effect 10
25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7
Blip effect: (1,0) vs (0,0) Time periods Blip effect 10
25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7
Pooled Blip effect: (1,0) vs (0,0) Time periods Blip effect
10 25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7 • • • • • •
Pooled Outcome fixed effects Blip effect: (1,0) vs (0,0) Time
periods Blip effect 10 25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7 • • • • • •
Pooled Outcome fixed effects Blip effect: (1,0) vs (0,0) IPTW
true weights Time periods Blip effect 10 25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7 • • • • • •
Pooled IPTW fixed effects Outcome fixed effects IPTW true weights
Blip effect: (1,0) vs (0,0) Time periods Blip effect 10 25 50 75 100 125 0.2 0.3 0.4 0.5 0.6 0.7 • • • • • •
Treatment History Effect: (1,1) vs (0,0) Time periods ATHE 10
25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4
Treatment History Effect: (1,1) vs (0,0) Time periods ATHE 10
25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 Time periods ATHE 10 25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4
Pooled Treatment History Effect: (1,1) vs (0,0) Time periods ATHE
10 25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 • • • • • •
Pooled Outcome fixed effects Treatment History Effect: (1,1) vs (0,0)
Time periods ATHE 10 25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 • • • • • •
Pooled Outcome fixed effects IPTW true weights Treatment History Effect:
(1,1) vs (0,0) Time periods ATHE 10 25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 • • • • • •
Pooled IPTW fixed effects Outcome fixed effects IPTW true weights
Treatment History Effect: (1,1) vs (0,0) Time periods ATHE 10 25 50 75 100 125 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 • • • • • •
How to make causal inferences with TSCS data
How to make causal inferences with TSCS data Very carefully
How to make causal inferences with TSCS data Very carefully
Even under strong assumptions, conditional estimators cannot recover ATHEs.
How to make causal inferences with TSCS data Very carefully
Using weights Even under strong assumptions, conditional estimators cannot recover ATHEs.
How to make causal inferences with TSCS data Very carefully
Using weights Even under strong assumptions, conditional estimators cannot recover ATHEs. A fixed effects weighting approach can recover ATHEs and CETs even with unmeasured confounding.