Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Testing Hypotheses of No Meaningful Effect
Carlisle Rainey
January 04, 2013
Research
1
360
Testing Hypotheses of No Meaningful Effect
Carlisle Rainey
January 04, 2013
Tweet
Share
More Decks by Carlisle Rainey
See All by Carlisle Rainey
carlislerainey
0
44
carlislerainey
0
300
carlislerainey
0
130
carlislerainey
0
110
carlislerainey
0
83
carlislerainey
0
370
carlislerainey
0
410
carlislerainey
0
340
carlislerainey
0
350
Other Decks in Research
See All in Research
highlow
0
440
satorin1204
0
660
liberalarts
6
2.6k
forgetmenotjun
0
300
digitalnaturegroup
0
450
pirika_info
0
900
jnishimu
1
630
mkimura
2
210
yohekawag
0
180
hiking
0
2.4k
waptech
1
170
clairity11
2
110
Featured
See All Featured
michaelherold
226
8.7k
smashingmag
233
18k
akmur
252
19k
roundedbygravity
242
21k
shpigford
370
42k
reverentgeek
167
7.4k
skipperchong
8
800
erikaheidi
15
4.5k
holman
448
140k
denniskardys
220
120k
andyhume
64
3.8k
philhawksworth
192
17k
Transcript
Testing Hypotheses of No Meaningful Effect Carlisle Rainey
I'd like to convince you of three things
Important 1
Our arguments are not compelling 2
Our arguments can be compelling 3
Important Step 1:
Hypotheses of no meaningful effect are crucial to complete evaluation
of theories
Interaction
Social heterogeneity increases the number of parties, but only when
electoral institutions are sufficiently permissive. “ ” Clark and Golder (2006)
Adjudication
None
None
How often do these examples occur?
30%
Our arguments are not compelling Step 2:
No American president since FDR has won a second term
when the unemployment rate topped 7.2 percent... Obama must defy that trend to keep his job. “ ” New York Times June 1, 2011 “ ”
None
None
The nation's unemployment status by itself is not going to
affect Obama's. “ ” Seth Masket June 2, 2011
My critique
Rule out implausible relationships
None
None
None
None
None
None
Insignificance can't be used to argue for “no effect.”
But doesn't everyone already know that? “ ” A skeptic
Political scientists draw strong conclusions from insignificance.
Recessions have no effect on whether a democracy is consolidated.
“ ” Svolik (2008)
Our arguments can be compelling Step 3:
just like any other hypothesis
Argue against relationships inconsistent with the hypothesis
Define substantively meaningful Step 1:
Check the 90% CI Step 2:
Only negativity about the respondent’s preferred candidate should have a
significant demobilizing effect on voter turnout. “ ” Krupnikov (2011)
What's a meaningful effect? 1% 3% 5% 7% 9%
The demobilizing effect could be as large as 9%
Those are the three things
Important 1
Our arguments are not compelling 2
Our arguments can be compelling 3
But what should I do about this? “ ” You
Go read the details crain.co/nme 1
Think about your own work. 2
Keep in mind when reviewing others' work 3
None