Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Testing Hypotheses of No Meaningful Effect
Search
Carlisle Rainey
January 04, 2013
Research
460
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Testing Hypotheses of No Meaningful Effect
Carlisle Rainey
January 04, 2013
Transcript
48 slides
Testing Hypotheses of No Meaningful Effect Carlisle Rainey
I'd like to convince you of three things
Important 1
Our arguments are not compelling 2
Our arguments can be compelling 3
Important Step 1:
Hypotheses of no meaningful effect are crucial to complete evaluation
of theories
Interaction
Social heterogeneity increases the number of parties, but only when
electoral institutions are sufficiently permissive. “ ” Clark and Golder (2006)
Adjudication
None
None
How often do these examples occur?
30%
Our arguments are not compelling Step 2:
No American president since FDR has won a second term
when the unemployment rate topped 7.2 percent... Obama must defy that trend to keep his job. “ ” New York Times June 1, 2011 “ ”
None
None
The nation's unemployment status by itself is not going to
affect Obama's. “ ” Seth Masket June 2, 2011
My critique
Rule out implausible relationships
None
None
None
None
None
None
Insignificance can't be used to argue for “no effect.”
But doesn't everyone already know that? “ ” A skeptic
Political scientists draw strong conclusions from insignificance.
Recessions have no effect on whether a democracy is consolidated.
“ ” Svolik (2008)
Our arguments can be compelling Step 3:
just like any other hypothesis
Argue against relationships inconsistent with the hypothesis
Define substantively meaningful Step 1:
Check the 90% CI Step 2:
Only negativity about the respondent’s preferred candidate should have a
significant demobilizing effect on voter turnout. “ ” Krupnikov (2011)
What's a meaningful effect? 1% 3% 5% 7% 9%
The demobilizing effect could be as large as 9%
Those are the three things
Important 1
Our arguments are not compelling 2
Our arguments can be compelling 3
But what should I do about this? “ ” You
Go read the details crain.co/nme 1
Think about your own work. 2
Keep in mind when reviewing others' work 3
None
More Decks by Carlisle Rainey
See All by Carlisle Rainey
Topic Sampling @ SPSA 2024
carlislerainey
0
320
Topic Sampling
carlislerainey
1
530
ggcarly:theme_carly_presents()
carlislerainey
0
120
Unnecessary
carlislerainey
0
690
When BLUE Is Not Best: Non-Normal Errors and the Linear Model
carlislerainey
0
330
Dealing with Separation in Logistic Regression Models
carlislerainey
0
180
Logit Models in Small Samples
carlislerainey
0
160
When BLUE is Not Best
carlislerainey
0
520
Dealing with Separation in Logistic Regression Models
carlislerainey
0
600
Other Decks in Research
See All in Research
論文紹介: Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind
hisaokatsumi
0
210
Méthane 2030 : Développer des solutions de réduction des émissions de méthane entérique : 1ers résultats
institutdelelevage
PRO
0
120
データサイエンティストの就労意識~2015 → 2026 一般(個人)会員アンケートより
datascientistsociety
PRO
0
1.2k
ふとした出会いで生まれたSkillが、 社内利用1位になるまで
mikimhk
22
25k
[IEICE-Soceity-Conf2026] セマンティック通信を見据えたマルチスケールセンシングと 学習の融合によるデジタルツイン基盤 / Digital Twin Infrastructure via the Fusion of Multi-Scale Sensing and Learning toward Semantic Communications
pman0214
0
150
Les émissions de méthane entérique en élevage laitier : Enjeux et travaux menés en Afrique de l’Ouest et en France
institutdelelevage
PRO
0
160
La longévité des troupeaux laitiers: état des lieux et perspectives
institutdelelevage
PRO
0
140
山中市政が招いた組織崩壊:よこはま安心ボックスを例に
sishi
0
370
超効率化への挑戦:1bit LLMの現状と展望
yumaichikawa
0
1k
Top 4セキュリティ会議に一通り論文が採択されるまでの道のりと展望 / Top 4 Security Grand Slam
takaomurakami
0
1.1k
モデル評価を効率的にする方法
ftakahashi
0
240
HAKARI-Bench - 実運用視点での情報検索モデル評価ベンチマーク
hotchpotch
1
870
Featured
See All Featured
Building Adaptive Systems
keathley
44
3.3k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
2.2k
Visualization
eitanlees
153
17k
How to build an LLM SEO readiness audit: a practical framework
nmsamuel
2
980
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
inesmontani
PRO
0
810
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
52
6.2k
Leading Effective Engineering Teams in the AI Era
addyosmani
9
2.9k
How Fast Is Fast Enough? [PerfNow 2025]
tammyeverts
3
980
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
380
Building Applications with DynamoDB
mza
96
7.3k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
11
1.1k