logoPicV1 logoTextV1

Document Detail


permalink to this item
CONFERENCE POSTER
Why "Significance Bias" Matters for Political Science
Esarey, Justin
Wu, Ahra

Abstract
It is common practice among political scientists that quantitative results must be statistically significant as a necessary condition of their receiving further scientific consideration. Unfortunately, statistically significant estimates of a relationship are typically larger than the true magnitude. The consequence is that scientifically notable (e.g., published) results will typically overstate the substantive significance of their findings, particularly early in a research program when null or weak findings are unpublishable. Worse yet, the actual false positive rate is often much larger than the nominal value of the significance test. We show that these forms of “significance bias” have a substantive impact on political science research. We also propose new methodological strategies to correct for and prevent significance bias.

Keywords
Keywords not supplied

File
icnPdfMini significancebiasposter2013718.pdf


Uploaded
07-20-2013

Poster Category
Faculty

Document ID Number
1410


   
wustlArtSci