当前位置: X-MOL 学术J. Econ. Surv. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
THE (NON‐)SIGNIFICANCE OF REPORTING ERRORS IN ECONOMICS: EVIDENCE FROM THREE TOP JOURNALS
Journal of Economic Surveys ( IF 4.142 ) Pub Date : 2020-11-11 , DOI: 10.1111/joes.12397
Peter Pütz 1 , Stephan B. Bruns 2
Affiliation  

We investigate the prevalence and sources of reporting errors in 30,993 hypothesis tests from 370 articles in three top economics journals. We define reporting errors as inconsistencies between reported significance levels by means of eye‐catchers and calculated urn:x-wiley:09500804:media:joes12397:joes12397-math-0001‐values based on reported statistical values, such as coefficients and standard errors. While 35.8% of the articles contain at least one reporting error, only 1.3% of the investigated hypothesis tests are afflicted by reporting errors. For strong reporting errors for which either the eye‐catcher or the calculated urn:x-wiley:09500804:media:joes12397:joes12397-math-0002‐value signals statistical significance but the respective other one does not, the error rate is 0.5% for the investigated hypothesis tests corresponding to 21.6% of the articles having at least one strong reporting error. Our analysis suggests a bias in favor of errors for which eye‐catchers signal statistical significance but calculated urn:x-wiley:09500804:media:joes12397:joes12397-math-0003‐values do not. Survey responses from the respective authors, replications, and exploratory regression analyses indicate some solutions to mitigate the prevalence of reporting errors in future research.

中文翻译:

经济学中报告错误的(无)意义:来自三本顶级期刊的证据

我们调查了三本顶级经济学期刊中370篇文章中的30993项假设检验中报告错误的普遍性和来源。我们将报告错误定义为通过引人注意的方式报告的显着性水平与缸:x-wiley:09500804:media:joes12397:joes12397-math-0001基于报告的统计值(例如系数和标准误差)的计算值之间的不一致。尽管35.8%的文章包含至少一个报告错误,但只有1.3%的调查假设检验受到报告错误的困扰。对于重大的报告错误,无论是引人注目的还是计算得出的错误ur:x-wiley:09500804:media:joes12397:joes12397-math-0002值表示统计显着性,但各自没有统计学意义,被调查的假设检验的错误率为0.5%,对应于具有至少一个强烈报告错误的文章的21.6%。我们的分析表明,偏向于偏向于那些引人注目的信号具有统计意义而计算出的值ur:x-wiley:09500804:media:joes12397:joes12397-math-0003却没有这种意义的误差。来自各作者的调查回复,重复研究和探索性回归分析表明,可以采用一些解决方案来减轻未来研究中报告错误的普遍性。
更新日期:2020-11-11
down
wechat
bug