当前位置: X-MOL 学术Perspect. Psychol. Sci. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014–2017)
Perspectives on Psychological Science ( IF 12.6 ) Pub Date : 2021-03-08 , DOI: 10.1177/1745691620979806
Tom E Hardwicke 1, 2 , Robert T Thibault 3, 4 , Jessica E Kosie 5 , Joshua D Wallach 6 , Mallory C Kidwell 7 , John P A Ioannidis 2, 8, 9
Affiliation  

Psychologists are navigating an unprecedented period of introspection about the credibility and utility of their discipline. Reform initiatives emphasize the benefits of transparency and reproducibility-related research practices; however, adoption across the psychology literature is unknown. Estimating the prevalence of such practices will help to gauge the collective impact of reform initiatives, track progress over time, and calibrate future efforts. To this end, we manually examined a random sample of 250 psychology articles published between 2014 and 2017. Over half of the articles were publicly available (154/237, 65%, 95% confidence interval [CI] = [59%, 71%]); however, sharing of research materials (26/183; 14%, 95% CI = [10%, 19%]), study protocols (0/188; 0%, 95% CI = [0%, 1%]), raw data (4/188; 2%, 95% CI = [1%, 4%]), and analysis scripts (1/188; 1%, 95% CI = [0%, 1%]) was rare. Preregistration was also uncommon (5/188; 3%, 95% CI = [1%, 5%]). Many articles included a funding disclosure statement (142/228; 62%, 95% CI = [56%, 69%]), but conflict-of-interest statements were less common (88/228; 39%, 95% CI = [32%, 45%]). Replication studies were rare (10/188; 5%, 95% CI = [3%, 8%]), and few studies were included in systematic reviews (21/183; 11%, 95% CI = [8%, 16%]) or meta-analyses (12/183; 7%, 95% CI = [4%, 10%]). Overall, the results suggest that transparency and reproducibility-related research practices were far from routine. These findings establish baseline prevalence estimates against which future progress toward increasing the credibility and utility of psychology research can be compared.



中文翻译:

估计心理学中透明度和可重复性相关研究实践的普遍性(2014-2017)

心理学家正在对他们学科的可信度和效用进行前所未有的反省。改革举措强调透明度和可重复性相关研究实践的好处;然而,心理学文献中的采用是未知的。估计此类做法的普遍性将有助于衡量改革举措的集体影响,跟踪一段时间内的进展,并校准未来的努力。为此,我们手动检查了 2014 年至 2017 年间发表的 250 篇心理学文章的随机样本。超过一半的文章是公开的(154/237, 65%, 95% 置信区间 [CI] = [59%, 71% ]); 但是,共享研究材料 (26/183; 14%, 95% CI = [10%, 19%]),研究方案 (0/188; 0%, 95% CI = [0%, 1%]),原始数据 (4/188; 2%, 95% CI = [1%, 4%]), 和分析脚本 (1/188; 1%, 95% CI = [0%, 1%]) 很少见。预注册也不常见 (5/188; 3%, 95% CI = [1%, 5%])。许多文章包括资金披露声明 (142/228; 62%, 95% CI = [56%, 69%]),但利益冲突声明不太常见 (88/228; 39%, 95% CI = [32%, 45%])。重复性研究很少(10/188;5%, 95% CI = [3%, 8%]),系统评价中纳入的研究很少(21/183;11%, 95% CI = [8%, 16 %]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。预注册也不常见 (5/188; 3%, 95% CI = [1%, 5%])。许多文章包括资金披露声明 (142/228; 62%, 95% CI = [56%, 69%]),但利益冲突声明不太常见 (88/228; 39%, 95% CI = [32%, 45%])。重复性研究很少(10/188;5%, 95% CI = [3%, 8%]),系统评价中纳入的研究很少(21/183;11%, 95% CI = [8%, 16 %]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。预注册也不常见 (5/188; 3%, 95% CI = [1%, 5%])。许多文章包括资金披露声明 (142/228; 62%, 95% CI = [56%, 69%]),但利益冲突声明不太常见 (88/228; 39%, 95% CI = [32%, 45%])。重复性研究很少(10/188;5%, 95% CI = [3%, 8%]),系统评价中纳入的研究很少(21/183;11%, 95% CI = [8%, 16 %]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。95% CI = [56%, 69%]),但利益冲突陈述不太常见 (88/228; 39%, 95% CI = [32%, 45%])。重复性研究很少(10/188;5%, 95% CI = [3%, 8%]),系统评价中纳入的研究很少(21/183;11%, 95% CI = [8%, 16 %]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。95% CI = [56%, 69%]),但利益冲突陈述不太常见 (88/228; 39%, 95% CI = [32%, 45%])。重复性研究很少(10/188;5%, 95% CI = [3%, 8%]),系统评价中纳入的研究很少(21/183;11%, 95% CI = [8%, 16 %]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。16%]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。16%]) 或荟萃分析 (12/183; 7%, 95% CI = [4%, 10%])。总体而言,结果表明与透明度和可重复性相关的研究实践远非常规。这些发现建立了基线流行率估计,可以比较未来在提高心理学研究的可信度和实用性方面取得的进展。

更新日期:2021-03-08
down
wechat
bug