当前位置: X-MOL 学术Research Integrity and Peer Review › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Open up: a survey on open and non-anonymized peer reviewing
Research Integrity and Peer Review Pub Date : 2020-06-26 , DOI: 10.1186/s41073-020-00094-z
Lonni Besançon 1, 2 , Niklas Rönnberg 1 , Jonas Löwgren 1 , Jonathan P Tennant 3, 4, 5 , Matthew Cooper 1
Affiliation  

Background

Our aim is to highlight the benefits and limitations of open and non-anonymized peer review. Our argument is based on the literature and on responses to a survey on the reviewing process of alt.chi, a more or less open review track within the so-called Computer Human Interaction (CHI) conference, the predominant conference in the field of human-computer interaction. This track currently is the only implementation of an open peer review process in the field of human-computer interaction while, with the recent increase in interest in open scientific practices, open review is now being considered and used in other fields.

Methods

We ran an online survey with 30 responses from alt.chi authors and reviewers, collecting quantitative data using multiple-choice questions and Likert scales. Qualitative data were collected using open questions.

Results

Our main quantitative result is that respondents are more positive to open and non-anonymous reviewing for alt.chi than for other parts of the CHI conference. The qualitative data specifically highlight the benefits of open and transparent academic discussions. The data and scripts are available on https://osf.io/vuw7h/, and the figures and follow-up work on http://tiny.cc/OpenReviews.

Conclusion

While the benefits are quite clear and the system is generally well-liked by alt.chi participants, they remain reluctant to see it used in other venues. This concurs with a number of recent studies that suggest a divergence between support for a more open review process and its practical implementation.



中文翻译:

开放:关于开放和非匿名同行评审的调查

背景

我们的目标是强调开放和非匿名同行评审的好处和局限性。我们的论点基于文献和对 alt.chi 审查过程调查的回应,alt.chi 是所谓的计算机人机交互 (CHI) 会议中或多或少开放的审查轨道,该会议是人类领域的主要会议- 计算机交互。该轨道目前是人机交互领域开放同行评审过程的唯一实施,而随着最近对开放科学实践的兴趣增加,现在正在考虑并在其他领域使用开放评审。

方法

我们对 alt.chi 作者和审稿人的 30 名回复进行了在线调查,使用多项选择题和李克特量表收集定量数据。使用开放式问题收集定性数据。

结果

我们的主要定量结果是,与 CHI 会议的其他部分相比,受访者对 alt.chi 的公开和非匿名审查更为积极。定性数据特别突出了公开透明的学术讨论的好处。数据和脚本可在 https://osf.io/vuw7h/ 上获得,数据和后续工作可在 http://tiny.cc/OpenReviews 上获得。

结论

虽然好处很明显,并且该系统普遍受到 alt.chi 参与者的喜爱,但他们仍然不愿意看到它在其他场所使用。这与最近的一些研究一致,这些研究表明支持更开放的审查过程与其实际实施之间存在分歧。

更新日期:2020-06-26
down
wechat
bug