It is important to evaluate risk of bias of the primary studies included in systematic reviews and meta-analyses. Since tools pertinent to surveys are scarce, the goal of the current research was to develop a measure to address this need. In Study 1, an initial list of 10 relevant topics was compiled from previous measures. In Study 2, the list was refined into an eight-item risk-of-bias measure via discussion and a pilot study. In Study 3, experienced researchers used the measure to asses 70 studies, demonstrating high interrater agreement (weighted Kappa = .82). Inexperienced raters also utilized the measure to code 26 different studies included in a prior meta-analysis, which resulted in adequate interrater agreement (weighted Kappa = .64) and excellent convergent validity (r = .66). Thus, the new measure, designed to be accessible and flexible, can increase standardization of risk-of-bias evaluations and contribute to the interpretation of systematic reviews and meta-analytic findings.

中文翻译：

---

为调查的系统审查开发一种新的通用偏倚风险度量

评估纳入系统评价和荟萃分析的主要研究的偏倚风险很重要。由于与调查相关的工具稀缺，因此当前研究的目标是制定一项措施来满足这一需求。在研究 1 中，根据之前的措施编制了 10 个相关主题的初始列表。在研究 2 中，通过讨论和试点研究，该列表被细化为八项偏倚风险测量。在研究 3 中，经验丰富的研究人员使用该方法评估了 70 项研究，显示出较高的评价者一致性（加权 Kappa = .82）。没有经验的评估者也利用该措施对包含在先前荟萃分析中的 26 项不同研究进行编码，从而获得足够的评估者间一致性（加权 Kappa = .64）和出色的收敛效度（r = .66）。因此，新的措施，旨在方便和灵活，