Usability testing can involve multiple users and evaluators. In such cases, consolidating usability problems (UPs) constitutes an essential part of data analysis. In a between-subjects design, this study aims to re-examine a previous study by comparing the results of novice evaluators merging UPs individually vs. collaboratively and to assess the quality of the final UP lists, by computing the merging rate and the accuracy rate, respectively. Law and Hvannberg compared the results of evaluators merging UPs individually vs. collaboratively in a within-subjects design, revealing a tendency towards merging UPs in collaborative settings. In the present study, 45 novice evaluators consolidated four UP lists into a single UP master list while working alone or with a partner. The results showed no significant difference between evaluators in the two settings, suggesting that the UP consolidation process does not benefit from positive group decision effects.

中文翻译：

---

在个人和协作环境中重新检查新手评估人员的可用性问题

可用性测试可能涉及多个用户和评估者。在这种情况下，合并可用性问题（UP）构成数据分析的重要组成部分。在受试者之间的设计中，本研究旨在通过比较新手评估者单独或协作合并UP的结果来重新审查先前的研究，并通过计算合并率和准确率来评估最终UP列表的质量， 分别。Law和Hvannberg在受试者内部设计中比较了评估者将UPs单独合并或协作合并的结果，揭示了在协作环境中合并UPs的趋势。在本研究中，有45位新手评估人员将四个UP列表合并为一个UP主列表，同时单独工作或与合作伙伴一起工作。