PURPOSE In medical education, peer assessment is considered to be an effective learning strategy. Although several studies have examined agreement between peer and faculty assessments regarding basic life support (BLS), few studies have done so for advanced resuscitation skills (ARS) such as intubation and defibrillation. Therefore, this study aimed to determine the degree of agreement between medical students' and faculty assessments of ARS examinations. METHODS This retrospective explorative study was conducted during the emergency medicine (EM) clinical clerkship of fourth-year medical students from April to July 2020. A faculty assessor (FA) and a peer assessor (PA) assessed each examinee's resuscitation skills (including BLS, intubation, and defibrillation) using a checklist that consisted of 20 binary items (performed or not performed) and 1 global proficiency rating using a 5-point Likert scale. The prior examinee assessed the next examinee after feedback and training as a PA. All 54 students participated in peer assessment. The assessments of 44 FA/PA pairs were analyzed using the intraclass correlation coefficient (ICC) and Gwet's first-order agreement coefficient. RESULTS The PA scores were higher than the FA scores (mean±standard deviation, 20.2±2.5 [FA] vs. 22.3±2.4 [PA]; P<0.001). The agreement was poor to moderate for the overall checklist (ICC, 0.55; 95% confidence interval [CI], 0.31 to 0.73; P<0.01), BLS (ICC, 0.19; 95% CI, -0.11 to 0.46; P<0.10), intubation (ICC, 0.51; 95% CI, 0.26 to 0.70; P<0.01), and defibrillation (ICC, 0.49; 95% CI, 0.23 to 0.68; P<0.01). CONCLUSION Senior medical students showed unreliable agreement in ARS assessments compared to faculty assessments. If a peer assessment is planned in skills education, comprehensive preparation and sufficient assessor training should be provided in advance.

中文翻译：

---

在韩国进行的高级复苏技术检查中，医学生的同伴评估与教师评估之间达成协议。

目的在医学教育中，同伴评估被认为是一种有效的学习策略。尽管有几项研究检查了同龄人和教职员工之间关于基本生命支持（BLS）的评估的一致性，但很少有研究针对诸如插管和除纤颤的高级复苏技术（ARS）。因此，本研究旨在确定医学生与ARS考试的院系评估之间的一致程度。方法这项回顾性探索性研究是在2020年4月至2020年7月的四年级医学生急诊医学（EM）临床工作期间进行的。教师评估师（FA）和同伴评估师（PA）评估了每位考生的复苏技能（包括BLS，插管 和除颤），该检查表由20个二元项目（已执行或未执行）和1个整体熟练程度评分（由5点李克特量表组成）组成。先前的应试者经过反馈和培训后作为PA评估了下一位应试者。所有54名学生参加了同伴评估。使用组内相关系数（ICC）和Gwet的一阶协议系数分析了44对FA / PA对的评估。结果PA评分高于FA评分（平均值±标准偏差，20.2±2.5 [FA]与22.3±2.4 [PA]； P <0.001）。总体检查清单的一致性差到中等（ICC，0.55; 95％置信区间[CI]，0.31至0.73; P <0.01），BLS（ICC，0.19; 95％CI，-0.11至0.46; P <0.10 ），插管（ICC，0.51; 95％CI，0.26至0.70; P <0.01）和除纤颤（ICC，0.49; 95％CI，0.23至0.68; P ＜0.01）。结论与医学院评估相比，高级医学生在ARS评估中显示出不可靠的一致性。如果计划在技能教育中进行同伴评估，则应事先提供全面的准备和足够的评估师培训。