Introduction

The ability to identify criteria (ATIC) refers to an examinee's capacity to distinguish the construct being evaluated. Previous research indicates ATIC can be predictive of performance on some assessments. This exploratory study investigated the relationship between a participant's ability to identify criteria and their performance on an empathy situational judgment test (SJT), an assessment format used to measure social and behavioral attributes.

Methods

A 12-item empathy SJT was completed by 15 students and 15 pharmacists. During a cognitive interview, participants were asked what they believed each exam question measured. Responses were coded to determine whether participants stated “empathy” (indication of ATIC). The point-biserial correlation coefficient was calculated to explore the relationship of ATIC (correctly or not correctly identifying the item measured empathy) and performance on the SJT (total score).

Results

Participants identified empathy 33.3% of the time, and it was the construct most often identified. Pharmacists (27.5%) identified empathy less often than students (39.2%). When empathy was identified as the construct, it was most often reported for items in a non-healthcare setting (56.3%) rather than a healthcare setting (43.7%) and for questions targeting affective empathy (71.3%) rather than cognitive empathy (28.7%). There were no statistically significant relationships with correctly identifying the construct and performance on individual items and the overall test.

Conclusions

There is inconclusive evidence that ATIC relates to performance on an empathy SJT. Additional research is needed to evaluate the role of ATIC and assessment performance to corroborate study results.

中文翻译：

---

在共情情境判断测试中识别结构的能力是否与表现有关？探索评估新概念

介绍

识别标准的能力 (ATIC) 是指考生区分被评估结构的能力。先前的研究表明，ATIC 可以预测某些评估的表现。这项探索性研究调查了参与者识别标准的能力与其在共情情境判断测试 (SJT) 中的表现之间的关系，SJT 是一种用于衡量社会和行为属性的评估格式。

方法

15 名学生和 15 名药剂师完成了 12 项移情 SJT。在认知面试中，参与者被问及他们认为每个考试问题测量的是什么。对回答进行编码以确定参与者是否表示“同理心”（ATIC 的迹象）。计算点双列相关系数以探讨 ATIC（正确或未正确识别测量的同理心）与 SJT 表现（总分）之间的关系。

结果

参与者在 33.3% 的时间内确定了同理心，这是最常被确定的结构。药剂师 (27.5%) 发现同理心的频率低于学生 (39.2%)。当共情被确定为结构时，最常报告的是非医疗环境 (56.3%) 而不是医疗环境 (43.7%) 以及针对情感移情 (71.3%) 而不是认知移情 (28.7) 的问题%）。与正确识别单个项目和整体测试的构造和性能之间没有统计学上的显着关系。

结论

没有确凿的证据表明 ATIC 与同理心 SJT 的表现有关。需要额外的研究来评估 ATIC 的作用和评估性能，以证实研究结果。