There has been a growing research interest in the identification and management of disengaged test taking, which poses a validity threat that is particularly prevalent with low‐stakes tests. This study investigated effort‐moderated (E‐M) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring. Using achievement test data composed of test takers who were quickly retested and showed differential degrees of disengagement, three basic findings emerged. First, standard E‐M scoring accounted for roughly one‐third of the score distortion due to differential disengagement. Second, a modified E‐M scoring method that used more liberal time thresholds performed better—accounting for two‐thirds or more of the distortion. Finally, the inability of E‐M scoring to account for all of the score distortion suggests the additional presence of nonrapid item responses that reflect less‐than‐full engagement by some test takers.

中文翻译：

---

使用重新测试数据评估和改善努力量评分

对非参与式考试的识别和管理的研究兴趣不断增长，这构成了有效性威胁，在低水平考试中尤为普遍。这项研究调查了努力适度（E-M）评分，其中识别出归类为快速猜测的项目响应，并将其排除在评分之外。使用由迅速被重新测试并显示不同脱离程度的应试者组成的成绩测试数据，得出了三个基本发现。首先，标准的E-M评分大约占因差异性脱离而产生的评分失真的三分之一。其次，使用更宽松的时间阈值的改进的E-M评分方法效果更好-占失真的三分之二或更多。最后，