ABSTRACT

The identification of rapid guessing is important to promote the validity of achievement test scores, particularly with low-stakes tests. Effective methods for identifying rapid guesses require reliable threshold methods that are also aligned with test taker behavior. Although several common threshold methods are based on rapid guessing response accuracy or visual inspection of response time distributions, this paper describes a new information-based approach to setting thresholds that does not share the limitations of other methods. A pair of information-based methods are introduced, and an empirical comparison study found the new methods to more reliably set thresholds than methods based on response accuracy or visual inspection.

摘要

快速猜测的识别对于提高成绩测验分数的有效性非常重要，尤其是对于低风险测验而言。识别快速猜测的有效方法需要可靠的阈值方法，这些方法也应与应试者的行为保持一致。尽管几种常见的阈值方法基于快速猜测响应准确度或对响应时间分布进行目视检查，但本文介绍了一种新的基于信息的阈值设置方法，该方法没有其他方法的局限性。引入了一对基于信息的方法，并进行了经验比较研究，发现新方法比基于响应精度或视觉检查的方法更可靠地设置阈值。