In signal detection rater models for constructed response (CR) scoring, it is assumed that raters discriminate equally well between different latent classes defined by the scoring rubric. An extended model that relaxes this assumption is introduced; the model recognizes that a rater may not discriminate equally well between some of the scoring classes. The extension recognizes a different type of rater effect and is shown to offer useful tests and diagnostic plots of the equal discrimination assumption, along with ways to assess rater accuracy and various rater effects. The approach is illustrated with an application to a large‐scale language test.

中文翻译：

---

具有有序感知分布的评分者评分的潜在类信号检测模型

在用于构造响应（CR）评分的信号检测评分器模型中，假定评分者在评分规则定义的不同潜在类别之间的区别很好。引入了一个放松该假设的扩展模型；该模型认识到，评分者可能无法在某些评分类别之间很好地区别对待。该扩展识别不同类型的评估者效果，并显示出可提供相等歧视假设的有用测试和诊断图，以及评估评估者准确性和各种评估者效果的方式。该方法通过在大型语言测试中的应用进行了说明。