Rater‐mediated assessments require the evaluation of the accuracy and consistency of the inferences made by the raters to ensure the validity of score interpretations and uses. Modeling rater response processes allows for a better understanding of how raters map their representations of the examinee performance to their representation of the scoring criteria. Validity of score meaning is affected by the accuracy of raters' representations of examinee performance and the scoring criteria, and the accuracy of the mapping process. Methodological advances and applications that model rater response processes, rater accuracy, and rater consistency inform the design, scoring, interpretations, and uses of rater‐mediated assessments.

中文翻译：

---

在评估分数含义中对评分者响应过程建模

评估者介导的评估需要评估评估者所作推论的准确性和一致性，以确保评分解释和使用的有效性。对评估者响应过程进行建模可以更好地了解评估者如何将其对考生表现的表述与他们对评分标准的表述。评分含义的有效性受评估者代表考生表现和评分标准的准确性以及映射过程的准确性影响。对评估者响应过程，评估者准确性和评估者一致性建模的方法学进步和应用，为评估者介导的评估的设计，评分，解释和使用提供了依据。