ABSTRACT

Identifying and considering test-taking effort is of utmost importance for drawing valid inferences on examinee competency in low-stakes tests. Different approaches exist for doing so. The speed-accuracy+engagement model aims at identifying non-effortful test-taking behavior in terms of nonresponse and rapid guessing based on responses and response times. The model allows for identifying rapid-guessing behavior on the item-by-examinee level whilst jointly modeling the processes underlying rapid guessing and effortful responding. To assess whether the model indeed provides a valid measure of test-taking effort, we investigate (1) convergent validity with previously developed behavioral as well as self-report measures on guessing behavior and effort, (2) fit within the nomological network of test-taking motivation derived from expectancy-value theory, and (3) ability to detect differences between groups that can be assumed to differ in test-taking effort. Results suggest that the model captures central aspects of non-effortful test-taking behavior. While it does not cover the whole spectrum of non-effortful test-taking behavior, it provides a measure for some aspects of it, in a manner that is less subjective than self-reports. The article concludes with a discussion of implications for the development of behavioral measures of non-effortful test-taking behavior.

摘要

识别和考虑参加考试的努力对于对低水平考试中的考生能力做出有效推论至关重要。存在不同的方法来这样做。速度准确性+参与度模型旨在根据响应和响应时间，根据无响应和快速猜测来识别不费力的考试行为。该模型允许在逐项检查者级别上识别快速猜测行为，同时对快速猜测和努力响应的基础流程进行联合建模。为了评估模型是否确实提供了有效的测验工作量度，我们调查（1）使用先前开发的行为和自我报告量度来猜测行为和努力量的收敛效度，（2）符合从期望值理论推导的应试动机的名词学网络，以及（3）能够检测可能被认为在应试工作上有所不同的组之间差异的能力。结果表明，该模型捕获了不努力的应试行为的主要方面。尽管它并不涵盖不费力的考试行为的全部范围，但它以一种比主观报告更少主观的方式为它的某些方面提供了一种度量。本文最后讨论了对不努力的应试行为的行为测度发展的意义。尽管它并不涵盖不费力的考试行为的全部范围，但它以一种比主观报告更少主观的方式为它的某些方面提供了一种度量。本文最后讨论了对不努力的应试行为的行为测度发展的影响。尽管它并不涵盖不费力的考试行为的全部范围，但它以一种比主观报告更少主观的方式为它的某些方面提供了一种度量。本文最后讨论了对不努力的应试行为的行为测度发展的意义。