当前位置: X-MOL 学术Journal of Educational Measurement › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Variation in Respondent Speed and its Implications: Evidence from an Adaptive Testing Scenario
Journal of Educational Measurement ( IF 1.188 ) Pub Date : 2021-06-22 , DOI: 10.1111/jedm.12291
Benjamin W. Domingue 1 , Klint Kanopka 1 , Ben Stenhaug 1 , James Soland 2, 3 , Megan Kuhfeld 2 , Steve Wise 2 , Chris Piech 4
Affiliation  

The more frequent collection of response time data is leading to an increased need for an understanding of how such data can be included in measurement models. Models for response time have been advanced, but relatively limited large-scale empirical investigations have been conducted. We take advantage of a large data set from the adaptive NWEA MAP Growth Reading Assessment to shed light on emergent features of response time behavior. We identify two behaviors in particular. The first, response acceleration, is a reduction in response time for responses that occur later in the assessment. We note that such reductions are heterogeneous as a function of estimated ability (lower ability estimates are associated with larger increases in acceleration) and that reductions in response time lead to lower accuracy relative to expectation for lower ability students. The second is within-person variation in the association between time usage and accuracy. Idiosyncratic within-person changes in response time have inconsistent implications for accuracy; in some cases additional response time predicts higher accuracy but in other cases additional response time predicts declines in accuracy. These findings have implications for models that incorporate response time and accuracy. Our approach may be useful in other studies of adaptive testing data.

中文翻译:

受访者速度的变化及其影响:来自自适应测试场景的证据

响应时间数据的更频繁收集导致对如何将此类数据包含在测量模型中的理解的需求增加。响应时间的模型已经得到改进,但已经进行了相对有限的大规模实证调查。我们利用来自自适应 NWEA MAP 增长阅读评估的大型数据集来阐明响应时间行为的紧急特征。我们特别确定了两种行为。第一个,响应加速,是减少在评估后期出现的响应的响应时间。我们注意到,作为估计能力的函数,这种减少是异质的(较低的能力估计与加速度的较大增加相关),并且响应时间的减少导致相对于能力较低的学生的预期准确性较低。第二个是时间使用和准确性之间关联的个体差异。响应时间的个人内部特殊变化对准确性的影响不一致;在某些情况下,额外的响应时间预示着更高的准确性,但在其他情况下,额外的响应时间预示着准确性的下降。这些发现对包含响应时间和准确性的模型有影响。我们的方法可能对自适应测试数据的其他研究有用。响应时间的个人内部特殊变化对准确性的影响不一致;在某些情况下,额外的响应时间预示着更高的准确性,但在其他情况下,额外的响应时间预示着准确性的下降。这些发现对包含响应时间和准确性的模型有影响。我们的方法可能对自适应测试数据的其他研究有用。响应时间的个人内部特殊变化对准确性的影响不一致;在某些情况下,额外的响应时间预示着更高的准确性,但在其他情况下,额外的响应时间预示着准确性的下降。这些发现对包含响应时间和准确性的模型有影响。我们的方法可能对自适应测试数据的其他研究有用。
更新日期:2021-06-22
down
wechat
bug