当前位置: X-MOL 学术Br. J. Math. Stat. Psychol. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Utilizing response times in cognitive diagnostic computerized adaptive testing under the higher-order deterministic input, noisy 'and' gate model.
British Journal of Mathematical and Statistical Psychology ( IF 2.6 ) Pub Date : 2019-02-22 , DOI: 10.1111/bmsp.12160
Hung-Yu Huang

Methods of cognitive diagnostic computerized adaptive testing (CD‐CAT) under higher‐order cognitive diagnosis models have been developed to simultaneously provide estimates of the attribute mastery statuses of examinees for formative assessment and estimates of a latent continuous trait for overall summative evaluation. In a typical CD‐CAT environment, examinees are often subject to a time limit, and the examinees’ response times (RTs) for specific test items can be routinely recorded by custom‐made programs. Because examinees are individually administered tailored sets of test items from the item pool, they may experience different levels of speededness during testing and different levels of risk of running out of time. In this study, RTs were considered during the item‐selection procedure to control the test speededness and the RTs were treated as useful information for improving latent trait estimation in CD‐CAT under the higher‐order deterministic input, noisy ‘and’ gate (DINA) model. A modified posterior‐weighted Kullback–Leibler (PWKL) method that maximizes the item information per time unit and a shadow‐test method that assembles a provisional test subject to a specified time constraint were developed. Two simulation studies were conducted to assess the effects of the proposed methods on the quality of CD‐CAT for fixed‐ and variable‐length exams. The results show that, compared with the traditional PWKL method, the proposed methods preserve a lower risk of running out of time while ensuring satisfactory attribute estimation and providing more accurate estimates of the latent trait and speed parameters. Finally, several suggestions for future research are proposed.

中文翻译:

在高阶确定性输入,噪声“和”门模型下,在认知诊断计算机自适应测试中利用响应时间。

已经开发出了在更高阶认知诊断模型下的认知诊断计算机自适应测试(CD-CAT)方法,可以同时提供对考生的属性掌握状态的估计,以进行形成性评估,并提供潜在的连续性状的估计,以进行总体总结性评估。在典型的CD-CAT环境中,应试者通常受时间限制,并且特定测试项目的应试者响应时间(RT)可以由定制程序例行记录。由于应试者是从项目库中单独管理量身定做的一组测试项目,因此他们在测试过程中可能会遇到不同程度的速度提高和不同程度的时间耗尽风险。在这个研究中,在项目选择过程中考虑了RT,以控制测试的速度,并且在更高阶确定性输入,“噪声”和“门”(DINA)模型下,RT被视为有助于改进CD-CAT潜在性状估计的有用信息。开发了一种改进的后加权Kullback-Leibler(PWKL)方法,该方法使每个时间单位的项目信息最大化,并开发了一种影子测试方法,该方法可以在指定的时间约束下组装临时测试。进行了两项模拟研究,以评估所提出的方法对定长和可变长考试的CD-CAT质量的影响。结果表明,与传统的PWKL方法相比,所提出的方法在确保令人满意的属性估计并提供对潜在特征和速度参数的更准确估计的同时,还保留了用尽时间的较低风险。最后,对未来的研究提出了一些建议。
更新日期:2019-02-22
down
wechat
bug