当前位置: X-MOL 学术Applied Psychological Measurement › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A Dynamic Stratification Method for Improving Trait Estimation in Computerized Adaptive Testing Under Item Exposure Control.
Applied Psychological Measurement ( IF 1.522 ) Pub Date : 2019-04-23 , DOI: 10.1177/0146621619843820
Jyun-Hong Chen 1 , Hsiu-Yi Chao 2 , Shu-Ying Chen 2
Affiliation  

When computerized adaptive testing (CAT) is under stringent item exposure control, the precision of trait estimation will substantially decrease. A new item selection method, the dynamic Stratification method based on Dominance Curves (SDC), which is aimed at improving trait estimation, is proposed to mitigate this problem. The objective function of the SDC in item selection is to maximize the sum of test information for all examinees rather than maximizing item information for individual examinees at a single-item administration, as in conventional CAT. To achieve this objective, the SDC uses dominance curves to stratify an item pool into strata with the number being equal to the test length to precisely and accurately increase the quality of the administered items as the test progresses, reducing the likelihood that a high-discrimination item will be administered to an examinee whose ability is not close to the item difficulty. Furthermore, the SDC incorporates a dynamic process for on-the-fly item–stratum adjustment to optimize the use of quality items. Simulation studies were conducted to investigate the performance of the SDC in CAT under item exposure control at different levels of severity. According to the results, the SDC can efficiently improve trait estimation in CAT through greater precision and more accurate trait estimation than those generated by other methods (e.g., the maximum Fisher information method) in most conditions.

中文翻译:

一种在项目暴露控制下提高计算机自适应测试性状估计的动态分层方法。

当计算机自适应测试(CAT)受严格项目暴露控制时,特征估计的精度将大大降低。提出了一种新的项目选择方法,即基于优势曲线的动态分层方法(SDC),旨在改善特征估计。SDC在项目选择中的目标功能是使所有应试者的考试信息总和最大化,而不是像常规CAT一样在单项管理中使单个应试者的项目信息最大化。为了实现此目标,SDC使用优势曲线将项目池分层为层,其数量等于测试长度,以随着测试的进行精确而准确地提高所管理项目的质量,降低了将高区分性项目管理给能力不接近项目难度的考生的可能性。此外,SDC结合了动态流程,可即时调整物料层次,以优化优质物料的使用。进行了模拟研究,以研究在不同严重程度的项目暴露控制下,CAT中SDC的性能。根据结果​​,在大多数情况下,SDC可以通过比其他方法(例如,最大Fisher信息方法)生成的特征估计更高的精度和更准确的特征估计,来有效地改进CAT中的特征估计。SDC结合了动态项目进行动态调整-层调整以优化质量项目的使用。进行了模拟研究,以研究在不同严重程度的项目暴露控制下,CAT中SDC的性能。根据结果​​,在大多数情况下,SDC可以通过比其他方法(例如,最大Fisher信息方法)生成的特征估计更高的精度和更准确的特征估计,来有效地改进CAT中的特征估计。SDC结合了动态项目进行动态调整-层调整以优化质量项目的使用。进行了模拟研究,以研究在不同严重程度的项目暴露控制下,CAT中SDC的性能。根据结果​​,在大多数情况下,SDC可以通过比其他方法(例如,最大Fisher信息方法)生成的特征估计更高的精度和更准确的特征估计,来有效地改进CAT中的特征估计。
更新日期:2019-04-23
down
wechat
bug