当前位置: X-MOL 学术Journal of Psychoeducational Assessment › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Evaluating a Computerized Adaptive Testing Version of a Cognitive Ability Test Using a Simulation Study
Journal of Psychoeducational Assessment ( IF 1.5 ) Pub Date : 2021-06-25 , DOI: 10.1177/07342829211027753
Ioannis Tsaousis 1 , Georgios D. Sideridis 2, 3 , Hannan M. AlGhamdi 4
Affiliation  

This study evaluated the psychometric quality of a computerized adaptive testing (CAT) version of the general cognitive ability test (GCAT), using a simulation study protocol put forth by Han, K. T. (2018a). For the needs of the analysis, three different sets of items were generated, providing an item pool of 165 items. Before evaluating the efficiency of the GCAT, all items in the final item pool were linked (equated), following a sequential approach. Data were generated using a standard normal for 10,000 virtual individuals (M = 0 and SD = 1). Using the measure’s 165-item bank, the ability value (θ) for each participant was estimated. maximum Fisher information (MFI) and maximum likelihood estimation with fences (MLEF) were used as item selection and score estimation methods, respectively. For item exposure control, the fade away method (FAM) was preferred. The termination criterion involved a minimum SE ≤ 0.33. The study revealed that the average number of items administered for 10,000 participants was 15. Moreover, the precision level in estimating the participant’s ability score was very high, as demonstrated by the CBIAS, CMAE, and CRMSE). It is concluded that the CAT version of the test is a promising alternative to administering the corresponding full-length measure since it reduces the number of administered items, prevents high rates of item exposure, and provides accurate scores with minimum measurement error.



中文翻译:

使用模拟研究评估认知能力测试的计算机化自适应测试版本

本研究使用 Han, KT (2018a) 提出的模拟研究协议,评估了一般认知能力测试 (GCAT) 的计算机化自适应测试 (CAT) 版本的心理测量质量。为了分析的需要,生成了三组不同的项目,提供了一个包含 165 个项目的项目库。在评估 GCAT 的效率之前,最终项目池中的所有项目都按照顺序方法进行链接(等同)。数据是使用 10,000 个虚拟个体的标准正态生成的(M = 0 和SD= 1)。使用该措施的 165 个项目库,估计每个参与者的能力值 (θ)。分别使用最大 Fisher 信息 (MFI) 和带栅栏的最大似然估计 (MLEF) 作为项目选择和评分估计方法。对于项目曝光控制,首选渐隐法(FAM)。终止标准涉及最小 SE ≤ 0.33。该研究表明,10,000 名参与者的平均管理项目数为 15。此外,如 CBIAS、CMAE 和 CRMSE 所证明的那样,估计参与者能力得分的精确度水平非常高。结论是,CAT 版本的测试是管理相应全长测量的有前途的替代方案,因为它减少了管理项目的数量,防止了项目暴露的高比率,

更新日期:2021-06-28
down
wechat
bug