当前位置: X-MOL 学术Journal of Educational Measurement › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A Comparison of Aggregation Rules for Selecting Anchor Items in Multigroup DIF Analysis
Journal of Educational Measurement ( IF 1.188 ) Pub Date : 2019-09-05 , DOI: 10.1111/jedm.12246
Thorben Huelmann 1 , Rudolf Debelak 1 , Carolin Strobl 1
Affiliation  

This study addresses the topic of how anchoring methods for differential item functioning (DIF) analysis can be used in multigroup scenarios. The direct approach would be to combine anchoring methods developed for two‐group scenarios with multigroup DIF‐detection methods. Alternatively, multiple tests could be carried out. The results of these tests need to be aggregated to determine the anchor for the final DIF analysis. In this study, the direct approach and three aggregation rules are investigated. All approaches are combined with a variety of anchoring methods, such as the “all‐other purified” and “mean p‐value threshold” methods, in two simulation studies based on the Rasch model. Our results indicate that the direct approach generally does not lead to more accurate or even to inferior results than the aggregation rules. The min rule overall shows the best trade‐off between low false alarm rate and medium to high hit rate. However, it might be too sensitive when the number of groups is large. In this case, the all rule may be a good compromise. We also take a closer look at the anchor selection method “next candidate,” which performed rather poorly, and suggest possible improvements.

中文翻译:

多组DIF分析中选择锚定项的聚合规则比较

这项研究解决了如何在多组方案中使用用于差异项功能(DIF)分析的锚定方法的主题。直接方法是将针对两组场景开发的锚定方法与多组DIF检测方法相结合。或者,可以执行多个测试。这些测试的结果需要汇总以确定最终DIF分析的锚点。在这项研究中,直接方法和三个聚合规则进行了研究。在基于Rasch模型的两个模拟研究中,所有方法都与多种锚定方法(例如“所有其他纯化方法”和“平均p值阈值”方法)结合使用。我们的结果表明,直接方法通常不会导致比聚合规则更准确或更差的结果。的最小规则总体上显示了在低误报警率和中高命中率之间的最佳折衷。但是,当组数很大时,它可能过于敏感。在这种情况下,全部规则可能是一个很好的折衷方案。我们还仔细研究了锚点选择方法“下一个候选者”,该方法效果不佳,并提出了可能的改进方案。
更新日期:2019-09-05
down
wechat
bug