当前位置: X-MOL 学术Educational Measurement: Issues and Practice › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
What are the Conditions Associated with Subscore Added Value Noninvariance? Implications for Improving Subscore Interpretation Fairness
Educational Measurement: Issues and Practice ( IF 2.7 ) Pub Date : 2020-08-03 , DOI: 10.1111/emip.12379
Joseph A. Rios 1 , Alejandra A. Miranda 1
Affiliation  

Subscore added value analyses assume invariance across test taking populations; however, this assumption may be untenable in practice as differential subdomain relationships may be present among subgroups. The purpose of this simulation study was to understand the conditions associated with subscore added value noninvariance when manipulating: (a) subdomain test length, (b) differences in subgroup mean ability, and (c) subgroup differences in intersubdomain correlations. Results demonstrated that subscore added value was noninvariant for 24–100% of replications (depending on subdomain test length) when the subgroup difference in intersubdomain correlation was equal to .30. To examine if this condition was met in practice, applied invariance analyses of three operational testing programs were conducted. Across these datasets, noninvariant subscore added value was present for some subdomains across sex and ethnic subgroups. Overall, these results indicate that subscore added value noninvariance is largely driven by differential intersubdomain correlations among subgroups, which may be present in some operational testing programs.

中文翻译:

与Subscore附加值不变性相关的条件是什么?对提高子成绩解释公平性的启示

Subscore增值分析假设参加应试的人群不变。但是,由于子组之间可能存在不同的子域关系,因此该假设在实践中可能站不住脚。本模拟研究的目的是了解操纵时与子评分增加值不变性相关的条件:(a)子域测试长度,(b)子组平均能力的差异以及(c)子域间相关性的子组差异。结果表明,当子域间相关性的子组差异等于0.30时,子分数增加值对于24-100%的复制是不变的(取决于子域测试长度)。为了检查此条件是否在实践中得到满足,对三个操作测试程序进行了应用不变性分析。在这些数据集中,跨性别和种族子群体的某些子域存在非不变的子得分附加值。总体而言,这些结果表明,子评分增加值的不变性很大程度上是由子组之间子域间差异的相关性驱动的,某些操作测试程序中可能存在这种差异。
更新日期:2020-08-03
down
wechat
bug