当前位置: X-MOL 学术J. Educ. Behav. Stat. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Aggregate-Level Test-Scale Linking: A New Solution for an Old Problem?
Journal of Educational and Behavioral Statistics ( IF 2.116 ) Pub Date : 2020-10-01 , DOI: 10.3102/1076998620960089
Tim Moses 1 , Neil J. Dorans 2
Affiliation  

The Reardon, Kalogrides, and Ho article on validation methods for aggregate-level test scale linking is an attempt to validate a district-level scale aligning procedure that appears to be a new solution to an old problem. Their aligning procedure uses the National Assessment of Educational Progress (NAEP) scale to piece together a patchwork of data structures from different tests of different constructs obtained under different administration conditions and used in different ways by different states. In this article, we critique their linking and validation efforts. Our critique has three components. First, we review the recommendations for linking state assessments to NAEP from several studies and commentaries to provide background from which to interpret Reardon et al.’s validation attempts. Second, we provide a replication of the Reardon et al. empirical validations of its proposed linking procedure to demonstrate that correlations between district means on two test scores can be high even when (1) the constructs being measured by the tests are different and (2) the district-level means estimated using the Reardon et al. linking approach can differ substantially from actual district-level means. Then, we suggest additional checks for construct similarity and subpopulation invariance from other concordance studies that could be used to assess whether the inferences made by Reardon et al. are warranted. Finally, until such checks are made, we urge cautious use of the results of the Reardon et al. results.



中文翻译:

聚合级测试规模链接:旧问题的新解决方案?

关于聚合级别的测试规模链接的验证方法的Reardon,Kalogrides和Ho文章是试图验证地区级别的规模调整过程的尝试,该过程似乎是对旧问题的新解决方案。他们的调整程序使用国家教育进步评估(NAEP)量表,将来自在不同管理条件下获得的,由不同州以不同方式使用的不同构造的不同测试的数据结构拼凑而成。在本文中,我们对它们的链接和验证工作进行了评论。我们的批评分为三个部分。首先,我们回顾了几项研究和评论中有关将州评估与NAEP联系起来的建议,以提供背景来解释Reardon等人的验证尝试。其次,我们提供了Reardon等人的副本。其提议的链接程序的经验验证,以证明即使在以下情况下,两个测试得分上的地区均值之间的相关性也可能很高:(1)测试所测结构不同,以及(2)使用Reardon等人估计的地区级均值。链接方法可能与实际的区级方法大不相同。然后,我们建议从其他一致性研究中对构建相似性和亚群不变性进行其他检查,这些研究可用于评估是否由Reardon等人进行了推断。是有保证的。最后,在进行此类检查之前,我们敦促谨慎使用Reardon等人的结果。结果。

更新日期:2020-10-01
down
wechat
bug