当前位置: X-MOL 学术Phys. Rev. Phys. Educ. Res. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Detecting the influence of item chaining on student responses to the Force Concept Inventory and the Force and Motion Conceptual Evaluation
Physical Review Physics Education Research ( IF 2.6 ) Pub Date : 
Philip Eaton, Barrett Frank, Shannon Willoughby

Items that are chained, or blocked, together appear on many of the conceptual assessments utilized for physics education research (PER). However, when items are chained together there is the potential to introduce local dependence between those items, which would violate the assumption of item independence required by classical test theory (CTT), unidimensional item response theory (IRT), and other measurement theories. Local dependence can be divided into two categories: (i) underlying local dependence (ULD), which can be adequately modeled with multidimensional measurement theories; (ii) surface local dependence (SLD), which cannot be modeled using multidimensional measurement theories. The act of chaining items is thought to be one of the many potential sources of SLD between items. Using previous local dependence research results, this study proposes two methods for detecting the presence of local dependence and SLD between items on an assessment. These methods were applied to the Force Concept Inventory (FCI) and the Force and Motion Conceptual Evaluation (FMCE). It was found that the assumption of item independence was violated for both assessments, implying that unidimensional measurement theories may not adequately model either the FCI or FMCE. Further, both detection methods identified the potential for a minimal amount of SLD present for FCI and a significant amount of SLD present for the FMCE. This implies that even multidimensional measurement theories may not be capable of adequately modeling the FMCE when scoring items individually. This result supports the claim made by Thornton {et al.} that the items on the FMCE should be scored in groups, however, the currently proposed grading scheme was found to be inadequate.

中文翻译:

检测项目链对学生对“力概念”清单和“力与运动”概念评估的反应的影响

链接在一起或封闭在一起的项目出现在许多用于物理教育研究(PER)的概念评估中。但是,将项目链接在一起时,有可能在这些项目之间引入局部依赖性,这将违反经典测试理论(CTT),一维项目响应理论(IRT)和其他度量理论所要求的项目独立性的假设。本地依赖性可以分为两类:(i)潜在的本地依赖性(ULD),可以使用多维度量理论对其进行充分建模;(ii)表面局部相关性(SLD),无法使用多维测量理论进行建模。链接项目的行为被认为是项目之间SLD的许多潜在来源之一。利用以前的本地依赖研究结果,这项研究提出了两种方法来检测评估项目之间的局部依赖和SLD。这些方法已应用于“力概念清单”(FCI)和“力与运动概念评估”(FMCE)。结果发现,两项评估都违反了项目独立性的假设,这意味着单维度测量理论可能无法充分模拟FCI或FMCE。此外,两种检测方法均确定了FCI存在最小量SLD和FMCE存在大量SLD的可能性。这意味着即使对多维测量理论进行单独计分时,也可能无法充分建模FMCE。这一结果支持了Thornton {et al。}的主张,即FMCE上的项目应分组评分,但是,
更新日期:2020-09-08
down
wechat
bug