ABSTRACT

Full-information item analysis provides item developers and reviewers comprehensive empirical evidence of item quality, including option response frequency, point-biserial index (PBI) for distractors, mean-scores of respondents selecting each option, and option trace lines. The multi-serial index (MSI) is introduced as a more informative item-total correlation, accounting for variable distractor performance. The overall item PBI is empirically compared to the MSI. For items from an operational mathematics and reading test, poorly performing distractors are systematically removed to recompute the MSI, indicating improvements in item quality. Case studies for specific items with different characteristics are described to illustrate a variety of outcomes, focused on improving item discrimination. Full-information item analyses are presented for each case study item, providing clear examples of interpretation and use of item analyses. A summary of recommendations for item analysts is provided.

摘要

全信息项目分析为项目开发人员和审查人员提供了项目质量的综合经验证据，包括选项响应频率、干扰项的点双列指数 (PBI)、选择每个选项的受访者的平均分数以及选项跟踪线。多序列索引 (MSI) 被引入作为信息更多的项目-总相关性，考虑可变干扰器性能。整体项目 PBI 根据经验与 MSI 进行比较。对于来自操作数学和阅读测试的项目，系统地删除表现不佳的干扰项以重新计算 MSI，表明项目质量有所提高。描述了具有不同特征的特定项目的案例研究，以说明各种结果，重点是提高项目辨别力。每个案例研究项目都提供了完整的信息项目分析，提供了解释和使用项目分析的清晰示例。提供了对项目分析师的建议摘要。