ABSTRACT

Buros’ Mental Measurements Yearbook (MMY) has provided professional reviews of commercially published psychological and educational tests for over 80 years. It serves as a kind of conscience for the testing industry. For a random sample of 50 entries in the 19th MMY (a total of 100 separate reviews) this study determined the level of qualitative judgment rendered by reviewers and the consistency of those independent reviewers in rendering judgments. Judgments of quality distributed themselves almost uniformly from very good to very bad across the 100 reviews. Agreement among reviewers for a given test was positive but relatively weak. We explore implications of the results and suggest follow-up investigations.

摘要

80 多年来，Buros 的心理测量年鉴( MMY ) 一直为商业出版的心理和教育测试提供专业评论。它是测试行业的一种良知。对于第19 届 MMY 中的 50 个条目的随机样本（总共 100 个单独的评论），该研究确定了评论者做出的定性判断的水平以及这些独立评论者做出判断的一致性。质量判断在 100 条评论中几乎均匀地从非常好到非常差。评审员对给定测试的一致意见是积极的，但相对较弱。我们探索结果的影响并建议后续调查。