ABSTRACT We investigated the use of adaptive comparative judgment to evaluate the middle school student learning, engagement, and experience with the design process in an open-ended problem assigned in a technology and engineering education course. Our results indicate that the adaptive comparative judgment tool effectively facilitated the grading of the students’ products and improved the judges’ understanding of the processes the students used to arrive at their solutions. We found the reliability and validity of the tool to be acceptable and the outcomes of our study suggest that there is justification for the use of the adaptive comparative judgment method to assess student learning outcomes at multiple levels of Science, Technology, Engineering, and Math (STEM) education.

中文翻译：

---

自适应比较判断作为评估开放式设计问题和模型推广活动的工具

摘要我们调查了使用自适应比较判断法来评估中学生在技术和工程教育课程中分配的开放性问题中对设计过程的学习，参与和经验。我们的结果表明，自适应比较判断工具有效地促进了学生产品的评分，并提高了法官对学生用来解决问题的过程的理解。我们发现该工具的可靠性和有效性是可以接受的，并且我们的研究结果表明，使用自适应比较判断方法评估科学，技术，工程和数学多个层次上的学生学习成果是合理的（ STEM）教育。