当前位置: X-MOL 学术Large-scale Assessments in Education › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Process data, the new frontier for assessment development: rich new soil or a quixotic quest?
Large-scale Assessments in Education Pub Date : 2021-01-04 , DOI: 10.1186/s40536-020-00092-z
Stephen Provasnik

This paper presents the concepts and observations in the author’s keynote address at the May 2019 “Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments” conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on process data in Washington, DC, and suggests some common terminology and concepts for facilitating future meaningful discussion. It then borrows some concepts from evolutionary biologists to take a critical look at process data and some of its ethical implications before turning to discuss major applications for and challenges of using process data and logfiles. The second half of this paper then maps out the terrain in which process data emerges as a “byproduct” of the shift from paper-and-pencil testing to digital-based assessments (DBA) and looks closely at how process data interacts with the development and operationalization of assessment systems. This interaction suggests new, fresh ways of improving national and international assessment system processes, and ultimately the measurement of cognitive skills, while venturing into the new frontiers opened with process data.



中文翻译:

处理数据,评估开发的新领域:丰富的新土壤还是对吉卜赛人的追求?

本文在爱尔兰都柏林举行的2019年5月的“机遇与挑战:探索国际大规模评估中日志文件和过程数据的使用”会议的主题演讲中介绍了概念和观察。本文简要回顾了2018年12月在华盛顿特区举行的ETS过程数据研讨会上出现的一些关键点,并提出了一些通用的术语和概念,以促进未来的有意义的讨论。然后,它从进化生物学家那里借来了一些概念,对过程数据及其伦理意义进行了批判性研究,然后转向讨论使用过程数据和日志文件的主要应用和面临的挑战。然后,本文的下半部分绘制了过程数据作为从纸笔测试到基于数字的评估(DBA)转变的“副产品”出现的地形,并仔细研究了过程数据如何与开发交互和评估系统的运作。这种互动提出了改进国家和国际评估系统过程的新方法,并最终改善了认知技能的测量,同时探索了过程数据打开的新领域。

更新日期:2021-01-04
down
wechat
bug