ABSTRACT Recent educational and psychological research has highlighted shifting workplace requirements and change required to equip the emerging workforce with skills for the 21st century. The emergence of these highlights the issues, and drives the importance, of new methods of assessment. This study addresses some of the issues by describing a scoring process for measuring collaborative problem solving (CPS) in online environments. The method presented, from conceptualization to implementation, centers on its generalizable application, presenting a systematic process of identifying, coding, and scoring behavior patterns in log stream data generated from assessments. Item Response Theory was used to investigate the psychometric properties of behavior patterns. The goal of this study was to present an approach that informs new measurement practices in relation to sociocognitive latent traits and their processes. The generalized scoring process provides an efficient approach to develop measures of social and cognitive skills in online environments.

中文翻译：

---

在线环境中衡量协作问题解决能力的广义评分过程

摘要最近的教育和心理研究突出了不断变化的工作场所要求和所需的变革，以使新兴劳动力具备21世纪的技能。这些问题的出现突出了新评估方法的问题，并推动了其重要性。本研究通过描述评估在线环境中协作问题解决（CPS）的评分过程来解决某些问题。从概念化到实现，所提出的方法均以其可推广应用为中心，并提出了一种系统的过程，该过程可对评估产生的日志流数据中的行为模式进行识别，编码和评分。项目反应理论被用来研究行为模式的心理测量特性。这项研究的目的是提出一种方法，为与社会认知潜伏性状及其过程有关的新测量方法提供信息。广义的评分过程提供了一种有效的方法来开发在线环境中社交和认知技能的度量。