当前位置: X-MOL 学术Comput. Educ. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Effect sizes and research directions of peer assessments: From an integrated perspective of meta-analysis and co-citation network
Computers & Education ( IF 8.9 ) Pub Date : 2021-01-06 , DOI: 10.1016/j.compedu.2020.104123
Ching-Yi Chang , De-Chih Lee , Kai-Yu Tang , Gwo-Jen Hwang

Peer assessments (PA) have been widely explored by researchers over the past few decades. However, their impact on various learning environments remains unclear. Based on a meta-analysis, this study aimed to analyze PA-based research performed across multiple learning environments. Unlike existing meta-analyses, however, this study integrated co-citation network analysis with the meta-analysis to examine the bibliometric relationships between the analyzed studies. This method provides citation-based evidence to secure the association of research data for conducting the meta-analysis. In addition, the visualized research network offers a fresh micro-to-macro understanding of the PA literature. A total of 20 PA-related core articles consisting of their follow-up 340 citing studies were collected based on systematic keyword searches. All analyzed articles were published between 1998 and 2020, and were sourced from two renowned databases, the Web of Science and Scopus, in order to maintain the quality of the data used for this present research. The main findings are twofold. First, the meta-analysis reported that the standard error at the 95% confidence interval for the average difference between the experimental and control groups is [0.288, 0.424], indicating that each effect value in the meta-analysis is heterogeneous. We also found that technology combined with PA teaching methods has certain learning effects in the contexts of web-based problem-solving activities. In addition, following Fu and Hwang's (2018) constructivist theoretical framework, we propose some criteria for conducting peer assessment research. Second, the co-citation network analysis presented a visualized networking structure of 20 PA articles, of which 11 were bibliographically connected. This result echoed the previous research by reviewing the relationships between the studies in the meta-analysis. Moreover, the co-citation network of PA research reveals some heavy co-citation links from the 11 core articles. The results further identified the main research foci include combining PA with technology-enhanced learning environments (e.g., game- and web-based learning) and PA activities for collaborative learning in the field. In conclusion, this study presents an innovative approach to examining the effects of empirical PA studies and, accordingly, offers discussions and directions for future research.



中文翻译:

同行评估的影响规模和研究方向:从荟萃分析和共引网络的综合角度

在过去的几十年中,研究人员广泛地探索了对等评估(PA)。但是,它们对各种学习环境的影响仍然不清楚。基于荟萃分析,本研究旨在分析跨多种学习环境进行的基于PA的研究。但是,与现有的荟萃分析不同,本研究将共引证网络分析与荟萃分析相结合,以检查所分析研究之间的文献计量关系。该方法提供了基于引文的证据,以确保进行荟萃分析的研究数据的关联。此外,可视化的研究网络提供了对PA文献的全新的微观到宏观的了解。基于系统的关键词搜索,共收集了20篇与PA相关的核心文章,包括其340篇后续研究。所有被分析的文章都发表于1998年至2020年之间,并且均来自两个著名的数据库,即Web of Science和Scopus,以保持用于本研究的数据的质量。主要发现有两个方面。首先,荟萃分析报告说,实验组和对照组之间的平均差异在95%置信区间的标准误为[0.288,0.424],这表明荟萃分析中的每个效应值都是异质的。我们还发现,结合基于PA的教学方法的技术在基于Web的问题解决活动的上下文中具有一定的学习效果。此外,根据Fu和Hwang(2018)的建构主义理论框架,我们提出了进行同行评估研究的一些标准。第二,共引网络分析显示了20篇PA文章的可视化网络结构,其中11篇按书目连接。该结果通过回顾荟萃分析中各个研究之间的关系,与之前的研究相呼应。此外,PA研究的共引网络揭示了11篇核心文章中的一些重要的共引链接。结果进一步确定了主要的研究重点,包括将PA与技术增强的学习环境(例如基于游戏和基于Web的学习)相结合,以及将PA活动用于该领域的协作学习。总而言之,本研究提出了一种创新的方法来检验PA经验研究的效果,并因此为将来的研究提供了讨论和方向。该结果通过回顾荟萃分析中各个研究之间的关系,与之前的研究相呼应。此外,PA研究的共引网络揭示了11篇核心文章中的一些重要的共引链接。结果进一步确定了主要的研究重点,包括将PA与技术增强的学习环境(例如基于游戏和基于Web的学习)相结合,以及将PA活动用于该领域的协作学习。总而言之,本研究提出了一种创新的方法来检验PA经验研究的效果,并因此为将来的研究提供了讨论和方向。该结果通过回顾荟萃分析中各个研究之间的关系,与之前的研究相呼应。此外,PA研究的共引网络揭示了11篇核心文章中的一些重要的共引链接。结果进一步确定了主要的研究重点,包括将PA与技术增强的学习环境(例如基于游戏和基于Web的学习)相结合,以及将PA活动用于该领域的协作学习。总而言之,本研究提出了一种创新的方法来检验PA经验研究的效果,并因此为将来的研究提供了讨论和方向。结果进一步确定了主要的研究重点,包括将PA与技术增强的学习环境(例如基于游戏和基于Web的学习)相结合,以及将PA活动用于该领域的协作学习。总而言之,本研究提出了一种创新的方法来检验PA经验研究的效果,并因此为将来的研究提供了讨论和方向。结果进一步确定了主要的研究重点,包括将PA与技术增强的学习环境(例如基于游戏和基于Web的学习)相结合,以及将PA活动用于该领域的协作学习。总而言之,本研究提出了一种创新的方法来检验PA经验研究的效果,并因此为将来的研究提供了讨论和方向。

更新日期:2021-01-16
down
wechat
bug