当前位置: X-MOL 学术System › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A review of the methodological quality of quantitative mobile-assisted language learning research
System ( IF 4.518 ) Pub Date : 2021-06-11 , DOI: 10.1016/j.system.2021.102568
Zhuohan Hou , Vahid Aryadoust

Mobile-assisted language learning (MALL) is a novel approach to language learning and teaching. The present study aims to review the methodological quality of quantitative MALL research by focusing on the applications of statistical techniques and instrument reliability and validity. A total of 174 papers within 41 journals identified using the Scopus database were screened and coded. Of these, 77 quantitative MALL studies that investigated English as a foreign or second language using mobile devices met the inclusion criteria. In the full-text screening, each study was coded for the statistical techniques applied, assumptions reported, reliability and validity investigation of the instruments and coding practices used. The results show the ubiquity of the general linear model (GLM) (i.e., mean-based data analysis, such as t-test, univariate analysis of variances (ANOVA), multivariate analysis of variances (MANOVA)), with 61.40% of the analyzed studies using this statistical method. Notably, the majority of studies that used GLM did not report confirmation of the fundamental assumptions (i.e., normality, homogeneity of variance, and linearity) of such analysis. In addition, a reliance of null hypothesis significance testing was observed without reporting of the practical significance of the investigated effect or relations (effect size). Lastly, less than half of MALL studies reported reliability and even fewer studies reported validity evidence, indicating a lack of evidence of the precision, meaningfulness of data, and accuracy of many of the measurement instruments used. Implications of these findings for MALL research are discussed, with several suggestions for future research.



中文翻译:

定量移动辅助语言学习研究的方法学质量综述

移动辅助语言学习 (MALL) 是一种新颖的语言学习和教学方法。本研究旨在通过关注统计技术和仪器信度和效度的应用来审查定量 MALL 研究的方法学质量。对使用 Scopus 数据库确定的 41 种期刊中的 174 篇论文进行了筛选和编码。其中,使用移动设备将英语作为外语或第二语言进行调查的 77 项定量 MALL 研究符合纳入标准。在全文筛选中,每项研究都针对应用的统计技术、报告的假设、工具的可靠性和有效性调查以及所使用的编码实践进行编码。结果显示了通用线性模型(GLM)的普遍性(即基于均值的数据分析,例如- 检验、单变量方差分析 (ANOVA)、多变量方差分析 (MANOVA)),61.40% 的分析研究使用这种统计方法。值得注意的是,大多数使用 GLM 的研究没有报告对此类分析的基本假设(即正态性、方差同质性和线性)的确认。此外,在没有报告所研究的效应或关系(效应大小)的实际意义的情况下,观察到了对零假设显着性检验的依赖。最后,只有不到一半的 MALL 研究报告了可靠性,甚至更少的研究报告了有效性证据,这表明缺乏数据的准确性、意义和使用的许多测量工具的准确性的证据。讨论了这些发现对 MALL 研究的影响,

更新日期:2021-06-11
down
wechat
bug