ABSTRACT

The Common European Framework of Reference for Languages Companion Volume (CEFR CV) emphasizes macro-functions of language (i.e., reception, production, interaction, and mediation). However, there seems to be little consensus on whether the macro-functions are commensurable with CEFR-based proficiency tests. This paper focuses on the Examination for the Certificate of Competency in English (ECCE), which is based on the CEFR and assesses high-intermediate level English proficiency. Specifically, the study explores the latent structure of the ECCE and its generalizability across groups (i.e., gender, age, and first language [L1]) to examine its construct validity, dimensionality of language proficiency, and commensurability with the CEFR macro-functions. The latent structure was examined through confirmatory factor analysis using performance scores from 9,700 test-takers. The results indicated that test-takers’ performance on the ECCE could be best represented by a correlated three-factor model (i.e., reading/listening/lexico-grammar, writing, and speaking abilities). The correlated three-factor model also held irrespective of gender, age, and L1 (with the exception of vocabulary scores). Overall, the findings indicate that the correlated three-factor model is consistent with the constructs that the ECCE proposes to measure, is in line with the current multi-componential view of language proficiency, and is partly commensurate with the CEFR macro-functions.

摘要

欧洲共同语言参考体系伴侣卷（CEFR CV）强调了语言的宏观功能（即接收，产生，交互和调解）。但是，关于宏功能是否可以与基于CEFR的能力测试相提并论，似乎尚未达成共识。本文侧重于基于CEFR的英语能力证书考试（ECCE），评估高中级英语水平。具体而言，该研究探讨了ECCE的潜在结构及其在各个群体（即性别，年龄和第一语言[L1]）中的可概括性，以检查其构造效度，语言熟练程度以及与CEFR宏功能的可比性。通过使用来自9,700名应试者的表现评分，通过验证性因素分析来检查潜在结构。结果表明，应试者在ECCE上的表现可以用相关的三因素模型（即阅读/聆听/词典语法，写作和口语能力）最好地表示。不论性别，年龄和L1（词汇得分除外），相关的三因素模型也成立。总体而言，调查结果表明，相关的三因素模型与ECCE提议衡量的结构是一致的，符合当前语言能力的多成分观点，并且部分与CEFR宏功能相对应。结果表明，应试者在ECCE上的表现可以用相关的三因素模型（即阅读/聆听/词典语法，写作和口语能力）最好地表示。不论性别，年龄和L1（词汇分数除外），相关的三因素模型也成立。总体而言，调查结果表明，相关的三因素模型与ECCE提议衡量的结构是一致的，符合当前语言能力的多成分观点，并且部分与CEFR宏功能相对应。结果表明，应试者在ECCE上的表现可以用相关的三因素模型（即阅读/聆听/词典语法，写作和口语能力）最好地表示。不论性别，年龄和L1（词汇分数除外），相关的三因素模型也成立。总体而言，调查结果表明，相关的三因素模型与ECCE提议衡量的结构是一致的，符合当前语言能力的多成分观点，并且部分与CEFR宏功能相对应。