当前位置: X-MOL 学术Language Testing › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Understanding writing quality change: A longitudinal study of repeaters of a high-stakes standardized English proficiency test
Language Testing ( IF 2.400 ) Pub Date : 2020-06-28 , DOI: 10.1177/0265532220925448
You-Min Lin 1 , Michelle Y. Chen 1
Affiliation  

This study examined the writing score and writing feature changes of 562 repeat test takers who took the Canadian English Language Proficiency Index Program–General (CELPIP–General) test at least three times, with a short (30–40 day) interval between the first and second attempts and a longer (90–180 day) interval between the first and third attempts. Analysis was conducted to uncover whether changes occurred at different testing durations (short vs. long) and whether the observed changes varied across repeater’s initial proficiency groups (low, mid, high). The writing scores measured by CELPIP bands showed great stability over the 6-month period, but the trends of development differed by proficiency group. Low proficiency test takers were more likely to have faster observable score gains, compared to the medium proficiency group, whereas high proficiency repeaters may not maintain their score levels at later attempts. Writing quality was analyzed using natural language processing (NLP) tools. Results suggested that for all proficiency groups, lexical features were more likely to improve over the 6-month period, with some measures showing improvement at 1 month; features in cohesion and syntactic sophistication, however, did not change significantly.

中文翻译:

理解写作质量的变化:对高风险标准化英语水平测试复读者的纵向研究

本研究调查了 562 名参加加拿大英语语言能力指数计划-通用 (CELPIP-General) 测试至少 3 次的重试者的写作分数和写作特征变化,第一次测试之间的间隔很短(30-40 天)。第二次尝试和第一次和第三次尝试之间的间隔更长(90-180 天)。进行了分析以发现不同测试持续时间(短与长)是否发生变化,以及观察到的变化是否因中继器的初始熟练程度组(低、中、高)而异。CELPIP 测试的写作分数在 6 个月内表现出很大的稳定性,但不同能力组的发展趋势有所不同。与中等熟练程度组相比,低熟练程度应试者更有可能获得更快的可观察到的分数增长,而高熟练度的复读者在以后的尝试中可能无法保持他们的分数水平。使用自然语言处理 (NLP) 工具分析写作质量。结果表明,对于所有熟练程度组,词汇特征在 6 个月内更有可能得到改善,一些措施显示在 1 个月时有所改善;然而,内聚和句法复杂性的特征没有显着变化。
更新日期:2020-06-28
down
wechat
bug