当前位置: X-MOL 学术Language Testing › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Predicting communicative effectiveness in the international workplace: Support for TOEIC® Speaking test scores from linguistic laypersons
Language Testing ( IF 2.400 ) Pub Date : 2020-07-21 , DOI: 10.1177/0265532220941803
Jonathan Schmidgall 1 , Donald E. Powers 1
Affiliation  

In this study we examined the extent to which TOEIC® Speaking test scores relate to evaluations by professionals in the international workplace, the target language use domain of TOEIC tests. Linguistic laypersons in 10 countries were invited to participate in an online research survey. The survey incorporated a stratified sample of test-taker (N = 99) responses to three representative tasks from the TOEIC Speaking test (reading a text aloud, responding to questions, expressing an opinion) that were cast as workplace role-play tasks. After completing each role-play task, participants used brief, descriptive six-point rating scales to rate the communicative effectiveness (comprehensibility, task fulfillment, elaboration, and coherence) of each of several speakers. Communicative effectiveness ratings from linguistic laypersons were strongly correlated with TOEIC Speaking test scaled scores (r = 0.84). In addition, regression analysis was used to plot the relationship between layperson and test-based evaluations of speaking proficiency. Results suggested that test takers’ performances can be expected to be perceived as effective at score ranges typically associated with important decisions. The results are discussed in terms of their implications for claims about the generalizability of TOEIC Speaking test score interpretations in relation to the evaluations of linguistic laypersons in the international workplace.



中文翻译:

支持:在国际职场交际预测效力TOEIC ®从语言的外行人口试成绩

在这项研究中,我们研究了TOEIC®口语考试成绩与国际工作场所专业人员(TOEIC考试的目标语言使用领域)的评估相关的程度。邀请了10个国家/地区的语言非专业人士参加在线研究调查。调查纳入了分层的考生样本(N= 99)对TOEIC口语测验中的三个代表性任务(大声朗读文章,回答问题,表达意见)的回应,被认为是工作场所的角色扮演任务。在完成每个角色扮演任务后,参与者使用简短的描述性六点评估量表来评估几个发言人的交流效果(可理解性,任务完成,精心制作和连贯性)。语言外行人的沟通效果评分与TOEIC口语测验量表评分密切相关(r= 0.84)。此外,使用回归分析来绘制外行人和基于测试的口语能力评估之间的关系。结果表明,应试者的表现在通常与重要决策相关的分数范围内可以被认为是有效的。讨论的结果涉及对托业口语考试成绩解释的普遍性主张的影响,这些说法与国际工作场所中语言非专业人士的评估有关。

更新日期:2020-07-21
down
wechat
bug