An assumption underlying replacing traditional paper-based (PB) writing tests with computer-based (CB) tests is that CB writing tests are more authentic than PB tests (Lessien, 2013). This study tested this assumption by examining the effect of test mode on the situational and interactive authenticity of English as a second language (ESL) writing assessments using an embedded correlational model of mixed-methods design. Sixty international ESL students enrolled at a university in the United States completed two writing tasks in the CB and PB modes. The participants then filled out cognitive processing questionnaires and participated in a post-test interview. All essays were scored by two raters both holistically and analytically. The results indicated higher authenticity for the CB test but also uncovered some concerns with the effect of typing skills on CB test performance. The findings have practical implications for test development, administration policies, and stakeholders in choosing delivery mode for ESL writing assessments.

用基于计算机的 (CB) 测试取代传统的纸基 (PB) 写作测试的一个假设是 CB 写作测试比 PB 测试更真实 (Lessien, 2013)。本研究使用混合方法设计的嵌入式相关模型，通过检查测试模式对英语作为第二语言 (ESL) 写作评估的情境和互动真实性的影响来测试这一假设。60 名在美国大学注册的国际 ESL 学生完成了 CB 和 PB 模式的两项写作任务。然后参与者填写认知处理问卷并参加测试后访谈。所有论文均由两名评分员从整体和分析方面进行评分。结果表明 CB 测试具有更高的真实性，但也揭示了对打字技能对 CB 测试性能影响的一些担忧。研究结果对测试开发、管理政策和利益相关者为 ESL 写作评估选择交付模式具有实际意义。