ABSTRACT

This article reports the first eye-movement experiment to examine how the presence versus absence of concurrent video content and presentation speed affect the reading of subtitles. Results indicated that participants adapted their visual routines to examine video content while simultaneously prioritizing the reading of subtitles, especially when the latter was displayed only briefly. Although decisions about when and where to move the eyes largely remained under local (cognitive) control, this control was also modulated by global task demands, suggesting an integration of local and global eye-movement control. The theoretical and pedagogical implications of these findings are discussed, and we also briefly describe a new theoretical framework for understanding all forms of multimodal reading, including the reading of subtitles in video.

摘要

本文报告了第一个眼动实验，以检查并发视频内容和演示速度的存在与否如何影响字幕的阅读。结果表明，参与者调整了他们的视觉例程来检查视频内容，同时优先阅读字幕，尤其是当后者仅短暂显示时。尽管关于何时何地移动眼睛的决定在很大程度上仍受局部（认知）控制，但这种控制也受到全局任务需求的调节，表明局部和全局眼动控制的整合。讨论了这些发现的理论和教学意义，我们还简要描述了一个新的理论框架，用于理解所有形式的多模式阅读，包括视频中的字幕阅读。