Abstract Readers are increasingly exposed to text that includes both words and images through comics, graphic novels, online materials, and video games. In this study, we use the medium of the 4-panel comic strip to examine how readers make meaning of the word/image composite. We propose a cognitive interactive framework that incorporates both the bottom-up constraints of verbal and visual cues and top-down constraints imposed by global narrative structures to assess the contributions of each in the meaning-making process. Previous research has focused more on the qualitative and sociocultural approaches while this study uses cognitive and quantitative perspectives to explore the meaning making of text that includes both words and images. Results of our analyses show that both bottom-up and top-down constraints make significant and separable contributions to the variance in a comprehension task.

中文翻译：

---

漫画阅读任务中的自下而上和自上而下的提示

摘要读者越来越多地通过漫画，图画小说，在线资料和视频游戏接触包含文字和图像的文本。在这项研究中，我们使用4格漫画的媒介来检查读者如何理解单词/图像合成的含义。我们提出了一种认知互动框架，该框架结合了言语和视觉提示的自下而上的约束以及全局叙事结构所施加的自上而下的约束，以评估每种在意义形成过程中的贡献。先前的研究更多地集中在定性和社会文化方法上，而本研究则使用认知和定量的观点来探索包括单词和图像在内的文本的含义。