ABSTRACT

Hollywood movies provide continuous audiovisual information. Yet, information conveyed by movies address different sensory systems. For a broad variety of media applications (such as multimedia learning environments) it is important to understand the underlying cognitive principles. This project addresses the interplay of auditory and visual information during movie perception. Because auditory information is known to change basic visual processes, it is possible that movie perception and comprehension depends on stimulus modality. In this project, we report three experiments that studied how humans perceive and remember changes in visual and audiovisual movie clips. We observed basic processes of event perception (event segmentation, change detection, and memory) to be independent of stimulus modality. We thus conclude that event boundary perception is a general perceptual-cognitive mechanism and discuss these findings with respect to current cognitive psychological and media psychological theories.

摘要

好莱坞电影提供连续的视听信息。然而，电影传达的信息涉及不同的感觉系统。对于各种各样的媒体应用程序（例如多媒体学习环境），了解基本的认知原理很重要。该项目致力于解决电影感知过程中听觉和视觉信息之间的相互作用。因为已知听觉信息会改变基本的视觉过程，所以电影的感知和理解可能取决于刺激方式。在这个项目中，我们报告了三个实验，这些实验研究了人类如何感知和记住视觉和视听电影剪辑中的变化。我们观察到事件感知（事件分段，更改检测和记忆）的基本过程与刺激方式无关。