当前位置:
X-MOL 学术
›
Multisensory Research
›
论文详情
Our official English website, www.x-mol.net, welcomes your
feedback! (Note: you will need to create a separate account there.)
Crossmodal Correspondence Between Tonal Hierarchy and Visual Brightness: Associating Syntactic Structure and Perceptual Dimensions Across Modalities
Multisensory Research ( IF 1.8 ) Pub Date : 2020-05-13 , DOI: 10.1163/22134808-bja10006 Neta B Maimon 1 , Dominique Lamy 1, 2 , Zohar Eitan 3
Multisensory Research ( IF 1.8 ) Pub Date : 2020-05-13 , DOI: 10.1163/22134808-bja10006 Neta B Maimon 1 , Dominique Lamy 1, 2 , Zohar Eitan 3
Affiliation
Crossmodal correspondences (CMC) systematically associate perceptual
dimensions in different sensory modalities (e.g., auditory pitch and visual
brightness), and affect perception, cognition, and action. While previous work
typically investigated associations between basic perceptual dimensions, here
we present a new type of CMC, involving a high-level, quasi-syntactic schema:
music tonality. Tonality governs most Western music and regulates stability and
tension in melodic and harmonic progressions. Musicians have long associated
tonal stability with non-auditory domains, yet such correspondences have hardly
been investigated empirically. Here, we investigated CMC between tonal
stability and visual brightness, in musicians and in non-musicians, using
explicit and implicit measures. On the explicit test, participants heard a
tonality-establishing context followed by a probe tone, and matched each probe
to one of several circles, varying in brightness. On the implicit test, we
applied the Implicit Association Test to auditory (tonally stable or unstable
sequences) and visual (bright or dark circles) stimuli. The findings indicate
that tonal stability is associated with visual brightness both explicitly and
implicitly. They further suggest that this correspondence depends only
partially on conceptual musical knowledge, as it also operates through fast,
unintentional, and arguably automatic processes in musicians and non-musicians
alike. By showing that abstract musical structure can establish concrete
connotations to a non-auditory perceptual domain, our results open a hitherto
unexplored avenue for research, associating syntactical structure with
connotative meaning.
中文翻译:
色调层次和视觉亮度之间的跨模态对应:关联句法结构和跨模态的感知维度
跨模态对应 (CMC) 系统地关联不同感官模式中的感知维度(例如,听觉音调和视觉亮度),并影响感知、认知和行动。虽然以前的工作通常调查基本感知维度之间的关联,但在这里我们提出了一种新型的 CMC,涉及高级、准句法模式:音乐调性。音调支配着大多数西方音乐,并调节旋律和和声进行的稳定性和张力。长期以来,音乐家一直将音调稳定性与非听觉领域联系起来,但几乎没有对这种对应关系进行实证研究。在这里,我们使用显式和隐式测量研究了音乐家和非音乐家的音调稳定性和视觉亮度之间的 CMC。在显式测试中,参与者听到一个建立音调的上下文,然后是探测音,并将每个探测与几个圆圈中的一个相匹配,这些圆圈的亮度各不相同。在隐性测试中,我们将隐性关联测试应用于听觉(音调稳定或不稳定序列)和视觉(亮眼或黑眼圈)刺激。研究结果表明,色调稳定性与视觉亮度显式和隐式相关。他们进一步表明,这种对应仅部分取决于概念音乐知识,因为它也通过快速、无意识且可以说是自动的过程在音乐家和非音乐家中起作用。通过表明抽象的音乐结构可以为非听觉感知领域建立具体的内涵,我们的结果开辟了一条迄今为止尚未探索的研究途径,
更新日期:2020-05-13
中文翻译:
色调层次和视觉亮度之间的跨模态对应:关联句法结构和跨模态的感知维度
跨模态对应 (CMC) 系统地关联不同感官模式中的感知维度(例如,听觉音调和视觉亮度),并影响感知、认知和行动。虽然以前的工作通常调查基本感知维度之间的关联,但在这里我们提出了一种新型的 CMC,涉及高级、准句法模式:音乐调性。音调支配着大多数西方音乐,并调节旋律和和声进行的稳定性和张力。长期以来,音乐家一直将音调稳定性与非听觉领域联系起来,但几乎没有对这种对应关系进行实证研究。在这里,我们使用显式和隐式测量研究了音乐家和非音乐家的音调稳定性和视觉亮度之间的 CMC。在显式测试中,参与者听到一个建立音调的上下文,然后是探测音,并将每个探测与几个圆圈中的一个相匹配,这些圆圈的亮度各不相同。在隐性测试中,我们将隐性关联测试应用于听觉(音调稳定或不稳定序列)和视觉(亮眼或黑眼圈)刺激。研究结果表明,色调稳定性与视觉亮度显式和隐式相关。他们进一步表明,这种对应仅部分取决于概念音乐知识,因为它也通过快速、无意识且可以说是自动的过程在音乐家和非音乐家中起作用。通过表明抽象的音乐结构可以为非听觉感知领域建立具体的内涵,我们的结果开辟了一条迄今为止尚未探索的研究途径,