当前位置: X-MOL 学术i-Perception › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
i-Perception ( IF 1.492 ) Pub Date : 2020-12-31 , DOI: 10.1177/2041669520981096
Qingqing Li 1 , Qiong Wu 2 , Yiyang Yu , Fengxia Wu , Satoshi Takahashi , Yoshimichi Ejima , Jiajia Yang , Jinglong Wu 3
Affiliation  

Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects.



中文翻译:

语义一致性调节注意负荷对动画图像和声音的视听整合的影响

注意过程在整合来自不同感觉方式的输入中扮演着复杂而多方面的角色。但是,尚不清楚增加的注意力负荷是否会破坏涉及语义内容的常见对象的视听(AV)集成。此外,关于语义一致性如何与注意力负荷相互作用以影响公共对象的AV集成的知识是有限的。我们通过检查各种注意负载条件下的AV集成来调查这些问题。通过采用单感觉(动物图像和声音)和AV刺激(语义一致的AV对象和语义不一致的AV对象)的动物识别任务来评估AV整合,同时通过使用快速串行视觉呈现任务来操纵注意力负荷。我们的结果表明,注意负荷并没有减弱语义一致的AV对象的集成。但是,没有整合语义上不一致的动物声音和图像(因为没有多感官促进),并且通过增加注意力负荷操作降低了语义上不一致的AV对象产生的干扰效果。这些发现凸显了语义一致性在调制注意负载对常见对象的AV集成的影响方面的关键作用。并且通过增加注意力负荷操作减少了语义上不一致的AV对象产生的干扰效果。这些发现凸显了语义一致性在调制注意负载对常见对象的AV集成的影响方面的关键作用。并且通过增加注意力负荷操作减少了语义上不一致的AV对象产生的干扰效果。这些发现凸显了语义一致性在调制注意负载对常见对象的AV集成的影响方面的关键作用。

更新日期:2021-01-04
down
wechat
bug