当前位置: X-MOL 学术Multisensory Research › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Orienting Auditory Attention through Vision: the Impact of Monaural Listening
Multisensory Research ( IF 1.8 ) Pub Date : 2021-08-11 , DOI: 10.1163/22134808-bja10059
Silvia Turri 1, 2 , Mehdi Rizvi 3 , Giuseppe Rabini 1 , Alessandra Melonio 3 , Rosella Gennari 3 , Francesco Pavani 1, 4
Affiliation  

The understanding of linguistic messages can be made extremely complex by the simultaneous presence of interfering sounds, especially when they are also linguistic in nature. In two experiments, we tested if visual cues directing attention to spatial or temporal components of speech in noise can improve its identification. The hearing-in-noise task required identification of a five-digit sequence (target) embedded in a stream of time-reversed speech. Using a custom-built device located in front of the participant, we delivered visual cues to orient attention to the location of target sounds and/or their temporal window. In Exp. 1 ( n = 14), we validated this visual-to-auditory cueing method in normal-hearing listeners, tested under typical binaural listening conditions. In Exp. 2 ( n = 13), we assessed the efficacy of the same visual cues in normal-hearing listeners wearing a monaural ear plug, to study the effects of simulated monaural and conductive hearing loss on visual-to-auditory attention orienting. While Exp. 1 revealed a benefit of both spatial and temporal visual cues for hearing in noise, Exp. 2 showed that only the temporal visual cues remained effective during monaural listening. These findings indicate that when the acoustic experience is altered, visual-to-auditory attention orienting is more robust for temporal compared to spatial attributes of the auditory stimuli. These findings have implications for the relation between spatial and temporal attributes of sound objects, and when planning devices to orient audiovisual attention for subjects suffering from hearing loss.



中文翻译:

通过视觉定向听觉注意力:单耳聆听的影响

干扰声音的同时存在会使对语言信息的理解变得极其复杂,尤其是当它们本质上也是语言的时候。在两个实验中,我们测试了将注意力引向噪声中语音的空间或时间成分的视觉线索是否可以提高其识别能力。噪声中的听觉任务需要识别嵌入时间反转语音流中的五位数序列(目标)。使用位于参与者面前的定制设备,我们提供视觉提示以将注意力定向到目标声音的位置和/或其时间窗口。在进出口。1 ( n = 14),我们在典型的双耳聆听条件下测试了正常听力听众的这种视觉到听觉提示方法。在进出口。2 ( n = 13),我们评估了相同视觉提示在佩戴单耳耳塞的正常听力听众中的效果,以研究模拟单耳和传导性听力损失对视觉到听觉注意力定向的影响。虽然进出口。1 揭示了空间和时间视觉线索对噪声中听觉的好处,Exp。图 2 显示在单耳聆听期间只有时间视觉提示仍然有效。这些发现表明,当听觉体验发生变化时,与听觉刺激的空间属性相比,视觉到听觉的注意力定向在时间上更为稳健。这些发现对声音对象的空间和时间属性之间的关系以及规划设备以定向听力损失对象的视听注意力具有影响。

更新日期:2021-08-11
down
wechat
bug