Seeing a talker’s face can aid audiovisual (AV) integration when speech is presented in noise. However, few studies have simultaneously manipulated auditory and visual degradation. We aimed to establish how degrading the auditory and visual signal affected AV integration. Where people look on the face in this context is also of interest; Buchan, Paré and Munhall (Brain Research, 1242, 162–171, 2008) found fixations on the mouth increased in the presence of auditory noise whilst Wilson, Alsius, Paré and Munhall (Journal of Speech, Language, and Hearing Research, 59(4), 601–615, 2016) found mouth fixations decreased with decreasing visual resolution. In Condition 1, participants listened to clear speech, and in Condition 2, participants listened to vocoded speech designed to simulate the information provided by a cochlear implant. Speech was presented in three levels of auditory noise and three levels of visual blurring. Adding noise to the auditory signal increased McGurk responses, while blurring the visual signal decreased McGurk responses. Participants fixated the mouth more on trials when the McGurk effect was perceived. Adding auditory noise led to people fixating the mouth more, while visual degradation led to people fixating the mouth less. Combined, the results suggest that modality preference and where people look during AV integration of incongruent syllables varies according to the quality of information available.

当说话者出现噪音时，看到说话者的脸可以帮助视听（AV）集成。然而，很少有研究同时操纵听觉和视觉退化。我们旨在确定降低听觉和视觉信号如何影响影音整合。人们在这种情况下的脸上表情也很有趣；巴肯，削减和Munhall（脑研究，1242，162-171，2008）发现对嘴听觉噪音而威尔逊，Alsius，削减和Munhall（的存在增加注视期刊的言语，语言和听力研究，59（4），601–615，2016）发现，注视力随着视觉分辨率的降低而降低。在条件1中，参与者收听清晰的语音，而在条件2中，参与者收听旨在模拟耳蜗植入物提供的信息的声码语音。语音以听觉噪声的三个级别和视觉模糊的三个级别来表示。向听觉信号中添加噪声会增加McGurk响应，而使视觉信号模糊会降低McGurk响应。当人们意识到麦格克效应时，参与者将更多的注意力放在试验上。增加听觉噪声会导致人们将嘴巴固定得更多，而视力下降会使人们减少嘴巴的固定。结合起来