当前位置: X-MOL 学术Multisensory Research › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
How Are Audiovisual Simultaneity Judgments Affected by Multisensory Complexity and Speech Specificity?
Multisensory Research ( IF 1.6 ) Pub Date : 2020-07-28 , DOI: 10.1163/22134808-bja10031
Tsunagu Ikeda 1, 2 , Masanao Morishita 1
Affiliation  

While stimulus complexity is known to affect the width of the temporal integration window (TIW), a quantitative evaluation of ecologically highly valid stimuli has not been conducted. We assumed that the degree of complexity is determined by the obviousness of the correspondence between the auditory onset and visual movement, and we evaluated the audiovisual complexity using video clips of a piano, a shakuhachi flute and human speech. In Experiment 1, a simultaneity judgment task was conducted using these three types of stimuli. The results showed that the width of TIW was wider for speech, compared with the shakuhachi and piano. Regression analysis revealed that the width of the TIW depended on the degree of complexity. In the second experiment, we investigated whether or not speech-specific factors affected the temporal integration. We used stimuli that either contained natural-speech sounds or white noise. The results revealed that the width of the TIW was wider for natural sentences, compared with white noise. Taken together, the width of the TIW might be affected by both the complexity and speech specificity.

中文翻译:

多感官复杂性和语音特异性如何影响视听同时性判断?

虽然已知刺激复杂性会影响时间整合窗口(TIW)的宽度,但尚未对生态高度有效的刺激进行定量评估。我们假设复杂程度是由听觉发作和视觉运动之间的对应关系的明显程度决定的,并且我们使用钢琴,尺八长笛和人类语音的视频剪辑评估了视听复杂性。在实验1中,使用这三种刺激进行了同时判断任务。结果表明,与尺八和钢琴相比,TIW的语音宽度更宽。回归分析表明,TIW的宽度取决于复杂程度。在第二个实验中,我们调查了特定于语音的因素是否影响时间整合。我们使用了包含自然语音或白噪声的刺激。结果表明,与白噪声相比,自然句子的TIW宽度更宽。两者合计,TIW的宽度可能同时受复杂性和语音特异性的影响。
更新日期:2020-07-28
down
wechat
bug