当前位置: X-MOL 学术Atten. Percept. Psychophys. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Explaining face-voice matching decisions: The contribution of mouth movements, stimulus effects and response biases
Attention, Perception, & Psychophysics ( IF 1.7 ) Pub Date : 2021-04-01 , DOI: 10.3758/s13414-021-02290-5
Nadine Lavan , Harriet Smith , Li Jiang , Carolyn McGettigan

Previous studies have shown that face-voice matching accuracy is more consistently above chance for dynamic (i.e. speaking) faces than for static faces. This suggests that dynamic information can play an important role in informing matching decisions. We initially asked whether this advantage for dynamic stimuli is due to shared information across modalities that is encoded in articulatory mouth movements. Participants completed a sequential face-voice matching task with (1) static images of faces, (2) dynamic videos of faces, (3) dynamic videos where only the mouth was visible, and (4) dynamic videos where the mouth was occluded, in a well-controlled stimulus set. Surprisingly, after accounting for random variation in the data due to design choices, accuracy for all four conditions was at chance. Crucially, however, exploratory analyses revealed that participants were not responding randomly, with different patterns of response biases being apparent for different conditions. Our findings suggest that face-voice identity matching may not be possible with above-chance accuracy but that analyses of response biases can shed light upon how people attempt face-voice matching. We discuss these findings with reference to the differential functional roles for faces and voices recently proposed for multimodal person perception.



中文翻译:

解释面部声音匹配决策:嘴巴运动,刺激效果和反应偏见的贡献

先前的研究表明,人脸-声音匹配的准确度始终高于动态(即说出)面孔而不是静态面孔。这表明动态信息可以在通知匹配决策中发挥重要作用。我们最初询问动态刺激的这种优势是否归因于在关节运动的嘴巴运动中编码的跨模态的共享信息。参与者完成了依次的人脸语音匹配任务,其中包括(1)人脸的静态图像,(2)人脸的动态视频,(3)仅嘴巴可见的动态视频和(4)嘴巴被遮挡的动态视频,在良好控制的刺激条件下。出人意料的是,在考虑了由于设计选择而导致的数据随机变化之后,所有四个条件的准确性都达到了预期。但至关重要的是 探索性分析表明,参与者不是随机响应的,在不同情况下,响应偏差的模式也很明显。我们的发现表明,面对面语音身份匹配可能无法以较高的准确度实现,但是对反应偏见的分析可以揭示人们如何尝试脸部语音匹配。我们参考最近提出的用于多模式人感知的面部和声音的微分功能角色来讨论这些发现。

更新日期:2021-04-02
down
wechat
bug