Abstract We examined the cognitive resources involved in processing speech with gesture compared to the same speech without gesture across four studies using a dual-task paradigm. Participants viewed videos of a woman describing spatial arrays either with gesture or without. They then attempted to choose the target array from among four choices. Participants’ cognitive load was measured as they completed this comprehension task by measuring how well they could remember the location and identity of digits in a secondary task. We found that addressees experience additional visuospatial load when processing gestures compared to speech alone, and that the load primarily comes when addressees attempt to use their memory of the descriptions with gesture to choose the target array. However, this cost only occurs when gestures about horizontal spatial relations (i.e., left and right) are produced from the speaker’s egocentric perspective.

中文翻译：

---

看手势是减轻还是增加负担？

摘要 我们在四项研究中使用双任务范式检查了与没有手势的相同语音相比，处理有手势的语音所涉及的认知资源。参与者观看了一位女性用手势或不带手势描述空间阵列的视频。然后他们尝试从四个选项中选择目标阵列。参与者的认知负荷是在他们完成这项理解任务时通过测量他们在次要任务中记住数字的位置和身份的程度来衡量的。我们发现，与单独的语音相比，收件人在处理手势时会经历额外的视觉空间负载，并且负载主要出现在收件人尝试使用他们对手势描述的记忆来选择目标数组时。然而，