当前位置: X-MOL 学术Cortex › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Multimodal comprehension in left hemisphere stroke patients
Cortex ( IF 3.6 ) Pub Date : 2020-10-12 , DOI: 10.1016/j.cortex.2020.09.025
Gabriella Vigliocco 1 , Anna Krason 2 , Harrison Stoll 3 , Alessandro Monti 2 , Laurel J Buxbaum 3
Affiliation  

Hand gestures, imagistically related to the content of speech, are ubiquitous in face-to-face communication. Here we investigated people with aphasia's (PWA) processing of speech accompanied by gestures using lesion-symptom mapping. Twenty-nine PWA and 15 matched controls were shown a picture of an object/action and then a video-clip of a speaker producing speech and/or gestures in one of the following combinations: speech-only, gesture-only, congruent speech-gesture, and incongruent speech-gesture. Participants' task was to indicate, in different blocks, whether the picture and the word matched (speech task), or whether the picture and the gesture matched (gesture task). Multivariate lesion analysis with Support Vector Regression Lesion-Symptom Mapping (SVR-LSM) showed that benefit for congruent speech-gesture was associated with 1) lesioned voxels in anterior fronto-temporal regions including inferior frontal gyrus (IFG), and sparing of posterior temporal cortex and lateral temporal-occipital regions (pTC/LTO) for the speech task, and 2) conversely, lesions to pTC/LTO and sparing of anterior regions for the gesture task. The two tasks did not share overlapping voxels. Costs from incongruent speech-gesture pairings were associated with lesioned voxels in these same anterior (for the speech task) and posterior (for the gesture task) regions, but crucially, also shared voxels in superior temporal gyrus (STG) and middle temporal gyrus (MTG), including the anterior temporal lobe. These results suggest that IFG and pTC/LTO contribute to extracting semantic information from speech and gesture, respectively; however, they are not causally involved in integrating information from the two modalities. In contrast, regions in anterior STG/MTG are associated with performance in both tasks and may thus be critical to speech-gesture integration. These conclusions are further supported by associations between performance in the experimental tasks and performance in tests assessing lexical-semantic processing and gesture recognition.



中文翻译:

左半球卒中患者的多模式理解

手势与语音的内容有着不可思议的关系,在面对面的交流中无处不在。在这里,我们调查了使用病变-症状映射并伴随手势的失语症(PWA)处理语音的人。向29个PWA和15个匹配的控件显示了一个对象/动作的图片,然后显示了发言人的视频剪辑,这些发言人以以下组合之一生成语音和/或手势:纯语音,纯手势,全等语音-手势和不恰当的语音手势。参与者的任务是在不同的块中指示图片和单词是否匹配(语音任务)或图片和手势是否匹配(手势任务)。支持向量回归病变-症状映射(SVR-LSM)的多变量病变分析显示,一致的语音手势的益处与1)前额颞区(包括下额额回(IFG))的病变体素以及后颞的保留有关语音任务的皮层和外侧颞枕区域(pTC / LTO),以及2)相反,手势任务的pTC / LTO损伤和前部区域保留。这两个任务没有共享重叠的体素。在相同的前部(用于语音任务)和后部(用于手势任务)区域中,病变手势体位不一致导致的体素相关,但至关重要的是,颞上回(STG)和颞中回(STG)也共享了体素( MTG),包括颞叶前叶。这些结果表明,IFG和pTC / LTO分别有助于从语音和手势中提取语义信息。但是,它们并没有因果关系地参与来自两种方式的信息集成。相反,前STG / MTG中的区域与两项任务的表现都相关,因此可能对语音手势整合至关重要。这些结论进一步得到了实验任务中的表现与评估词汇语义处理和手势识别的测试中的表现之间的关联的支持。前STG / MTG中的两个区域与两项任务的表现都相关,因此对于语音-手势整合至关重要。这些结论进一步得到了实验任务中的表现与评估词汇语义处理和手势识别的测试中的表现之间的关联的支持。前STG / MTG中的两个区域与两项任务的表现都相关,因此对于语音-手势整合至关重要。这些结论进一步得到了实验任务中的表现与评估词汇语义处理和手势识别的测试中的表现之间的关联的支持。

更新日期:2020-11-05
down
wechat
bug