Interpersonal human-human interaction is a dynamical exchange and coordination of social signals, feelings and emotions usually performed through and across multiple modalities such as facial expressions, gestures, and language. Developing machines able to engage humans in rich and natural interpersonal interactions requires capturing such dynamics. This paper addresses primitive emotional contagion during dyadic interactions in which roles are prefixed. Primitive emotional contagion was defined as the tendency people have to automatically mimic and synchronize their multimodal behavior during interactions and, consequently, to emotionally converge. To capture emotional contagion, a cross-recurrence based methodology that explicitly integrates short and long-term temporal dynamics through the analysis of both facial expressions and sentiment was developed. This approach is employed to assess emotional contagion at unimodal, multimodal and cross-modal levels and is evaluated on the Solid SAL-SEMAINE corpus. Interestingly, the approach is able to show the importance of the adoption of cross-modal strategies for addressing emotional contagion.

中文翻译：

---

二元交互中原始情绪传染的计算研究

人与人之间的互动是社会信号、感觉和情绪的动态交换和协调，通常通过多种方式进行，例如面部表情、手势和语言。开发能够让人类参与丰富而自然的人际互动的机器需要捕捉这种动态。本文讨论了在角色带有前缀的二元交互中的原始情绪传染。原始情绪传染被定义为人们在互动过程中必须自动模仿和同步他们的多模态行为并因此在情绪上收敛的趋势。捕捉情绪感染，开发了一种基于交叉循环的方法，通过分析面部表情和情绪，明确整合短期和长期时间动态。这种方法用于评估单模态、多模态和跨模态水平的情绪传染，并在 Solid SAL-SEMAINE 语料库上进行评估。有趣的是，该方法能够表明采用跨模式策略来解决情绪传染的重要性。