Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding emotional expressions in presentations and improving presentation skills. However, manually watching and studying presentation videos is often tedious and time-consuming. There is a lack of tool support to help conduct an efficient and in-depth multi-level analysis. Thus, in this paper, we introduce EmoCo, an interactive visual analytics system to facilitate efficient analysis of emotion coherence across facial, text, and audio modalities in presentation videos. Our visualization system features a channel coherence view and a sentence clustering view that together enable users to obtain a quick overview of emotion coherence and its temporal evolution. In addition, a detail view and word view enable detailed exploration and comparison from the sentence level and word level, respectively. We thoroughly evaluate the proposed system and visualization techniques through two usage scenarios based on TED Talk videos and interviews with two domain experts. The results demonstrate the effectiveness of our system in gaining insights into emotion coherence in presentations.

中文翻译：

---

EmoCo：演示视频中情感连贯性的视觉分析。

情感在人类交流和公开演讲中起着关键作用。人类的情感通常通过多种方式表达。因此，探索多模态情绪及其连贯性对于理解演讲中的情感表达和提高演讲技巧具有重要价值。但是，手动观看和研究演示视频通常很繁琐且耗时。缺少工具支持来帮助进行有效且深入的多层次分析。因此，在本文中，我们介绍了一种交互式视觉分析系统EmoCo，该系统有助于跨演示文稿视频中的面部，文本和音频模态有效地分析情感连贯性。我们的可视化系统具有通道连贯性视图和句子聚类视图，它们共同使用户能够快速获得情感连贯性及其时间演变的概述。此外，详细视图和单词视图可分别从句子级别和单词级别进行详细的探索和比较。我们通过两种基于TED Talk视频的使用场景以及对两位领域专家的采访，全面评估了所提出的系统和可视化技术。结果证明了我们的系统在了解演示文稿中的情绪连贯性方面的有效性。我们通过两种基于TED Talk视频的使用场景以及对两位领域专家的采访，全面评估了所提议的系统和可视化技术。结果证明了我们的系统在了解演示文稿中的情绪连贯性方面的有效性。我们通过两种基于TED Talk视频的使用场景以及对两位领域专家的采访，全面评估了所提议的系统和可视化技术。结果证明了我们的系统在了解演示文稿中的情绪连贯性方面的有效性。