ABSTRACT

Recent studies in human–human interaction (HHI) have revealed the propensity of negative emotional expression to initiate affiliating functions which are beneficial to the expresser and also help fostering cordiality and closeness amongst interlocutors during conversation. Effort in human–robot interaction has also been devoted to furnish robots with the expression of both positive and negative emotions. However, only a few have considered body gestures in context with the dialogue act functions conveyed by the emotional utterances. This study aims on furnishing robots with humanlike negative emotional expression, specifically anger-based body gestures roused by the utterance context. In this regard, we adopted a multimodal HHI corpus for the study, and then analyzed and established predominant gestures types and dialogue acts associated with anger-based utterances in HHI. Based on the analysis results, we implemented these gesture types in an android robot, and carried out a subjective evaluation to investigate their effects on the perception of anger expression in utterances with different dialogue act functions. Results showed significant effects of the presence of gesture on the anger degree perception. Findings from this study also revealed that the functional content of anger-based utterances plays a significant role in the choice of the gesture accompanying such utterances.

摘要

最近的人与人互动（HHI）研究表明，负性情绪表达倾向于启动从属功能，这有利于表达者，也有助于在对话者之间培养亲切感和亲密感。人机交互中的努力也致力于为机器人提供正面和负面情绪的表达。然而，只有少数几个人考虑到了与情感表达所传达的对话行为功能相关的身体姿势。这项研究旨在为机器人提供人性化的负面情感表达，特别是通过话语上下文引起的基于愤怒的肢体手势。在这方面，我们采用了多模式HHI语料进行研究，然后分析并建立与HHI中基于愤怒的话语相关的主要手势类型和对话行为。根据分析结果，我们在Android机器人中实现了这些手势类型，并进行了主观评估，以研究它们对不同对话动作功能的发声对愤怒表达的感知的影响。结果显示手势的存在对愤怒程度感知有显着影响。这项研究的发现还表明，基于愤怒的话语的功能内容在选择伴随此类话语的手势时起着重要作用。并进行了主观评估，以研究它们对具有不同对话行为功能的话语中愤怒表达的感知的影响。结果显示手势的存在对愤怒程度感知有显着影响。这项研究的发现还表明，基于愤怒的话语的功能内容在选择伴随此类话语的手势时起着重要作用。并进行了主观评估，以研究它们对具有不同对话行为功能的话语中愤怒表达的感知的影响。结果显示手势的存在对愤怒程度感知有显着影响。这项研究的发现还表明，基于愤怒的话语的功能内容在伴随此类话语的手势选择中起着重要作用。