Abstract The objective of this work was to study the dynamics of human emotional states in the process of social interaction in a virtual environment. The previously developed for this purpose prototypes of the virtual actor (NPC) and its virtual environment simulator “Teleport” underwent significant re-design and modification. The experimental platform was re-implemented and used in experiments with college student participants, combining electromyography, emotion recognition in facial recordings and model-based game log analysis in a social videogame paradigm. Participants interacted with two virtual actors implemented based on the eBICA cognitive architecture (Samsonovich, 2013, 2018). Positive correlations were found between eBICA model predictions and participant affects extracted from their facial expressions and facial muscle activity. Affective dynamics of social phenomena, such as the establishment of partnership or an act of betrayal, were characterized and found consistent with the model predictions. Other findings include a gradually developing emotional reaction, possibly due to the integration of appraisals of game events. Overall, obtained results confirm the eBICA model, suggesting its further extension and refinement.

中文翻译：

---

社交视频游戏范式中情绪状态动态的实证和建模研究

摘要 这项工作的目的是研究虚拟环境中社会互动过程中人类情绪状态的动态。之前为此目的开发的虚拟演员 (NPC) 原型及其虚拟环境模拟器“Teleport”经历了重大的重新设计和修改。该实验平台被重新实施并用于大学生参与者的实验，结合了肌电图、面部记录中的情绪识别和社交视频游戏范式中基于模型的游戏日志分析。参与者与基于 eBICA 认知架构实现的两个虚拟参与者进行交互（Samsonovich，2013，2018）。在 eBICA 模型预测和参与者从面部表情和面部肌肉活动中提取的影响之间发现了正相关。社会现象的情感动态，例如建立伙伴关系或背叛行为，被表征并发现与模型预测一致。其他发现包括逐渐发展的情绪反应，可能是由于对游戏事件的评估的整合。总体而言，获得的结果证实了 eBICA 模型，表明其进一步扩展和完善。