Autism spectrum disorder (ASD), which since 2013 is considered as an umbrella term for several disorders such as autistic syndrome, Asperger’s disorder and pervasive developmental disorder, is characterized, among other aspects, by deficits in social-emotion reciprocity. This deficit manifests itself as a reduced sharing of emotions and an increased difficulty in interpreting emotions other people are feeling, which in the end leads to more impairments in social communication. Since it is possible to help a person with ASD (especially children) to improve their ability to understand and detect emotions, we have developed a proposal which integrates emotion recognition technologies, often used in the field of HCI, to try to overcome this difficulty. In this paper, we present a novel software application developed as a serious game to teach children with autism spectrum disorder (ASD) to identify and express emotions. The system incorporates cutting-edge technology to support novel interaction mechanisms based on tangible user interfaces (TUIs) and emotion recognition from facial expressions. In this way, children interact with the system in a natural way by simply grasping objects with their hands and using their faces. The system has been assessed on the premises of an association with children with ASD. The outcomes of the evaluation are very positive and support the validity of the proposal.

自 2013 年以来，自闭症谱系障碍 (ASD) 被认为是自闭症综合征、阿斯伯格症和广泛性发育障碍等多种疾病的总称，其特点是社交情感互惠性缺陷等。这种缺陷本身表现为情感分享的减少和解读其他人感受的情感的难度增加，最终导致更多的社交障碍。由于可以帮助患有 ASD 的人（尤其是儿童）提高他们理解和检测情绪的能力，因此我们开发了一个集成了 HCI 领域常用的情绪识别技术的提案，以试图克服这一困难。在本文中，我们展示了一种新颖的软件应用程序，该应用程序开发为一款严肃的游戏，用于教自闭症谱系障碍 (ASD) 儿童识别和表达情绪。该系统结合了尖端技术，以支持基于有形用户界面 (TUI) 和面部表情情感识别的新型交互机制。通过这种方式，孩子们通过简单地用手抓住物体并使用他们的脸以自然的方式与系统交互。该系统已在与 ASD 儿童关联的前提下进行了评估。评估结果非常积极，支持提案的有效性。该系统结合了尖端技术，以支持基于有形用户界面 (TUI) 和面部表情情感识别的新型交互机制。通过这种方式，孩子们通过简单地用手抓住物体并使用他们的脸以自然的方式与系统交互。该系统已在与 ASD 儿童关联的前提下进行了评估。评估结果非常积极，支持提案的有效性。该系统结合了尖端技术，以支持基于有形用户界面 (TUI) 和面部表情情感识别的新型交互机制。通过这种方式，孩子们通过简单地用手抓住物体并使用他们的脸以自然的方式与系统交互。该系统已在与 ASD 儿童关联的前提下进行了评估。评估结果非常积极，支持提案的有效性。