当前位置: X-MOL 学术Big Data › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Residual-Based Graph Convolutional Network for Emotion Recognition in Conversation for Smart Internet of Things
Big Data ( IF 4.6 ) Pub Date : 2021-08-16 , DOI: 10.1089/big.2020.0274
Young-Ju Choi 1 , Young-Woon Lee 2 , Byung-Gyu Kim 1
Affiliation  

Recently, emotion recognition in conversation (ERC) has become more crucial in the development of diverse Internet of Things devices, especially closely connected with users. The majority of deep learning-based methods for ERC combine the multilayer, bidirectional, recurrent feature extractor and the attention module to extract sequential features. In addition to this, the latest model utilizes speaker information and the relationship between utterances through the graph network. However, before the input is fed into the bidirectional recurrent module, detailed intrautterance features should be obtained without variation of characteristics. In this article, we propose a residual-based graph convolution network (RGCN) and a new loss function. Our RGCN contains the residual network (ResNet)-based, intrautterance feature extractor and the GCN-based, interutterance feature extractor to fully exploit the intra–inter informative features. In the intrautterance feature extractor based on ResNet, the elaborate context feature for each independent utterance can be produced. Then, the condensed feature can be obtained through an additional GCN-based, interutterance feature extractor with the neighboring associated features for a conversation. The proposed loss function reflects the edge weight to improve effectiveness. Experimental results demonstrate that the proposed method achieves superior performance compared with state-of-the-art methods.

中文翻译:

用于智能物联网对话中情感识别的基于残差的图卷积网络

最近,对话中的情感识别(ERC)在各种物联网设备的发展中变得更加重要,尤其是与用户紧密相连。大多数基于深度学习的 ERC 方法结合了多层、双向、循环特征提取器和注意力模块来提取序列特征。除此之外,最新模型通过图网络利用说话者信息和话语之间的关系。然而,在将输入输入双向循环模块之前,应该在不改变特征的情况下获得详细的话语内特征。在本文中,我们提出了一个基于残差的图卷积网络(RGCN)和一个新的损失函数。我们的 RGCN 包含基于残差网络 (ResNet) 的话语内特征提取器和基于 GCN 的,话语间特征提取器以充分利用内部间信息特征。在基于 ResNet 的话语内特征提取器中,可以为每个独立话语生成精心制作的上下文特征。然后,可以通过附加的基于 GCN 的话语间特征提取器与相邻的对话相关特征来获得浓缩特征。建议的损失函数反映了边缘权重以提高有效性。实验结果表明,与最先进的方法相比,所提出的方法具有更好的性能。可以通过附加的基于 GCN 的话语间特征提取器以及相邻的对话相关特征来获得浓缩特征。建议的损失函数反映了边缘权重以提高有效性。实验结果表明,与最先进的方法相比,所提出的方法具有更好的性能。可以通过附加的基于 GCN 的话语间特征提取器以及相邻的对话相关特征来获得浓缩特征。建议的损失函数反映了边缘权重以提高有效性。实验结果表明,与最先进的方法相比,所提出的方法具有更好的性能。
更新日期:2021-08-17
down
wechat
bug