当前位置: X-MOL 学术arXiv.cs.CL › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Domain Adaptation in Dialogue Systems using Transfer and Meta-Learning
arXiv - CS - Computation and Language Pub Date : 2021-02-22 , DOI: arxiv-2102.11146
Rui Ribeiro, Alberto Abad, José Lopes

Current generative-based dialogue systems are data-hungry and fail to adapt to new unseen domains when only a small amount of target data is available. Additionally, in real-world applications, most domains are underrepresented, so there is a need to create a system capable of generalizing to these domains using minimal data. In this paper, we propose a method that adapts to unseen domains by combining both transfer and meta-learning (DATML). DATML improves the previous state-of-the-art dialogue model, DiKTNet, by introducing a different learning technique: meta-learning. We use Reptile, a first-order optimization-based meta-learning algorithm as our improved training method. We evaluated our model on the MultiWOZ dataset and outperformed DiKTNet in both BLEU and Entity F1 scores when the same amount of data is available.

中文翻译:

使用转移和元学习的对话系统中的域适应

当前的基于生成的对话系统需要大量数据,并且当只有少量目标数据可用时,无法适应新的看不见的领域。另外,在实际应用中,大多数领域的代表性不足,因此需要创建一种系统,能够使用最少的数据将其推广到这些领域。在本文中,我们提出了一种通过结合转移学习和元学习(DATML)来适应未知领域的方法。DATML通过引入另一种学习技术:元学习,改进了以前的最新对话模型DiKTNet。我们使用爬行动物,一种基于一阶优化的元学习算法作为改进的训练方法。当可获得相同数量的数据时,我们在MultiWOZ数据集上评估了我们的模型,并且在BLEU和Entity F1得分方面均优于DiKTNet。
更新日期:2021-02-23
down
wechat
bug