当前位置: X-MOL 学术Software Qual. J. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Ontology-based metamorphic testing for chatbots
Software Quality Journal ( IF 1.7 ) Pub Date : 2021-04-27 , DOI: 10.1007/s11219-020-09544-9
Josip Božić

Modern-day demands for services often require an availability on a 24/7 basis as well as online accessibility around the globe. For this sake, personalized virtual assistants, called chatbots, are implemented. Such systems offer services, goods or information in natural language. These natural language processing (NLP) programs respond to the user in real time and offer an intuitive and simple interface to interact with. Advantages like these make them increasingly popular. Therefore, ensuring correct functionality of chatbots is of increasing importance. However, since different implementations and user behaviour result in unpredictable results, the chatbot’s input and output data are difficult to predict and classify as well. Under such circumstances, test cases can be inferred from the domain of possible inputs of a system under test (SUT). Ontologies are concepts used in AI to provide formal representations of knowledge for a specific domain. Such ontological models contain structured information that is used for test generation. On the other hand, testing of chatbots represents a challenge because of the absence of a test oracle. In this paper, both challenges are addressed by conceptualizing ontologies for input generation and output processing in form of a metamorphic testing approach. In this scenario, both concepts are applied for automated testing of chatbots. The approach is demonstrated on a real system from the tourism domain, thereby discussing the obtained results.



中文翻译:

基于本体的聊天机器人变形测试

现代的服务需求通常要求24/7的可用性以及全球范围内的在线可访问性。为此,实现了称为聊天机器人的个性化虚拟助手。这样的系统以自然语言提供服务,商品或信息。这些自然语言处理(NLP)程序会实时响应用户,并提供一个直观,简单的交互界面。这些优势使它们越来越受欢迎。因此,确保聊天机器人的正确功能变得越来越重要。但是,由于不同的实现方式和用户行为会导致不可预测的结果,因此聊天机器人的输入和输出数据也难以预测和分类。在这种情况下,可以从被测系统(SUT)的可能输入域中推断出测试用例。本体是AI中用于提供特定领域知识的形式表示的概念。这样的本体模型包含用于测试生成的结构化信息。另一方面,由于没有测试预告片,因此对聊天机器人的测试是一个挑战。在本文中,这两种挑战都是通过以变态测试方法的形式将输入生成和输出处理的本体概念化来解决的。在这种情况下,这两个概念都适用于聊天机器人的自动测试。在旅游领域的真实系统上演示了该方法,从而讨论了获得的结果。由于没有测试预告片,因此对聊天机器人的测试是一个挑战。在本文中,这两种挑战都是通过以变态测试方法的形式将输入生成和输出处理的本体概念化来解决的。在这种情况下,这两个概念都适用于聊天机器人的自动测试。在旅游领域的真实系统上演示了该方法,从而讨论了获得的结果。由于没有测试预告片,因此对聊天机器人的测试是一个挑战。在本文中,这两种挑战都是通过以变态测试方法的形式将输入生成和输出处理的本体概念化来解决的。在这种情况下,这两个概念都适用于聊天机器人的自动测试。在旅游领域的真实系统上演示了该方法,从而讨论了获得的结果。

更新日期:2021-04-28
down
wechat
bug