当前位置: X-MOL 学术arXiv.cs.SE › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Metamorphic Relation Prioritization for Effective Regression Testing
arXiv - CS - Software Engineering Pub Date : 2021-09-20 , DOI: arxiv-2109.09798
Madhusudan Srinivasan, Upulee Kanewala

Metamorphic testing (MT) is widely used for testing programs that face the oracle problem. It uses a set of metamorphic relations (MRs), which are relations among multiple inputs and their corresponding outputs to determine whether the program under test is faulty. Typically, MRs vary in their ability to detect faults in the program under test, and some MRs tend to detect the same set of faults. In this paper, we propose approaches to prioritize MRs to improve the efficiency and effectiveness of MT for regression testing. We present two MR prioritization approaches: (1) fault-based and (2) coverage-based. To evaluate these MR prioritization approaches, we conduct experiments on three complex open-source software systems. Our results show that the MR prioritization approaches developed by us significantly outperform the current practice of executing the source and follow-up test cases of the MRs in an ad-hoc manner in terms of fault detection effectiveness. Further, fault-based MR prioritization leads to reducing the number of source and follow-up test cases that needs to be executed as well as reducing the average time taken to detect a fault, which would result in saving time and cost during the testing process.

中文翻译:

用于有效回归测试的变形关系优先级

变形测试(MT)被广泛用于测试面临预言机问题的程序。它使用一组变形关系(MR),即多个输入及其相应输出之间的关系来确定被测程序是否有故障。通常,MR 检测被测程序中的错误的能力各不相同,并且一些 MR 倾向于检测同一组错误。在本文中,我们提出了优先考虑 MR 的方法,以提高 MT 在回归测试中的效率和有效性。我们提出了两种 MR 优先级划分方法:(1)基于故障和(2)基于覆盖。为了评估这些 MR 优先级方法,我们对三个复杂的开源软件系统进行了实验。我们的结果表明,我们开发的 MR 优先级方法在故障检测有效性方面明显优于当前以临时方式执行 MR 的源和后续测试用例的做法。此外,基于故障的 MR 优先级可减少需要执行的源和后续测试用例的数量,并减少检测故障所需的平均时间,从而节省测试过程中的时间和成本.
更新日期:2021-09-22
down
wechat
bug