当前位置: X-MOL 学术J. Syst. Softw. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
On introducing automatic test case generation in practice: A success story and lessons learned
Journal of Systems and Software ( IF 3.7 ) Pub Date : 2021-03-06 , DOI: 10.1016/j.jss.2021.110933
Matteo Brunetto , Giovanni Denaro , Leonardo Mariani , Mauro Pezzé

The level and quality of automation dramatically affects software testing activities, determines costs and effectiveness of the testing process, and largely impacts on the quality of the final product. While costs and benefits of automating many testing activities in industrial practice (including managing the quality process, executing large test suites, and managing regression test suites) are well understood and documented, the benefits and obstacles of automatically generating system test suites in industrial practice are not well reported yet, despite the recent progresses of automated test case generation tools. Proprietary tools for automatically generating test cases are becoming common practice in large software organizations, and commercial tools are becoming available for some application domains and testing levels. However, generating system test cases in small and medium-size software companies is still largely a manual, inefficient and ad-hoc activity.

This paper reports our experience in introducing techniques for automatically generating system test suites in a medium-size company. We describe the technical and organizational obstacles that we faced when introducing automatic test case generation in the development process of the company, and present the solutions that we successfully experienced in that context. In particular, the paper discusses the problems of automating the generation of test cases by referring to a customized ERP application that the medium-size company developed for a third party multinational company, and presents ABT2.0, the test case generator that we developed by tailoring ABT, a research state-of-the-art GUI test generator, to their industrial environment. This paper presents the new features of ABT2.0, and discusses how these new features address the issues that we faced.



中文翻译:

在实践中引入自动测试用例生成的成功案例和经验教训

自动化的水平和质量极大地影响软件测试活动,确定测试过程的成本和有效性,并在很大程度上影响最终产品的质量。尽管很好地理解和记录了在工业实践中使许多测试活动自动化的成本和收益(包括管理质量过程,执行大型测试套件和管理回归测试套件),但在工业实践中自动生成系统测试套件的收益和障碍却广为人知。尽管自动测试用例生成工具最近取得了进展,但报告还不够好。在大型软件组织中,用于自动生成测试用例的专有工具正变得越来越普遍,并且商用工具也可用于某些应用程序域和测试级别。然而,

本文介绍了我们在中型公司中介绍的用于自动生成系统测试套件的技术方面的经验。我们描述了在公司的开发过程中引入自动测试用例生成时遇到的技术和组织上的障碍,并介绍了在这种情况下我们成功经历的解决方案。特别是,本文通过参考中型公司为第三方跨国公司开发的定制ERP应用程序,讨论了自动生成测试用例的问题,并提出了一个Ť2个0,我们通过定制开发的测试用例生成器 一个Ť,最先进的GUI测试生成器,适合其工业环境。本文介绍了新功能一个Ť2个0,并讨论这些新功能如何解决我们面临的问题。

更新日期:2021-03-18
down
wechat
bug