Context:

Modern software development increasingly relies on software testing for an ever more frequent delivery of high quality software. This puts high demands on the quality of the central artifacts in software testing, test suites and test cases.

Objective:

We aim to develop a comprehensive model for capturing the dimensions of test case/suite quality, which are relevant for a variety of perspectives.

Methods:

We have carried out a systematic literature review to identify and analyze existing secondary studies on quality aspects of software testing artifacts.

Results:

We identified 49 relevant secondary studies. Of these 49 studies, less than half did some form of quality appraisal of the included primary studies and only 3 took into account the quality of the primary study when synthesizing the results. We present an aggregation of the context dimensions and factors that can be used to characterize the environment in which the test case/suite quality is investigated. We also provide a comprehensive model of test case/suite quality with definitions for the quality attributes and measurements based on findings in the literature and ISO/IEC 25010:2011.

Conclusion:

The test artifact quality model presented in the paper can be used to support test artifact quality assessment and improvement initiatives in practice. Furthermore, the model can also be used as a framework for documenting context characteristics to make research results more accessible for research and practice.

中文翻译：

---

评估测试工件质量——第三项研究

语境：

现代软件开发越来越依赖软件测试来更频繁地交付高质量软件。这对软件测试、测试套件和测试用例中的中心工件的质量提出了很高的要求。

客观的：

我们的目标是开发一个综合模型来捕捉测试用例/套件质量的维度，这些维度与各种观点相关。

方法：

我们进行了系统的文献回顾，以识别和分析现有的关于软件测试工件质量方面的二次研究。

结果：

我们确定了 49 项相关的二级研究。在这 49 项研究中，不到一半对纳入的初级研究进行了某种形式的质量评估，只有 3 项在综合结果时考虑了初级研究的质量。我们提供了上下文维度和因素的聚合，可用于表征研究测试用例/套件质量的环境。我们还根据文献和 ISO/IEC 25010:2011 中的发现，提供了一个测试用例/套件质量的综合模型，其中包含对质量属性和度量的定义。

结论：

论文中提出的测试工件质量模型可用于支持实践中的测试工件质量评估和改进计划。此外，该模型还可用作记录上下文特征的框架，使研究结果更易于研究和实践。