Automotive test case specifications document test cases to be performed for a specific test object at a defined test level. They are a fundamental part of a structured automotive testing process, as required by the ISO 26262. The aim of our research is to identify challenges from a practitioner’s point of view that lead to poor quality of test case specifications and thus negatively impact time, cost, and probability of defect detection. We designed an exploratory case study to systematically identify challenges focusing on (C) creation, (P) processing, and (Q) quality assurance related aspects of test case specifications. We conducted 17 semi-structured interviews covering a German OEM as well as three of its automotive suppliers and analyzed them qualitatively. We investigated causes and consequences arising from the challenges. Additionally, we conducted a descriptive survey to assess frequency and criticality. The identified challenges were summarized in a taxonomy consisting of nine main categories: (1) availability and (2) content-related problems with input artifacts, problems related to (3) a lack of knowledge, (4) the test case description, (5) the test case specification content, (6) processes, (7) communication, (8) quality assurance, and (9) tools. The challenges were assessed by 26 internal and 10 external employees. Hence, we identified differences between these groups in terms of access to documents, incomplete requirements, scope of model series, process, and tool-related aspects. Overall, the study results underline the necessity of quality assurance measures for test case specifications. Based on the assessments, our research indicates a broad range of test case description related challenges that are promising candidates for improving test case specification quality.

中文翻译：

---

汽车软件测试中测试用例规范的挑战：频率和关键性评估

汽车测试用例规范记录了要在定义的测试级别为特定测试对象执行的测试用例。它们是 ISO 26262 要求的结构化汽车测试过程的基本组成部分。我们研究的目的是从从业者的角度确定导致测试用例规范质量低劣的挑战，从而对时间、成本产生负面影响，以及缺陷检测的概率。我们设计了一个探索性案例研究，以系统地识别测试用例规范的 (C) 创建、(P) 处理和 (Q) 质量保证相关方面的挑战。我们对一家德国原始设备制造商及其三个汽车供应商进行了 17 次半结构化访谈，并对其进行了定性分析。我们调查了挑战产生的原因和后果。此外，我们进行了描述性调查以评估频率和重要性。识别出的挑战总结在一个由九个主要类别组成的分类法中：（1）可用性和（2）与输入工件的内容相关的问题，与（3）缺乏知识相关的问题，（4）测试用例描述，（ 5）测试用例规范内容，（6）过程，（7）沟通，（8）质量保证，（9）工具。这些挑战由 26 名内部员工和 10 名外部员工进行评估。因此，我们在文档访问、不完整的需求、模型系列的范围、流程和工具相关方面确定了这些组之间的差异。总的来说，研究结果强调了测试用例规范质量保证措施的必要性。根据评估，