Constructing good test cases is difficult and time-consuming, especially if the system under test is still under development and its exact behavior is not yet fixed. We propose a new approach to compute test strategies for reactive systems from a given temporal logic specification using formal methods. The computed strategies are guaranteed to reveal certain simple faults in every realization of the specification and for every behavior of the uncontrollable part of the system’s environment. The proposed approach supports different assumptions on occurrences of faults (ranging from a single transient fault to a persistent fault) and by default aims at unveiling the weakest one. We argue that such tests are also sensitive for more complex bugs. Since the specification may not define the system behavior completely, we use reactive synthesis algorithms with partial information. The computed strategies are adaptive test strategies that react to behavior at runtime. We work out the underlying theory of adaptive test strategy synthesis and present experiments for a safety-critical component of a real-world satellite system. We demonstrate that our approach can be applied to industrial specifications and that the synthesized test strategies are capable of detecting bugs that are hard to detect with random testing.

中文翻译：

---

从时序逻辑规范综合自适应测试策略

构建好的测试用例既困难又耗时，尤其是在被测系统仍在开发中且其确切行为尚未确定的情况下。我们提出了一种使用形式方法从给定的时间逻辑规范计算反应系统测试策略的新方法。计算出的策略可以保证在规范的每个实现中以及系统环境中不可控部分的每个行为中揭示某些简单的错误。所提出的方法支持对故障发生的不同假设（从单个瞬态故障到持续故障），并且默认情况下旨在揭示最弱的故障。我们认为此类测试对更复杂的错误也很敏感。由于规范可能没有完全定义系统行为，我们使用具有部分信息的反应合成算法。计算策略是在运行时对行为作出反应的自适应测试策略。我们制定了自适应测试策略综合的基本理论，并为现实世界卫星系统的安全关键组件提供了实验。我们证明了我们的方法可以应用于工业规范，并且综合测试策略能够检测随机测试难以检测的错误。