Test adequacy criteria are widely used to guide test creation. However, many of these criteria are sensitive to statement structure or the choice of test oracle. This is because such criteria ensure that execution reaches the element of interest, but impose no constraints on the execution path after this point. We are not guaranteed to observe a failure just because a fault is triggered. To address this issue, we have proposed the concept of observability—an extension to coverage criteria based on Boolean expressions that combines the obligations of a host criterion with an additional path condition that increases the likelihood that a fault encountered will propagate to a monitored variable. Our study, conducted over five industrial systems and an additional forty open-source systems, has revealed that adding observability tends to improve efficacy over satisfaction of the traditional criteria, with average improvements of 125.98 percent in mutation detection with the common output-only test oracle and per-model improvements of up to 1760.52 percent. Ultimately, there is merit to our hypothesis—observability reduces sensitivity to the choice of oracle and to the program structure.

中文翻译：

---

确保结构测试义务的可观察性

测试充分性标准被广泛用于指导测试创建。然而，这些标准中有许多对语句结构或测试 oracle 的选择很敏感。这是因为这样的标准确保执行到达感兴趣的元素，但在此之后对执行路径没有施加任何限制。我们不能保证仅仅因为触发了故障就会观察到故障。为了解决这个问题，我们提出了可观察性的概念——基于布尔表达式的覆盖标准的扩展，它将主机标准的义务与附加路径条件相结合，增加了遇到的故障传播到监控变量的可能性。我们的研究进行了超过五个工业系统和另外四十个开源系统，已经表明，增加可观察性往往会提高效率，而不是满足传统标准，突变检测的平均改进为 125.98%，通用的仅输出测试预言机和每个模型的改进高达 1760.52%。最终，我们的假设是有价值的——可观察性降低了对 oracle 选择和程序结构的敏感性。