The validation of a cloud system can be complicated by the size of the system, the number of users that can concurrently request services, and the virtualization used to give the illusion of using dedicated machines. Unfortunately, it is not feasible to use conventional testing methods with cloud systems. This article proposes a framework, called TEA- Cloud , that integrates simulation with testing methods for validating cloud system designs. Testing is applied on both functional and nonfunctional aspects of the cloud, like performance and cost. The aim of the framework is to provide a complete methodology to help users to model both software and hardware parts of cloud systems and automatically test the validity of these clouds using a cost-effective approach. Metamorphic testing is used to overcome the lack of an oracle that checks whether the behavior observed in testing is allowed. Metamorphic testing is based on metamorphic relations (MRs). We define three families of MRs, which target issues such as performance, resource provisioning, and cost. TEA- Cloud was evaluated through an empirical study that used fault seeding (mutation) and ten MRs for testing different cloud configurations. The results were promising, with TEA- Cloud finding all seeded faults.

中文翻译：

---

茶-云：测试云计算系统的正式框架

云系统的验证可能因系统规模，可以同时请求服务的用户数量以及用于给人以使用专用计算机的幻想的虚拟化而变得复杂。不幸的是，在云系统中使用常规测试方法是不可行的。本文提出了一个名为TEA-的框架 云 ，它将模拟与测试方法集成在一起，以验证云系统设计。测试适用于云的功能和非功能方面，例如性能和成本。该框架的目的是提供一种完整的方法，以帮助用户对云系统的软件和硬件部分进行建模，并使用经济高效的方法自动测试这些云的有效性。变质测试 用于克服缺乏 甲骨文检查是否允许在测试中观察到的行为。变质测试基于变质关系（MRs）。我们定义了三个MR系列，它们针对诸如性能，资源供应和成本之类的问题。茶- 云通过一项使用故障种子（变异）和十个MR来测试不同云配置的经验研究进行了评估。TEA-的结果令人鼓舞 云 查找所有种子故障。