Scientific software can be used for decades and is constantly evolving. Recently, metamorphic testing, a property-based testing technique, has shown to be effective in testing scientific software, and the necessary properties are expressed as metamorphic relations. However, the development of metamorphic relations is difficult: it requires considerable practical expertise for the software tester. In this article, we report our experience of uncovering metamorphic relations from a user forum's questions of the United States Environmental Protection Agency's Storm Water Management Model (SWMM). Our study not only illustrates a wealth of end users’ expertise in interpreting software results, but also demonstrates the usefulness of classifying the user-oriented metamorphic relations into a nominal, ordinal, and functional hierarchy mainly from the software output perspective.

中文翻译：

---

在用户论坛中发现科学软件的变形关系

科学软件可以使用数十年，并且在不断发展。近来，变质测试（一种基于属性的测试技术）已证明可以有效地测试科学软件，并且必要的属性以变质关系表示。但是，变态关系的开发很困难：软件测试人员需要相当多的实践专业知识。在本文中，我们报告了从用户论坛提出的有关美国环境保护局的雨水管理模型（SWMM）的问题中发现变质关系的经验。我们的研究不仅说明了最终用户在解释软件结果方面的专业知识，而且还证明了将面向用户的变态关系分类为名义，有序，