This paper presents MaxHadoop, a flexible and scalable emulation tool, which allows the efficient and accurate emulation of Hadoop environments over Software Defined Networks (SDNs). Hadoop has been designed to manage endless data-streams over networks, making it a tailored candidate to support the new class of network services belonging to Big Data. The development of Hadoop is contemporary with the evolution of networks towards the new architectures “Software Defined.” To create our emulation environment, tailored to SDNs, we employ MaxiNet, given its capability of emulating large-scale SDNs. We make it possible to emulate realistic Hadoop scenarios on large-scale SDNs using low-cost commodity hardware, by resolving a few key limitations of MaxiNet through appropriate configuration settings. We validate the MaxHadoop emulator by executing two benchmarks, namely WordCount and TeraSort, to evaluate a set of Key Performance Indicators. The tests’ outcomes evidence that MaxHadoop outperforms other existing emulation tools running over commodity hardware. Finally, we show the potentiality of MaxHadoop by utilizing it to perform a comparison of SDN-based network protocols.

中文翻译：

---

MaxHadoop：一种高效的可扩展仿真工具，用于在仿真 Hadoop 环境中测试 SDN 协议

本文介绍了 MaxHadoop，这是一种灵活且可扩展的仿真工具，它允许通过软件定义网络 (SDN) 高效准确地仿真 Hadoop 环境。Hadoop 旨在管理网络上无休止的数据流，使其成为支持属于大数据的新型网络服务的量身定制的候选者。Hadoop 的发展与网络向“软件定义”的新架构演进同步。为了创建我们为 SDN 量身定制的仿真环境，我们采用了 MaxiNet，因为它具有模拟大规模 SDN 的能力。通过适当的配置设置解决 MaxiNet 的一些关键限制，我们可以使用低成本商品硬件在大型 SDN 上模拟真实的 Hadoop 场景。我们通过执行两个基准测试（即 WordCount 和 TeraSort）来验证 MaxHadoop 模拟器，以评估一组关键性能指标。测试结果证明 MaxHadoop 的性能优于其他在商品硬件上运行的现有仿真工具。最后，我们通过利用 MaxHadoop 对基于 SDN 的网络协议进行比较来展示其潜力。