Network bandwidth demand in datacenters is doubling every 12 to 15 months. In response to this demand, high-bandwidth network interface cards, each capable of transferring 100s of Gigabits of data per second, are making inroads into the servers of next-generation datacenters. Such unprecedented data delivery rates on server endpoints raise new challenges, as inbound network traffic placement decisions within the memory hierarchy have a direct impact on end-to-end performance. Modern server-class Intel processors leverage DDIO technology to steer all inbound network data into the last-level cache (LLC), regardless of the network traffic’s nature. This static data placement policy is suboptimal, both from a performance and an energy efficiency standpoint. In this work, we design IDIO, a framework that—unlike DDIO—dynamically decides where to place inbound network traffic within a server’s multi-level memory hierarchy. IDIO dynamically monitors system behavior and distinguishes between different traffic classes to determine and periodically re-evaluate the best placement location for each flow: LLC, mid-level (L2) cache or DRAM. Our results show that IDIO increases a server’s maximum sustainable load by up to ∼\sim33.3% across various network functions.

中文翻译：

---

IDIO：在服务器处理器上编排入站网络数据


数据中心的网络带宽需求每 12 到 15 个月就会翻一番。为了满足这一需求，每秒能够传输数百千兆位数据的高带宽网络接口卡正在进入下一代数据中心的服务器。服务器端点上这种前所未有的数据传输率带来了新的挑战，因为内存层次结构中的入站网络流量放置决策对端到端性能有直接影响。现代服务器级英特尔处理器利用 DDIO 技术将所有入站网络数据引导到最后一级缓存 (LLC)，无论网络流量的性质如何。从性能和能源效率的角度来看，这种静态数据放置策略都不是最佳的。在这项工作中，我们设计了 IDIO，这是一个与 DDIO 不同的框架，它动态地决定将入站网络流量放置在服务器的多级内存层次结构中的位置。 IDIO 动态监控系统行为并区分不同的流量类别，以确定并定期重新评估每个流的最佳放置位置：LLC、中级 (L2) 缓存或 DRAM。我们的结果表明，IDIO 在各种网络功能上将服务器的最大可持续负载提高了 ∼\sim33.3%。