当前位置: X-MOL 学术J. Parallel Distrib. Comput. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Scalable flow probe architecture for 100 Gbps+ rates on commodity hardware: Design considerations and approach
Journal of Parallel and Distributed Computing ( IF 3.8 ) Pub Date : 2021-05-10 , DOI: 10.1016/j.jpdc.2021.04.015
Raktim Bhattacharjee , R. Rajesh , K.R. Prasanna Kumar , Vinu Paul MV , G. Athithan , A.V. Sahadevan

The unrelenting growth of data intensive applications has been raising the bar for performance of high speed networks. To cater for this growth, the core segments of networks today are based on 100 Gbps links. Analyzing the huge volume of traffic over these networks is a challenging yet essential task from the perspectives of network administration, network security and law enforcement. In spite of the availability of adequate network, compute, and memory resources, designing traffic analysis solutions performing at line rate for high speed traffic brings up several challenges. Traffic analysis solutions built on commodity compute platforms bring distinct advantages in terms of cost, adaptability, up-gradation and scalability. Keeping this in view, this paper explores the feasibility of designing high speed traffic analysis solutions that can handle 100s of Gbps on commodity compute platforms. It begins this process by analyzing the design issues in line rate handling of traffic on commodity servers with 100 GbE NIC and by bringing out an optimized and scalable packet processing pipeline. Leveraging this processing pipeline, NAPA-FP, a NUMA aware flow probe architecture, has been designed. With an implementation of this architecture on a commodity server, we show that line rate processing of Internet-like traffic from a 100 GbE interface can be achieved with a single NUMA node, by using a suitably configured packet processing path. We also show that its performance scales linearly to multiple 100 Gbps with additional NUMA nodes and NICs. In particular, the implementation on a 4-socket commodity server with 3×100 GbE NICs is able to process 3×100 Gbps Internet-like traffic at line rate using 3 NUMA nodes. The optimizations with respect to resource allocation, sharing and processing pipeline are reported with corroborating experimental results.



中文翻译:

在商用硬件上实现100 Gbps +速率的可扩展流量探针架构:设计注意事项和方法

数据密集型应用程序的持续增长一直在提高高速网络性能的标准。为了适应这种增长,当今网络的核心部分基于100 Gbps链路。从网络管理,网络安全和执法的角度来看,分析这些网络上的巨大流量是一项具有挑战性但必不可少的任务。尽管有足够的网络,计算和内存资源可用,但为高速通信量设计以线速执行的通信量分析解决方案仍带来了一些挑战。基于商品计算平台的流量分析解决方案在成本,适应性,升级和可扩展性方面具有明显优势。保持这种观点,本文探讨了设计可在商品计算平台上处理100 Gbps的高速流量分析解决方案的可行性。首先,通过分析具有100 GbE NIC的商品服务器上流量的线速处理中的设计问题,并通过优化和可扩展的数据包处理管道来开始此过程。利用此处理管道,已经设计了NAPA-FP(一种NUMA感知型流量探针架构)。通过在商用服务器上实现此体系结构,我们显示了通过使用适当配置的数据包处理路径,可以使用单个NUMA节点实现来自100 GbE接口的类似于Internet的流量的线速处理。我们还展示了其性能可以通过其他NUMA节点和NIC线性扩展至多个100 Gbps。特别是,3×100 GbE NIC能够处理 3×100使用3个NUMA节点以线速进行Gbps的类似于Internet的流量。报告了有关资源分配,共享和处理管道的优化,并证实了实验结果。

更新日期:2021-05-15
down
wechat
bug