Cloud deployments now increasingly provision FPGA accelerators as part of virtual instances. While FPGAs are still essentially single-tenant, the growing demand for hardware acceleration will inevitably lead to the need for methods and architectures supporting FPGA multi-tenancy. In this paper, we propose an architecture supporting space-sharing of FPGA devices among multiple tenants in the cloud. The proposed architecture implements a network-on-chip (NoC) designed for fast data movement and low hardware footprint. Prototyping the proposed architecture on a Xilinx Virtex Ultrascale+ demonstrated near specification maximum frequency for on-chip data movement and high throughput in virtual instance access to hardware accelerators. We demonstrate similar performance compared to single-tenant deployment while increasing FPGA utilization ( we achieved 6x higher FPGA utilization with our case study), which is one of the major goals of virtualization. Overall, our NoC interconnect achieved about 2x higher maximum frequency than the state-of-the-art and a bandwidth of 25.6 Gbps.

中文翻译：

---

对云中 FPGA 多租户的架构支持

云部署现在越来越多地将 FPGA 加速器配置为虚拟实例的一部分。虽然 FPGA 本质上仍然是单租户的，但对硬件加速不断增长的需求将不可避免地导致对支持 FPGA 多租户的方法和架构的需求。在本文中，我们提出了一种支持云中多个租户之间 FPGA 设备空间共享的架构。所提议的架构实现了片上网络 (NoC)，旨在实现快速数据移动和低硬件占用空间。在 Xilinx Virtex Ultrascale+ 上对所提议的架构进行原型设计，证明了片上数据移动的最大频率接近规范，以及对硬件加速器的虚拟实例访问的高吞吐量。与单租户部署相比，我们展示了与单租户部署相似的性能，同时提高了 FPGA 利用率（我们通过案例研究实现了 6 倍的 FPGA 利用率），这是虚拟化的主要目标之一。总体而言，我们的 NoC 互连实现了比最先进技术高出约 2 倍的最大频率和 25.6 Gbps 的带宽。