Abstract:Rapid growth in data size poses significant computational and memory challenges to data processing. FPGA accelerators and near-storage processing have emerged as compelling solutions for tackling the growing computational and memory requirements. Many FPGA-based accelerators have shown to be effective in processing large data sets by leveraging the storage capability of either host-attached or FPGA-attached storage devices. However, the current HLS development environment does not allow direct access to host- or FPGA-attached NVMe storage from the HLS code. As such, users must frequently hand off between HLS and host code to access data in storage, and such a process requires tedious programming to ensure functional correctness. Moreover, since the HLS code uses radically different methods to access storage compared to DRAM, the HLS codebase targeting DRAM-based platforms cannot be easily ported to NVMe-based platforms, resulting in limited code portability and reusability. Furthermore, frequent suspension of HLS kernel and synchronization between CPU and FPGA introduce significant latency overhead and require sophisticated scheduling mechanisms to hide latency. To address these challenges, we propose a new HLS storage interface named DONGLE 2.0 that enables direct FPGA-orchestrated NVMe storage access. By providing a unified interface for storage and memory access, DONGLE 2.0 allows a single-source HLS program to target multiple memory/storage devices, thus making the codebase cleaner, portable, and more efficient. DONGLE 2.0 is an extension to DONGLE 1.0 [1] but adds support for host-attached storage. While its primary focus is still on FPGA NVMe access in near-storage configurations, the added host storage support ensures its compatibility with platforms that lack native support for FPGA-attached NVMe storage. We implemented a prototype of DONGLE 2.0 using an AMD/Xilinx Alveo U200 FPGA and Solidigm DC-P4610 SSD. Our evaluation on various workloads showed a geometric mean speed-up of 2.3 × and a reduction in lines of code by 2.4 × compared to the state-of-the-art commercial platform when using FPGA-attached NVMe storage. Moreover, DONGLE 2.0 demonstrated a geometric mean speed-up of 1.5 × and a reduction in lines of code by 2.4 × compared to the state-of-the-art commercial platform when using host-attached NVMe storage.

DHL: Enabling Flexible Software Network Functions with FPGA Acceleration

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

LightNF: Simplifying Network Function Offloading in Programmable Networks

Halia: Toward Full-Coverage Network Function Offloading in the Data Plane

hXDP: Efficient Software Packet Processing on FPGA NICs

Enabling Efficient and Flexible FPGA Virtualization for Deep Learning in the Cloud

Network Function Virtualization based on FPGAs:A Framework for all-Programmable network devices

HYPER: A Hybrid High-Performance Framework for Network Function Virtualization.

Accelerating Network Features Deployment with Heterogeneous Platforms

DFabric: Scaling Out Data Parallel Applications with CXL-Ethernet Hybrid Interconnects

FP-DNN: an Automated Framework for Mapping Deep Neural Networks Onto FPGAs with RTL-HLS Hybrid Templates

NFP: Enabling Network Function Parallelism in NFV.

An All-Digital Compute-In-Memory FPGA Architecture for Deep Learning Acceleration

DONGLE 2.0: Direct FPGA-Orchestrated NVMe Storage for HLS

FlowLever: Leverage Flow Director for Packet Dispatch Acceleration in NFV

AccD: A Compiler-based Framework for Accelerating Distance-related Algorithms on CPU-FPGA Platforms

A high-performance framework for a network programmable packet processor using P4 and FPGA

Octopus: A Heterogeneous In-network Computing Accelerator Enabling Deep Learning for network

HeteroFlow: An Accelerator Programming Model with Decoupled Data Placement for Software-Defined FPGAs

Revisiting FPGA Acceleration of Molecular Dynamics Simulation with Dynamic Data Flow Behavior in High-Level Synthesis

FABLE-DTS: Hardware-Software Co-Design of a Fast and Stable Data Transmission System for FPGAs