Abstract:Network bandwidth is improving faster than the compute capacity of the host CPU, turning the CPU into a bottleneck. As a result, SmartNICs are often used to offload packet processing, even application logic, away from the CPU. However, today many applications such as Artificial Intelligence (AI) and High Performance Computing (HPC) rely on clusters of GPUs for computation. In such clusters, the majority of the network traffic is created by the GPUs. Unfortunately, commercially available multi-core SmartNICs, such as BlueFiled-2, fail to process 100Gb network traffic at line-rate with its embedded CPU, which is capable of doing control-plane management only. Commercially available FPGA-based SmartNICs are mainly optimized for network applications running on the host CPU. To address such scenarios, in this paper we present FpgaNIC, a GPU-oriented SmartNIC to accelerate applications running on distributed GPUs. FpgaNIC is an FPGA-based, GPU-centric, versatile SmartNIC that enables direct PCIe P2P communication with local GPUs using GPU virtual address, and that provides reliable 100Gb network access to remote GPUs. FpgaNIC allows to offload various complex compute tasks to a customized data-path accelerator for line-rate in-network computing on the FPGA, thereby complementing the processing at the GPU. The data-path accelerator can be programmed using C++-based HLS (High Level Synthesis), so as to make it easier to use for software programmers. FpgaNIC has been designed to explore the design space of SmartNICs, e.g., direct, on-path, and off-path models, benefiting different type of application. It opens up a wealth of research opportunities, e.g., accelerating a broad range of distributed applications by combining GPUs and FPGAs and exploring a larger design space of SmartNICs by making them easily accessible from local GPUs.

An Offloading Architecture of Lossless Compression Based on Smart NIC

Data Compression and Storage under High Speed Network

Multi-core Lossless Compression System for High-speed Data and Its FPGA Implementation

HybriDC: A Resource-Efficient CPU-FPGA Heterogeneous Acceleration System for Lossless Data Compression

Adaptive Pipeline Hardware Architecture Design and Implementation for Image Lossless Compression/Decompression Based on JPEG-LS

Performance Characterization of SmartNIC NVMe-over-Fabrics Target Offloading

MetaZip: a high-throughput and efficient accelerator for DEFLATE

Work-in-Progress: A High-Bandwidth Snappy Decompressor in Reconfigurable Logic

FPGA Acceleration of Zstd Compression Algorithm

HyQ: Hybrid I/O Queue Architecture for NVMe over Fabrics to Enable High- Performance Hardware Offloading

An FPGA-Based LOCO-ANS Implementation for Lossless and Near-Lossless Image Compression Using High-Level Synthesis

Lossless Compression Decoders for Bitstreams and Software Binaries Based on High-Level Synthesis.

FpgaNIC: An FPGA-based Versatile 100Gb SmartNIC for GPUs

FPGA-Based High-Performance Data Compression Deep Neural Network Accelerator

FPX-NIC: An FPGA-Accelerated 4K Ultra-High-Definition Neural Video Coding System

Real-time lossless image compression by dynamic Huffman coding hardware implementation

NetFEC: In-network FEC Encoding Acceleration for Latency-sensitive Multimedia Applications

FPGA bitstream compression and decompression using LZ and golomb coding (abstract only).

UH-JLS: A Parallel Ultra-High Throughput JPEG-LS Encoding Architecture for Lossless Image Compression

An Optimization Method of WebP Images Lossy Compression Algorithm for FPGAs.

A self-aware data compression system on FPGA in Hadoop