Abstract:In-memory key-value store (KVS) is critical infrastructure in data centers and is facing challenges in performance and power consumption with the development of the big data technology, which mainly results from the low efficiency of the multi-level memory hierarchy of the CPU-based system. Remote direct memory access (RDMA) technology partly alleviates the problems, but it is still not efficient for KVS, especially for the PUT operation. In this paper, we present an ultra-low-latency and flexible in-memory KVS system based on the CPU-FPGA heterogeneous architecture, which leverages FPGA to serve as a KVS accelerator. We design a highly parallel accelerator architecture with several novel techniques, including memory pre-allocation, fragmentation processing, and decoupling design, to achieve ultra-low latency, high flexibility, efficiency, and scalability. The system workload can scale up with the storage capacity due to the decoupling design which stores the hash table in onboard DRAM memory and values in the host memory. For each KVS operation, at most one PCIe DMA is needed, which achieves high efficiency. Compared with current hardware-based KVS systems, the proposed one is more flexible, where the supported value range is 4x wider (from 1 byte to 4M bytes). In 10Gbps Ethernet, the peak throughput of the system can reach 13.6 million key-value operations per second (Mops), achieving nearly full utilization of the Ethernet bandwidth. The system latency can achieve as low as 1.2us for the PUT operation and 1.7us for the GET operation, which is 3.8x and 2.0x faster respectively than current state-of-the-art KVS systems.

High-Throughput and Low-Latency Distributed Management Proxy for Key-Value Store Over 100Gbps Ethernet on FPGA

KVLB: an In-network Key-Value Load Balancer Using Multi-Valued Hash

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA

Ultra-Low Latency and High Throughput Key-Value Store Systems over Ethernet.

HeteroKV: A Scalable Line-rate Key-Value Store on Heterogeneous CPU-FPGA Platforms.

Design and FPGA Verification of a Novel Reliable Real-Time Data Transfer System

High Throughput and Low Latency Multi-Version Management Key-Value Storage Accelerator

Achieving Flexible, Low-Latency and 100gbps Line-rate Load Balancing over Ethernet on FPGA

A Fully-Pipelined Hash Table Achieving Low-Latency and High Throughput Key-Value Retrieving System.

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

Memory efficient and high performance key-value store on FPGA using Cuckoo hashing

A Low-Latency Multi-Version Key-Value Store Using B-Tree on an FPGA-CPU Platform.

Honeycomb: ordered key-value store acceleration on an FPGA-based SmartNIC

A Domain-Specific Accelerator for Ultralow Latency Market Data Distribution System

SKV: A SmartNIC-Offloaded Distributed Key-Value Store.

NetStorageFPGA—A prototyping platform for building high-performance transmission and storage systems using Field Programmable Gate Array (FPGA) hardware

FABLE-DTS: Hardware-Software Co-Design of a Fast and Stable Data Transmission System for FPGAs

A High-Performance and Flexible Architecture for Accelerating SDN on the MPSoC Platform

Accelerating Graph Analytics by Co-Optimizing Storage and Access on an FPGA-HMC Platform

A Distributed In-Memory Key-Value Store System on Heterogeneous CPU–GPU Cluster

Efficient PC-FPGA Communication over Gigabit Ethernet