Abstract:In-memory key-value store (KVS) is critical infrastructure in data centers and is facing challenges in performance and power consumption with the development of the big data technology, which mainly results from the low efficiency of the multi-level memory hierarchy of the CPU-based system. Remote direct memory access (RDMA) technology partly alleviates the problems, but it is still not efficient for KVS, especially for the PUT operation. In this paper, we present an ultra-low-latency and flexible in-memory KVS system based on the CPU-FPGA heterogeneous architecture, which leverages FPGA to serve as a KVS accelerator. We design a highly parallel accelerator architecture with several novel techniques, including memory pre-allocation, fragmentation processing, and decoupling design, to achieve ultra-low latency, high flexibility, efficiency, and scalability. The system workload can scale up with the storage capacity due to the decoupling design which stores the hash table in onboard DRAM memory and values in the host memory. For each KVS operation, at most one PCIe DMA is needed, which achieves high efficiency. Compared with current hardware-based KVS systems, the proposed one is more flexible, where the supported value range is 4x wider (from 1 byte to 4M bytes). In 10Gbps Ethernet, the peak throughput of the system can reach 13.6 million key-value operations per second (Mops), achieving nearly full utilization of the Ethernet bandwidth. The system latency can achieve as low as 1.2us for the PUT operation and 1.7us for the GET operation, which is 3.8x and 2.0x faster respectively than current state-of-the-art KVS systems.

KVLB: an In-network Key-Value Load Balancer Using Multi-Valued Hash

Vswitchlb: Stratified Load Balancing for Vswitch Efficiency in Data Centers

SDSSE: A Self-Driven RPC Load Balancing Method in Datacenter

An Implementation of LVS-based Highly-Available Radius Server

Randomized Algorithm for Virtual Network Mapping Problem Based on Load Balancing

HeteroKV: A Scalable Line-rate Key-Value Store on Heterogeneous CPU-FPGA Platforms.

NetCache: Balancing Key-Value Stores with Fast In-Network Caching.

A Fully-Pipelined Hash Table Achieving Low-Latency and High Throughput Key-Value Retrieving System.

Ultra-Low Latency and High Throughput Key-Value Store Systems over Ethernet.

Hashkv: Enabling Efficient Updates In Kv Storage Via Hashing

High Throughput and Low Latency Multi-Version Management Key-Value Storage Accelerator

The Design and Implementation of UniKV for Mixed Key-Value Storage Workloads

High-Throughput and Low-Latency Distributed Management Proxy for Key-Value Store Over 100Gbps Ethernet on FPGA

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA

SKV: A SmartNIC-Offloaded Distributed Key-Value Store.

A Low-Latency Multi-Version Key-Value Store Using B-Tree on an FPGA-CPU Platform.

UniKV: Toward High-Performance and Scalable KV Storage in Mixed Workloads via Unified Indexing

Poster: Triton: Accelerating Vswitch with Flexibility Through Hardware Assisting Not Bypassing Software

LibreKV: A Persistent In-Memory Key-Value Store

Achieving Flexible, Low-Latency and 100gbps Line-rate Load Balancing over Ethernet on FPGA

Safe Randomized Load-Balanced Switching by Diffusing Extra Loads