Abstract:Disaggregated memory systems separate monolithic servers into different components, including compute and memory nodes, to enjoy the benefits of high resource utilization, flexible hardware scalability, and efficient data sharing. By exploiting the high-performance RDMA (Remote Direct Memory Access), the compute nodes directly access the remote memory pool without involving remote CPUs. Hence, the ordered key-value (KV) stores (e.g., B-trees and learned indexes) keep all data sorted to provide rang query service via the high-performance network. However, existing ordered KVs fail to work well on the disaggregated memory systems, due to either consuming multiple network roundtrips to search the remote data or heavily relying on the memory nodes equipped with insufficient computing resources to process data modifications. In this paper, we propose a scalable RDMA-oriented KV store with learned indexes, called ROLEX, to coalesce the ordered KV store in the disaggregated systems for efficient data storage and retrieval. ROLEX leverages a retraining-decoupled learned index scheme to dissociate the model retraining from data modification operations via adding a bias and some data-movement constraints to learned models. Based on the operation decoupling, data modifications are directly executed in compute nodes via one-sided RDMA verbs with high scalability. The model retraining is hence removed from the critical path of data modification and asynchronously executed in memory nodes by using dedicated computing resources. ROLEX efficiently alleviates the fragmentation and garbage collection issues, due to allocating and reclaiming space via fixed-size leaves that are accessed via the atomic-size leaf numbers. Our experimental results on YCSB and real-world workloads demonstrate that ROLEX achieves competitive performance on the static workloads, as well as significantly improving the performance on dynamic workloads by up to 2.2 × than state-of-the-art schemes on the disaggregated memory systems. We have released the open-source codes for public use in GitHub.

HeteroKV: A Scalable Line-rate Key-Value Store on Heterogeneous CPU-FPGA Platforms.

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA

KVLB: an In-network Key-Value Load Balancer Using Multi-Valued Hash

Memory efficient and high performance key-value store on FPGA using Cuckoo hashing

Ultra-Low Latency and High Throughput Key-Value Store Systems over Ethernet.

A Low-Latency Multi-Version Key-Value Store Using B-Tree on an FPGA-CPU Platform.

A Distributed In-Memory Key-Value Store System on Heterogeneous CPU–GPU Cluster

High Throughput and Low Latency Multi-Version Management Key-Value Storage Accelerator

A Fully-Pipelined Hash Table Achieving Low-Latency and High Throughput Key-Value Retrieving System.

Put an Elephant into a Fridge

Mega-KV

Honeycomb: ordered key-value store acceleration on an FPGA-based SmartNIC

FPGA-Accelerated Compactions for LSM-based Key-Value Store.

High-Throughput and Low-Latency Distributed Management Proxy for Key-Value Store Over 100Gbps Ethernet on FPGA

FeFET-Based In-Memory Hyperdimensional Encoding Design

The Design and Implementation of UniKV for Mixed Key-Value Storage Workloads

BonsaiKV: Towards Fast, Scalable, and Persistent Key-Value Stores with Tiered, Heterogeneous Memory System

HeterMM: applying in-DRAM index to heterogeneous memory-based key-value stores

A High-Performance RDMA-oriented Learned Key-Value Store for Disaggregated Memory Systems

Enabling Efficient Updates in KV Storage via Hashing: Design and Performance Evaluation

Hetero-DB：Next Generation High-Performance Database Systems by Best Utilizing Heterogeneous Computing and Storage Resources