Abstract:Disaggregated memory systems separate monolithic servers into different components, including compute and memory nodes, to enjoy the benefits of high resource utilization, flexible hardware scalability, and efficient data sharing. By exploiting the high-performance RDMA (Remote Direct Memory Access), the compute nodes directly access the remote memory pool without involving remote CPUs. Hence, the ordered key-value (KV) stores (e.g., B-trees and learned indexes) keep all data sorted to provide rang query service via the high-performance network. However, existing ordered KVs fail to work well on the disaggregated memory systems, due to either consuming multiple network roundtrips to search the remote data or heavily relying on the memory nodes equipped with insufficient computing resources to process data modifications. In this paper, we propose a scalable RDMA-oriented KV store with learned indexes, called ROLEX, to coalesce the ordered KV store in the disaggregated systems for efficient data storage and retrieval. ROLEX leverages a retraining-decoupled learned index scheme to dissociate the model retraining from data modification operations via adding a bias and some data-movement constraints to learned models. Based on the operation decoupling, data modifications are directly executed in compute nodes via one-sided RDMA verbs with high scalability. The model retraining is hence removed from the critical path of data modification and asynchronously executed in memory nodes by using dedicated computing resources. ROLEX efficiently alleviates the fragmentation and garbage collection issues, due to allocating and reclaiming space via fixed-size leaves that are accessed via the atomic-size leaf numbers. Our experimental results on YCSB and real-world workloads demonstrate that ROLEX achieves competitive performance on the static workloads, as well as significantly improving the performance on dynamic workloads by up to 2.2 × than state-of-the-art schemes on the disaggregated memory systems. We have released the open-source codes for public use in GitHub.

EKRM: Efficient Key-Value Retrieval Method to Reduce Data Lookup Overhead for Redis.

Put an Elephant into a Fridge

Penalty- and Locality-aware Memory Allocation in Redis Using Enhanced AET

Reo: Enhancing Reliability and Efficiency of Object-based Flash Caching

pRedis - Penalty and Locality Aware Memory Allocation in Redis.

Towards Scalable And Reliable In-Memory Storage System: A Case Study With Redis

KVLB: an In-network Key-Value Load Balancer Using Multi-Valued Hash

Lightweight and Accurate Memory Allocation in Key-Value Cache

A High-Performance Key-Value Query Solution Based on Hash Dictionary and Trie Tree

Small File Read Performance Optimization Based on Redis Cache in Distributed Storage System

Efficient Cache Resource Aggregation Using Adaptive Multi-Level Exclusive Caching Policies

Optimizing Locality-Aware Memory Management of Key-Value Caches.

InnerCache: A Tactful Cache Mechanism for RDMA-Based Key-Value Store.

Enabling High Performance and Resource Utilization in Clustered Cache Via Hotness Identification, Data Copying, and Instance Merging

LAMA: Optimized Locality-aware Memory Allocation for Key-value Cache.

Redis automatic performance tuning based on eBPF

XStore : Fast RDMA-Based Ordered Key-Value Store Using Remote Learned Cache

High-Performance Remote Data Persisting for Key-Value Stores via Persistent Memory Region

RadixKV - A Memory Efficient and High Performance Key-Value Store.

UDORN: A Design Framework of Persistent In-Memory Key-Value Database for NVM

A High-Performance RDMA-oriented Learned Key-Value Store for Disaggregated Memory Systems