Abstract:Memory disaggregation is a promising architecture for modern datacenters that separates compute and memory resources into independent pools connected by ultra-fast networks, which can improve memory utilization, reduce cost, and enable elastic scaling of compute and memory resources. However, existing memory disaggregation solutions based on remote direct memory access (RDMA) suffer from high latency and additional overheads including page faults and code refactoring. Emerging cache-coherent interconnects such as CXL offer opportunities to reconstruct high-performance memory disaggregation. However, existing CXL-based approaches have physical distance limitation and cannot be deployed across racks. In this article, we propose Rcmp, a novel low-latency and highly scalable memory disaggregation system based on RDMA and CXL. The significant feature is that Rcmp improves the performance of RDMA-based systems via CXL, and leverages RDMA to overcome CXL’s distance limitation. To address the challenges of the mismatch between RDMA and CXL in terms of granularity, communication, and performance, Rcmp (1) provides a global page-based memory space management and enables fine-grained data access, (2) designs an efficient communication mechanism to avoid communication blocking issues, (3) proposes a hot-page identification and swapping strategy to reduce RDMA communications, and (4) designs an RDMA-optimized RPC framework to accelerate RDMA transfers. We implement a prototype of Rcmp and evaluate its performance by using micro-benchmarks and running a key-value store with YCSB benchmarks. The results show that Rcmp can achieve 5.2× lower latency and 3.8× higher throughput than RDMA-based systems. We also demonstrate that Rcmp can scale well with the increasing number of nodes without compromising performance.

CITRON: Distributed Range Lock Management with One-sided RDMA

Using RDMA for Lock Management

Scalable Range Locks for Scalable Address Spaces and Beyond

Reducing Scalability Collapse Via Requester-Based Locking on Multicore Systems

RDMA-enabled Concurrency Control Protocols for Transactions in the Cloud Era

ALock: Asymmetric Lock Primitive for RDMA Systems

Scalable RDMA RPC on Reliable Connection with Efficient Resource Sharing

Fast and Scalable In-network Lock Management Using Lock Fission.

POSTER: CAVER: Enhancing RDMA Load Balancing by Hunting Less-Congested Paths

A Comprehensive Evaluation of RDMA-enabled Concurrency Control Protocols.

Dart: Divide and Specialize for Fast Response to Congestion in RDMA-Based Datacenter Networks

Rcmp: Reconstructing RDMA-Based Memory Disaggregation via CXL

SeqDLM: A Sequencer-Based Distributed Lock Manager for Efficient Shared File Access in a Parallel File System

RB2: Narrow the Gap Between RDMA Abstraction and Performance Via a Middle Layer

Conflux: Exploiting Persistent Memory and RDMA Bandwidth Via Adaptive I/O Mode Selection.

Efficient Distributed Memory Management with RDMA and Caching

Semi-Preemptible Range Lock in Parallel Network File System (pNFS)

Csrna: Connection-Scalable RDMA NIC Architecture in Datacenter Environment

RDMA Performance Isolation With Justitia

RDMA Load Balancing via Data Partition

Scalable Adaptive NUMA-Aware Lock.