Abstract:Remote Direct Memory Access (RDMA) is an efficient way to improve the performance of traditional client-server systems. Currently, there are two main design paradigms for RDMA-accelerated systems. The first allows the clients to directly operate the server's memory and totally bypasses the CPUs at server side. The second follows the traditional server-reply paradigm, which asks the server to write results back to the clients. However, the first method has to expose server's memory and needs tremendous re-design of upper-layer software, which is complex, unsafe, error-prone, and inefficient. The second cannot achieve high input/output operations per second (IOPS), because it employs out-bound RDMA-write at server side which is not efficient. We find that the performance of out-bound RDMA-write and in-bound RDMA-read is asymmetric and the latter is 5 times faster than the former. Based on this observation, we propose a novel design paradigm named Remote Fetching Paradigm (RFP). In RFP, the server is still responsible for processing requests from the clients. However, counter-intuitively, instead of sending results back to the clients through out-bound RDMA-write, the server only writes the results in local memory buffers, and the clients use in-bound RDMA-read to remotely fetch these results. Since in-bound RDMA-read achieves much higher IOPS than out-bound RDMA-write, our model is able to bring higher performance than the traditional models. In order to prove the effectiveness of RFP, we design and implement an RDMA-accelerated in-memory key-value store following the RFP model. To further improve the IOPS, we propose an optimization mechanism that combines status checking and result fetching. Experiment results show that RFP can improve the IOPS by 160%~310% against state-of-the-art models for in-memory key-value stores.

A High-Performance FPGA-Based RoCE v2 RDMA Packet Parser and Generator

FPGA Implementation of RDMA-Based Data Acquisition System Over 100 GbE

RFT: Toward Highly Reliable Flow Data Transmission in Network Measurement

Extending On-Chip Interconnects for Rack-Level Remote Resource Access

Performance profiling and design choices of an RDMA implementation using FPGA devices

An Out-of-Order Packet Processing Algorithm of RoCE Based on Improved SACK

RF-RPC: Remote Fetching RPC Paradigm for RDMA-Enabled Network

Error Recovery of RDMA Packets in Data Center Networks

SoftRDMA

SRNIC: A Scalable Architecture for RDMA NICs

StRoM: Smart Remote Memory

Front-end RDMA over Converged Ethernet, real-time firmware simulation

Towards connection-scalable RNIC architecture

Switch-Assistant Loss Recovery for RDMA Transport Control

Bifrost: Extending RoCE for Long Distance Inter-DC Links

RFP: A Remote Fetching Paradigm for RDMA-Accelerated Systems

Revisiting network support for RDMA

RFP: When RPC is Faster than Server-Bypass with RDMA.

ORCA: A Network and Architecture Co-design for Offloading us-scale Datacenter Applications

An efficient cloud-based elastic RDMA protocol for HPC applications

Maximizing the Benefit of RDMA at End Hosts