Abstract:Though Remote Direct Memory Access (RDMA) promises to reduce datacenter network latencies significantly compared to TCP (e.g., 10 $\times$ ), end-to-end congestion control in the presence of incasts is a challenge. Targeting the full generality of the congestion problem, previous schemes rely on slow, iterative convergence to the appropriate sending rates (e.g., TIMELY takes 50 RTTs). Several papers have shown that even in oversubscribed datacenter networks most congestion occurs at the receiver. Accordingly, we propose a divide-and-specialize approach, called Dart , which isolates the common case of receiver congestion and further subdivides the remaining in-network congestion into the simpler spatially-localized and the harder spatially-dispersed cases. For receiver congestion, we propose direct apportioning of sending rates (DASR) in which a receiver for $n$ senders directs each sender to cut its rate by a factor of $n$ , converging in only one RTT. For the spatially-localized case, Dart provides fast (under one RTT) response by adding novel switch hardware for in-order flow deflection (IOFD) because RDMA disallows packet reordering on which previous load balancing schemes rely. For the uncommon spatially-dispersed case, Dart falls back to DCQCN. Small-scale testbed measurements and at-scale simulations, respectively, show that Dart achieves 60% (2.5 $\times$ ) and 79% (4.8 $\times$ ) lower $99^{th}$ -percentile latency, and similar and 58% higher throughput than InfiniBand, and TIMELY and DCQCN.

DySched: Relieving Large-Scale Incast for Cloud-Native RDMA Applications

Srdma: A General and Low-Overhead Scheduler for RDMA.

X-RDMA: Effective RDMA Middleware in Large-scale Production Environments.

DCQCN+: Taming Large-Scale Incast Congestion in RDMA over Ethernet Networks

RDMAvisor: Toward Deploying Scalable and Simple RDMA as a Service in Datacenters

An efficient cloud-based elastic RDMA protocol for HPC applications

Dart: Divide and Specialize for Fast Response to Congestion in RDMA-Based Datacenter Networks

MC-RDMA: Improving Replication Performance of RDMA-based Distributed Systems with Reliable Multicast Support

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

When Cloud Storage Meets RDMA.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Toward Effective and Fair RDMA Resource Sharing.

SeqBalance: Congestion-Aware Load Balancing with no Reordering for RoCE

RDMA Load Balancing via Data Partition

Zero+: Monitoring Large-Scale Cloud-Native Infrastructure Using One-Sided RDMA

Towards Zero Copy Dataflows using RDMA

Network Load Balancing with In-network Reordering Support for RDMA

Csrna: Connection-Scalable RDMA NIC Architecture in Datacenter Environment

Scalable RDMA RPC on Reliable Connection with Efficient Resource Sharing

POSTER: CAVER: Enhancing RDMA Load Balancing by Hunting Less-Congested Paths

SoftRDMA