Abstract:Compared to commonly used loss-based congestion control algorithms predominantly used in Transmission Control Protocol (TCP) implementations, congestion-based congestion control called BBR has shown much better performance in resource-abundant modern communication links. However, for a high influx of TCP sessions on the bottleneck switch, clusters in High-Performance Compute (HPC) nodes and data centers face resource constraints because of the immense workload during orchestration and relocation of workflows across the resource pool. This article discusses how to resolve this problem, commonly known as TCP incast, through efficient queue management of the bottleneck link and adding a shaper function in the standard BBR algorithm. We analyzed TCP incast issue for two efficient versions of congestion control i.e., BBR and CUBIC (named after the cubic function used instead of linear function), in a highly overloaded convergent switch of the cluster. It is noticeable that the queuing delay and buffer build-up are two essential parameters in causing TCP Incast. Hence, we used the M/G/1/B queuing model when multiple TCP sessions generate the network traffic and different buffer build-up scenarios are analyzed in the bottleneck node of HPC clusters. Based on the findings of our queuing analysis, we propose an incast recovery BBR algorithm that introduces additional controls like Incast shaping to deal with queue build-up during TCP incast. The effects of these modifications in BBR implementation are studied in terms of performance parameters like flow completion time, throughput, RTT variations, and fairness to other competing flows are significant compared with standard BBR and CUBIC implementations.

IBperf: A Testing and Evaluation Model of IB Datacenter Transmission Control

Receiver-Driven Congestion Control for InfiniBand.

IBShare : A Dynamic IB Bandwidth Allocation Based on Congestion Control ⋆

Research of Infiniband Architecture

Survey on transport control in data center networks.

FlowStar: Fast Convergence Per-Flow State Accurate Congestion Control for InfiniBand

Optimizing Data Transport Efficiency in Datacenters through Traffic Shaping of BBR Congestion Control

A Large Scale Data Transmission Control Mechanism Across Data Centers.

Management Framework for IBA

Measuring congestion-induced performance imbalance in internet load balancing at scale

HPLB: High precision load balancing based on in-band network telemetry in data center networks

Study On Testing And Evaluation Of Fiber Based Storage Network

Modeling and Analyzing the Performance of High-Speed Packet I/O

Transmission Performance Evaluation Throughout the Life Cycle of Lightpath in Intelligent Optical Networks

Performance Evaluation and Analysis of Bundle Protocol in Cislunar Communications

An Index-Bit Enabled Transmission Scheme with Dynamic Balancing

ICLB: intelligent controllers load balancing for software-defined based optical data center networks

Transmission Control of MPTCP Incast Based on Buffer Balance Factor Allocation in Data Center Networks

Modeling and Understanding TCP's Fairness Problem in Data Center Networks

Data Transfer Performance Analysis and Enhancement of Critical 3D Interconnects in a 3D SiP Based on Communication Channel Modeling Methodology

One Rein to Rule Them All: A Framework for Datacenter-to-User Congestion Control