Abstract:Many applications in public clouds require a high fan-in, many-to-one type of data communication (known as TCP incast) in modern Data Center Networks (DCNs). Such communication could cause severe incast congestion in switches and result in TCP throughput collapse, substantially degrading the application performance. The root cause of throughput collapse is the Retransmission Timeouts (RTO) due to packet losses in congested switches. Tenants in public clouds can opt to use a variety of TCP versions. However, the existing solutions rely on modifications of TCP protocols and specific techniques from switches, and thus these existing solutions are not always feasible for public clouds. In this paper, we are inspired by the emerging virtualization and network softwarization technologies to develop a novel scheme called Retransmission timeout Avoidance by Packet Intelligent Discarding (RAPID) using software switches. RAPID considers the number of packets of each incast flow, buffered in the switch to selectively discard some packets, and ensures that the Fast Retransmission/Fast Recovery rather than RTO is invoked at the sender(s) in response to packet loss. Thus, the long idle period of a timeout and the throughput drop are avoided. We prove that, given a predetermined minimum switch buffer space, dedicated to the incast application, RAPID can prevent RTO in all the incast senders. We also present a low-complexity heuristic version of RAPID named RAPID-ED, which combines the principles of RAPID and early detection and is extremely easy to implement on today’s software switches. We evaluate the two proposed schemes in a data center network testbed built on NS-3 simulator. The simulation results confirm the theoretical expectation, and show that the RAPID and RAPID-ED perform very well to prevent RTO of TCP incast flows and hence the throughput collapse. Compared with other incast solutions, RAPID and RAPID-ED do not modify TCP protocols and therefore are more suitable in public clouds.

Taming TCP Incast Throughput Collapse in Data Center Networks

Analysis for TCP in Data Center Networks: Outcast and Incast

Modeling and Understanding Tcp Incast in Data Center Networks

TCP-FITDC: an Adaptive Approach to TCP Incast Avoidance for Data Center Applications

A Delay-Based Tcp For Solving Incast Problem In Data Centers

Preventing TCP Incast Throughput Collapse at the Initiation, Continuation, and Termination

Research on TCP Incast in Data Center Networks

Modeling and Solving Tcp Incast Problem in Data Center Networks

Comprehensive understanding of TCP Incast problem

Session-aware congestion control for TCP Incast in datacenter networks

A Coding-based Approach to Mitigate TCP Incast in Data Center Networks

Designing a new TCP based on FAST TCP for datacenter

Throughput Optimization of TCP Incast Congestion Control in Large-Scale Datacenter Networks

Enhancing TCP Incast congestion control over large-scale datacenter networks

CW-HSTCP: Fair TCP in High-Speed Networks

Adaptive rate control for TCP Incast based on selective ECN-marking

RAPID: Avoiding TCP Incast Throughput Collapse in Public Clouds with Intelligent Packet Discarding

Tuning the Aggressive TCP Behavior for Highly Concurrent HTTP Connections in Intra-Datacenter

An Algorithm for Reducing Loss Rate of High-Speed TCP

Tuning the Aggressive TCP Behavior for Highly Concurrent HTTP Connections in Data Center

Lttp: an Lt-Code Based Transport Protocol for Many-To-One Communication in Data Centers