Abstract:Scheduling of coflows, each a collection of parallel flows sharing the same objective, is an important task of data transmission that arises in the networks supporting data-intensive applications such as data center networks (DCNs). The hybrid switch design combining the optical circuit switch (OCS) and electrical packet switch (EPS) for transmitting high-volume and low-volume traffic separately has received considerable research attention. To support this design, efficient scheduling of coflows on hybrid network links is crucial for reducing the overall communication time. However, because it needs to consider both reconfiguration delay of circuit switching in the OCS and bandwidth limitation of packet switching in the EPS, coflow scheduling on hybrid network links is more challenging than on monotonic network links of either OCS or EPS. The existing coflow scheduling algorithms in hybrid switches are all heuristic and provide no performance guarantees. In this work, we first propose an approximation algorithm with a worst-case performance guarantee of $2\tau$ , where $\tau\le N$ is the maximum number of non-zero elements of each row and column of coflow’s demand matrix, for single coflow scheduling in an $N\times N$ hybrid switch to minimize the coflow completion time (CCT). We then extend the algorithm for scheduling multiple coflows to minimize the total weighted CCT with a provable performance guarantee of $\mu\tau_{\max}$ , where $\mu=4M\cdot\frac{w_{\max}}{w_{\min}}$ , $\tau_{\max}=\max_{1\le m\le M}\tau_{m}\leq N$ , $w_{\max}$ and $w_{\min}$ are respectively the maximum and minimum weights of the $M$ coflows. Extensive simulations using Facebook data traces show that our algorithms outperform the state-of-the-art coflow scheduling schemes. Specifically, our algorithms transmit a single coflow up to 1.08 $\times$ faster than Solstice (hybrid switch) and 1.42 $\times$ faster than Reco-Sin (pure OCS), and multiple coflows up to 1.11 $\times$ faster than Solstice and 1.17 $\times$ faster than Reco-Mul $+$ (pure OCS).

Effective *-Flow Schedule for Optical Circuit Switching Based Data Center Networks: A Comprehensive Survey

Omco: Online Multiple Coflow Scheduling In Optical Circuit Switch

Regularization-Based Coflow Scheduling in Optical Circuit Switches

Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks

Minimizing Coflow Completion Time in Optical Circuit Switched Networks.

OSA: an Optical Switching Architecture for Data Center Networks with Unprecedented Flexibility

A Non-Centralized Routing Scheme with Phase-Caching CDR for Nanosecond-Level Optical Switching Systems

On the Performance of a Scalable Optical Switching Architecture for Flat Intercluster Data Center Network with Centralized Control

Research on control and management mechanism of an optical network testbed based on flow switching

Efficient Coflow Scheduling in Hybrid-Switched Data Center Networks

Research on Traffic Identification and Scheduling Based on Optical Interconnection Architecture in Data Center

Optical Switching Data Center Networks: Understanding Techniques and Challenges

Scheduling Techniques for Hybrid Circuit/packet Networks

Group Scheduling Based on Control-Packet Batch Processing in Optical Burst Switched Networks

Energy-efficient Scaling of Active Electrical/Optical Switches in Hybrid Packet/Circuit Switched Data Center Networks

Enabling Low Latency at Large-Scale Data Center and High-Performance Computing Interconnect Networks Using Fine-Grained All-Optical Switching Technology

Optical Flow Switching Based on Time-Shift Scheduling

Data-Oriented Task Scheduling in Fixed- and Flexible-Grid Multilayer Inter-DC Optical Networks: A Comparison Study

Scheduling Coflows in Hybrid Optical-Circuit and Electrical-Packet Switches with Performance Guarantee

Optical Flooding Cluster Switching (OFCS)

DiFS: Distributed Flow Scheduling for Data Center Networks