Abstract:Scheduling of coflows, each a collection of parallel flows sharing the same objective, is an important task of data transmission that arises in the networks supporting data-intensive applications such as data center networks (DCNs). The hybrid switch design combining the optical circuit switch (OCS) and electrical packet switch (EPS) for transmitting high-volume and low-volume traffic separately has received considerable research attention. To support this design, efficient scheduling of coflows on hybrid network links is crucial for reducing the overall communication time. However, because it needs to consider both reconfiguration delay of circuit switching in the OCS and bandwidth limitation of packet switching in the EPS, coflow scheduling on hybrid network links is more challenging than on monotonic network links of either OCS or EPS. The existing coflow scheduling algorithms in hybrid switches are all heuristic and provide no performance guarantees. In this work, we first propose an approximation algorithm with a worst-case performance guarantee of $2\tau$ , where $\tau\le N$ is the maximum number of non-zero elements of each row and column of coflow’s demand matrix, for single coflow scheduling in an $N\times N$ hybrid switch to minimize the coflow completion time (CCT). We then extend the algorithm for scheduling multiple coflows to minimize the total weighted CCT with a provable performance guarantee of $\mu\tau_{\max}$ , where $\mu=4M\cdot\frac{w_{\max}}{w_{\min}}$ , $\tau_{\max}=\max_{1\le m\le M}\tau_{m}\leq N$ , $w_{\max}$ and $w_{\min}$ are respectively the maximum and minimum weights of the $M$ coflows. Extensive simulations using Facebook data traces show that our algorithms outperform the state-of-the-art coflow scheduling schemes. Specifically, our algorithms transmit a single coflow up to 1.08 $\times$ faster than Solstice (hybrid switch) and 1.42 $\times$ faster than Reco-Sin (pure OCS), and multiple coflows up to 1.11 $\times$ faster than Solstice and 1.17 $\times$ faster than Reco-Mul $+$ (pure OCS).

Optimal Scheduling Control in Fluid Models of General $n\times n$ Input-Queued Switches

Delay-Constrained Input-Queued Switch.

Coflow Scheduling in Input-Queued Switches: Optimal Delay Scaling and Algorithms

Optimal switching control of message transmission in computer networks

Throughput-Optimal Scheduling for Multi-Hop Networked Transportation Systems With Switch-Over Delay

Single-machine scheduling to minimize total convex resource consumption with a constraint on total weighted flow time

Low-Complexity Switch Scheduling Algorithms: Delay Optimality in Heavy Traffic

Bicriteria Common Flow Allowance Scheduling with Aging Effect, Convex Resource Allocation, and a Rate-Modifying Activity on a Single Machine.

Minimizing the Communication Overhead of Iterative Scheduling Algorithms for Input-Queued Switches.

Optimization of the fluid model of scheduling: local predictions

Scheduling Coflows in Hybrid Optical-Circuit and Electrical-Packet Switches with Performance Guarantee

Optimal differentiated threshold characterization for multi-task stochastic deadline scheduling with queuing

Convex Resource Allocation Scheduling in the No-Wait Flowshop with Common Flow Allowance and Learning Effect.

Dynamic Scheduling Of A Multiclass Fluid Network

Optimal-Control And Scheduling In A Multiclass Queuing Network - Results And Conjectures

Dynamic Scheduling Control for a Network of Queues

Delay-Optimal Buffer-Aware Scheduling with Adaptive Transmission

What Appears Suboptimal May Surprise You: A Fixed-Rate Scheduling Policy for Geo-Distributed CoFlows

Infinite-horizon optimal scheduling for feedback control

Bounded-Velocity Stochastic Control for Dynamic Resource Allocation

Optimal Control for Generalized Network-Flow Problems