Abstract:Emerging reconfigurable data centers introduce unprecedented flexibility in how the physical layer can be programmed to adapt to current traffic demands. These reconfigurable topologies are commonly hybrid, consisting of static and reconfigurable links, enabled by e.g. an Optical Circuit Switch (OCS) connected to top-of-rack switches in Clos networks. Even though prior work has showcased the practical benefits of hybrid networks, several crucial performance aspects are not well understood. For example, many systems enforce artificial segregation of the hybrid network parts, leaving money on the table. In this paper, we study the algorithmic problem of how to jointly optimize topology and routing in reconfigurable data centers, in order to optimize a most fundamental metric, maximum link load. The complexity of reconfiguration mechanisms in this space is unexplored at large, especially for the following cross-layer network-design problem: given a hybrid network and a traffic matrix, jointly design the physical layer and the flow routing in order to minimize the maximum link load. We chart the corresponding algorithmic landscape in our work, investigating both un-/splittable flows and (non-)segregated routing policies. A topological complexity classification of the problem reveals NP-hardness in general for network topologies that are trees of depth at least two, in contrast to the tractability on trees of depth one. We moreover prove that the problem is not submodular for all these routing policies, even in multi-layer trees. However, networks that can be abstracted by a single packet switch (e.g., nonblocking Fat-Tree topologies) can be optimized efficiently, and we present optimal polynomial-time algorithms accordingly. We complement our theoretical results with trace-driven simulation studies, where our algorithms can significantly improve the network load in comparison to the state of the art.

Hybrid complex network topologies are preferred for component-subscription in large-scale data-centres

Decluster: a Complex Network Model-Based Data Center Network Topology.

BCN: Expansible Network Structures for Data Centers Using Hierarchical Compound Graphs

Load-Optimization in Reconfigurable Data-Center Networks: Algorithms and Complexity of Flow Routing

Flexible, highly scalable and cost-effective network structures for data centers

BCN: Bidimensional Compound Networks for Data Centers

Suppressing cascades of load in interdependent networks

A complex network approach to cloud computing

GHDC: a dual-centric data center network architecture by using multi-port servers with greater incremental scalability

Impact of Network Topology on the Performance of DML: Theoretical Analysis and Practical Factors

Expandable and Cost-Effective Network Structures for Data Centers Using Dual-Port Servers.

How Network Topology Affects the Strength of Dangerous Power Grid Perturbations

Network Topology Reconfiguration Based on Risk Management

A Hybrid Multiscale Coarse-Grained Method for Dynamics on Complex Networks

BCDC: A High-Performance, Server-Centric Data Center Network

High Throughput Data Center Topology Design

Network Topologies for Composable Data Centres

Small versus large: Switch sizing in topology design of energy-efficient data centers.

Topological Optimization of Hybrid Quantum Key Distribution Networks

Sierpinski Triangle Based Data Center Architecture in Cloud Computing.

Towards Communication-Aware Robust Topologies