OCBridge: an Efficient Topology Reconfiguration Strategy in Optical Data Center Network

Yinan Tang,Hongxiang Guo,Jian Wu

DOI: https://doi.org/10.1364/ofc.2018.w2a.18

2018-01-01

Abstract:We proposed an algorithm named OCBridge to effectively reconfigure the topology of optical data center network. Simulation results show it can reduce hotspots and achieve better throughput in data center networks compared with relative proposals.

What problem does this paper attempt to address?

Effectively Reconfigure the Optical Circuit Switching Layer Topology in Data Center Network by OCBridge

Yinan Tang,Hongxiang Guo,Yong Zhu,Tongtong Yuan,Xiong Gao,Cen Wang,Jian Wu

DOI: https://doi.org/10.1109/JLT.2018.2883387

IF: 4.7

2019-01-01

Journal of Lightwave Technology

Abstract:All optical or hybrid electrical/optical switching data center network (DCN) architectures are capable of adapting the optical-layer topology to various network traffic demands based on the flexibility of optical switching technology. The topology reconfiguration strategies in previous research simply attempt to reconfigure optical circuit switching (OCS) links to offload heavier rack-to-rack traf...
A progressive topology rconfiguration algorithm in optical data center networks

Yu Hongfang,Shouxi Luo,Yangming Zhao,Sheng Wang,shizhong xu,xiaoning zhang

DOI: https://doi.org/10.1109/ICOCN.2015.7203630

2015-01-01

Abstract:In recent years there has been an exponential growth in the traffic of cloud data centers networks (DCNs). More and more users are outsourcing their computing demands and services to DCNs. To handle such increases in the workload and traffic in a scalable manner, many technologies have been proposed to provide dynamic topology to the network so as to adapt to the traffic. One representative is the optical switching architecture (OSA) as it provides tremendous flexibility. However, OSA requires too much time (10 ms) to reconfigure the topology. Reconfiguring the topology in one step not only brings much performance degradation to the delay sensitive flows, but also incurs large traffic losses in high throughput low latency DCNs. Therefore, a progressive topology reconfiguration scheme is required to guarantee the performance of delay sensitive flows and reduce the traffic loss. To this end, we propose a topology management algorithm (TMA) in this paper to design such a progressive topology reconfiguration scheme. With TMA, a sequence of intermediate topologies and routing schemes are derived. We leverage these intermediate topologies to realize the reconfiguration progressively, while maintaining the topology connectivity and reducing the total traffic loss during the topology reconfiguration. Through extensive real-trace driven simulation experiments, we find that TMA can reduce the traffic loss during topology reconfiguration with little computational overhead..
Experimental Demonstration Of Efficient Topology Reconstruction In Optical Switching Based Data Center Network

Yinan Tang,Hongxiang Guo,Xiang Li,Jian Wu

DOI: https://doi.org/10.1109/icocn.2017.8121472

2017-01-01

Abstract:We review our previously proposed topology reconstruction mechanism in the small world topology based optical data center network (DCN). We also present some recent experimental demonstration results, which verified that the topology reconstruction can reduce the number of hotspots and thus further accelerate data analysis jobs in DCN.
Enabling Quasi-Static Reconfigurable Networks With Robust Topology Engineering

Min Yee Teh,Shizhen Zhao,Peirui Cao,Keren Bergman

DOI: https://doi.org/10.1109/TNET.2022.3210534

2023-01-01

IEEE/ACM Transactions on Networking

Abstract:Many optical circuit switched data center networks (DCN) have been proposed in the last decade to attain higher capacity and topology reconfigurability, though commercial adoption of these architectures have been minimal. One major challenge these architectures face is the difficulty of handling uncertain traffic demands using commercial optical circuit switches (OCS) with high switching latency. Prior works have generally focused on developing fast-switching OCS prototypes to quickly react to traffic variations through frequent reconfigurations. This approach, however, adds tremendous complexity overhead to the control plane, and raises the barrier for commercial adoption of optical circuit switched data center networks. We propose, a robust topology and routing optimization framework for reconfigurable optical circuit switched data centers. co-optimizes topology and routing based on a convex set of traffic matrices, and offers strict throughput guarantees for any future traffic matrices bounded by the convex set. For the bursty traffic demands that are unbounded by the convex set, we employ a desensitization technique to reduce performance hit. This enables to generate topology and routing solutions capable of handling unexpected traffic changes without relying on frequent topology reconfigurations. Our extensive evaluations based on Facebook's production DCN traces show that, even with daily reconfigurations which could be realized by current commercial MEMS-based OCSs from Calient Technologies, achieves about 20% lower max link utilization, and about 32% lower average hop count compared to cost-equivalent static topologies. Our work shows that adoption of reconfigurable topologies in commercial DCNs is feasible even without fast OCSs.
Fast and Nondisruptive Reconfiguration Design for Optical Datacom Networks

Wenbang Zheng,Xiaoliang Chen,Zhaohui Li

DOI: https://doi.org/10.1109/psc57974.2023.10297209

2023-01-01

Abstract:This paper proposes a fast and nondisruptive reconfiguration algorithm for topology migration in optical datacom networks. The proposed algorithm models the dependency between links to be removed as conflict graphs (CGs) and jointly optimizes the reconfiguration speed and traffic disruption by iteratively solving the maximum clique problems with the CGs. Numerical results show that the proposed algorithm can reduce the number of disrupted connections by ×74.5 with just 2.7 more reconfiguration stages on average compared with a baseline performing one-shot reconfiguration.
Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

YANG Wen,GUO Bing-li,YANG Hong-zhen,WANG Yan-bo,FAN Chao,MENG Ling-yu,HUANG Shan-guo

DOI: https://doi.org/10.13756/j.gtxyj.2022.01.003

2022-01-01

Abstract:Aiming at preventing the network performance deterioration caused by fixed link topology connections in optically switched networks, this paper proposes and validates an interconnection and control mechanism that can automatically optimize and reconfigure network topology according to the network traffic volume. This mechanism combines deep reinforcement learning with software defined network technology. Based on the real-time network performance parameters collected by the software-defined network control plane and the performance feedback of the network simulation system, the continuous training of the topology structure can be realized in the model of deep reinforcement learning. The automatic network topology reconfiguration is achieved with improved network performance. The experimental results show that for a given traffic intensity, the model trained by deep reinforcement learning can learn the topology reconstruction strategy and realize automatic selection. The optimal network topology structure can be achieved in one step, with reduced average network delay and average packet loss.
COUDER: Robust Topology Engineering for Optical Circuit Switched Data Center Networks

Min Yee Teh,Shizhen Zhao,Peirui Cao,Keren Bergman

DOI: https://doi.org/10.48550/arXiv.2010.00090

2020-10-01

Abstract:Many optical circuit switched data center networks (DCN) have been proposed in the past to attain higher capacity and topology reconfigurability, though commercial adoption of these architectures have been minimal. One major challenge these architectures face is the difficulty of handling uncertain traffic demands using commercial optical circuit switches (OCS) with high switching latency. Prior works have generally focused on developing fast-switching OCS prototypes to quickly react to traffic changes through frequent reconfigurations. This approach, however, adds tremendous complexity to the control plane, and raises the barrier for commercial adoption of optical circuit switched data center networks. We propose COUDER, a robust topology and routing optimization framework for reconfigurable optical circuit switched data centers. COUDER optimizes topology and routing based on a convex set of traffic matrices, and offers strict throughput guarantees for any future traffic matrices bounded by the convex set. For the bursty traffic demands that are unbounded by the convex set, we employ a desensitization technique to reduce performance hit. This enables COUDER to generate topology and routing solutions capable of handling unexpected traffic changes without relying on frequent topology reconfigurations. Our extensive evaluations based on Facebook's production DCN traces show that, even with daily reconfiguration, COUDER achieves about 20\% higher throughput, and about 32\% lower average hop count compared to cost-equivalent static topologies. Our work shows that adoption of reconfigurable topologies in commercial DCNs is feasible even without fast OCSs.

Networking and Internet Architecture
A new optical interconnection network for data centers

Gang Wu,Huaxi Gu,Xiaoshan Yu

DOI: https://doi.org/10.1109/WOCC.2013.6676425

2013-01-01

Abstract:The network topology is the foundation of data center networks, and it is directly related to the performance, management, operation, maintenance and many other aspects of data center networks. With the rapid growth of cloud computing, the demand for high bandwidth and low network latency increases greatly. Traditional tree-based topologies of data centers have some inherent problems such as poor scalability, the lack of path diversity, low bisection bandwidth, etc. In this paper, we propose a new optical interconnection topology for data centers, which is called OIT. In our theoretical analysis, OIT has good characters of scalability and path diversity. We also design a new routing algorithm according to its network features.
Dynamic Topology Management in Optical Data Center Networks

Yangming Zhao,Sheng Wang,Shouxi Luo,Hongfang Yu,Shizhong Xu,Xiaoning Zhang

DOI: https://doi.org/10.1109/glocom.2014.7037142

IF: 4.7

2015-01-01

Journal of Lightwave Technology

Abstract:In this paper, we study how to manage the topology reconfiguration in OSA-based datacenter networks (DCNs). Though an OSA-based DCN can change its topology to adapt to the traffic matrix and improve the network scalability, it requires too much time (10ms) to reconfigure the topology, which may not only incur a great amount of traffic loss in high throughput low latency DCNs, but also bring much performance degradation to the delay sensitive flows. Therefore, a progressive topology reconfiguration scheme is required to reduce the traffic loss and guarantee the performance of delay sensitive flows. To this end, we first formulate the problem as a mathematical model, and then analyze its feasibility and complexity. Based on these analyses, topology management algorithm (TMA) is proposed to calculate the topology reconfiguration scheme that can maintain the topology connectivity during reconfiguration. By simulation, we find that TMA can reduce the traffic loss during topology reconfiguration by up to 50% in most of the cases and reconfigure topology without traffic loss in some cases.
NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Cong Liang,Xiangli Song,Jing Cheng,Mowei Wang,Yashe Liu,Zhenhua Liu,Shizhen Zhao,Yong Cui

DOI: https://doi.org/10.1145/3651890.3672222

2024-07-29

Abstract:Recent advances in fast optical switching technology show promise in meeting the high goodput and low latency requirements of datacenter networks (DCN). We present NegotiaToR, a simple network architecture for optical reconfigurable DCNs that utilizes on-demand scheduling to handle dynamic traffic. In NegotiaToR, racks exchange scheduling messages through an in-band control plane and distributedly calculate non-conflicting paths from binary traffic demand information. Optimized for incasts, it also provides opportunities to bypass scheduling delays. NegotiaToR is compatible with prevalent flat topologies, and is tailored towards a minimalist design for on-demand reconfigurable DCNs, enhancing practicality. Through large-scale simulations, we show that NegotiaToR achieves both small mice flow completion time (FCT) and high goodput on two representative flat topologies, especially under heavy loads. Particularly, the FCT of mice flows is one to two orders of magnitude better than the state-of-the-art traffic-oblivious reconfigurable DCN design.

Networking and Internet Architecture
Leaf: Improving QoS for Reconfigurable Datacenters with Multiple Optical Circuit Switches

Jingzhou Wang,Gongming Zhao,Hongli Xu,Haibo Wang

DOI: https://doi.org/10.1109/iwqos61813.2024.10682931

2024-01-01

Abstract:Facing the huge volume of traffic and intensive traffic dynamics, the traditional datacenter architectures are behind the curve due to the fixed topology and the demand-oblivious nature. Driven by the traffic pattern, the reconfigurable technologies, like optical circuit switches (OCSes), are a promising alternative to further improve throughput when facing traffic dynamics, thanks to the high bandwidth and low reconfiguration time. However, existing works on OCSes are relatively elementary. Some of previous works only deploy single OCS which cannot adapt to large-scale datacenters, while others either cannot guarantee near-optimality or overlook practical issues like limited fiber capacity. These solutions may cause low throughput and long reconfiguration time, resulting in poor QoS. In this paper, we present Leaf to maximize throughput thus to further improve QoS, by deploying multiple OCSes to carry traffic in a cooperation manner. Furthermore, we also show its efficient reconfiguration ability and near-optimality. The formulated problem is a new k-weight limited matching problem and is proven to be N P-hard, which can be solved by a new proposed approximation algorithm with bounded approximation ratio. To evaluate our proposed solution, simulation experiments are conducted with both real-world and synthetic datasets. Compared with state-of-the-arts works, Leaf can improve throughput by 42.16%−68.92%, and reduce runnning time by 68.87%−78.72%.
Achieving Efficient Routing in Reconfigurable DCNs.

Zhenjie Yang,Yong Cui,Shihan Xiao,Xin Wang,Minming Li,Chuming Li,Yadong Liu

DOI: https://doi.org/10.1145/3366695

2019-01-01

Proceedings of the ACM on Measurement and Analysis of Computing Systems

Abstract:Heavy and highly dynamic traffic demands in today's data center networks (DCNs) pose great challenges to efficient traffic engineering. With gigabit bandwidth, wireless communication technologies, such as free space optics and 60GHz wireless, are promising to augment DCNs and enable efficient traffic engineering. Complementary to the emerging reconfigurable architectures, we aim to achieve efficient routing and effectively balance the load with the performance guarantee. We derive a general interference model and propose a decomposition technique with proven performance guarantee and solve the load balancing problem in reconfigurable DCNs. In addition, we propose two solutions, WiRo and OFS, to flexibly reconfigure network topology and enable hybrid-routing with paths consisting of both stable wired links and flexible wireless links with different methods. Our measurement-facilitated and trace-driven simulations demonstrate that our solutions outperform existing flow scheduling algorithms with the average throughput of large flows increased by up to 190% and the average completion time reduced by up to 72.6%. Meanwhile, the average completion time of small flows is reduced by up to 64.5%.
Optical Switching Based Small-World Data Center Network.

Dongxu Zhang,Hongxiang Guo,Tingting Yang,Jian Wu

DOI: https://doi.org/10.1016/j.comcom.2017.01.001

IF: 5.047

2017-01-01

Computer Communications

Abstract:Redesigning data center networks, particularly taking advantages of optical switching technologies to reduce cost-per-bandwidth and energy consumption, has spawned interests of researchers worldwide in recent years. In this paper, we introduce and analysis our recently proposed optical switching technology powered data center network architecture, which is inspired from the small world data center network topology yet has additional flexibility brought by optical lightpath's reconfigurability. Specifically, logically full-meshed optical burst switching rings are employed to compose a lattice substrate, which provide dense connectivity for small groups of ToR switches to accommodate highly clustered and dynamic regional data traffic, while a reconfigurable wavelength circuit switching plane offers direct connections among the racks to effectively reduce overall network diameter. A centralized control plane is employed to realize traffic-adaptive optical lightpath scheduling mechanisms. We thoroughly study the throughput and latency performance of the proposed architecture through numerical simulations, and particularly reveal the impact of traffic patterns. It turns out that, the proposed network architecture can achieve high throughput with significantly reduced cost, and exploiting its traffic-adaptive reconfiguration capability can effectively improve throughput and reduce latency under varying traffic distributions.
Dynamic TCP Congestion Window Adjustment for Effective Topology Reconstruction in Optical DCN

Junyuan Guo,Hongxiang Guo,Cen Wang,Jian Wu

DOI: https://doi.org/10.1109/oecc.2017.8114839

2017-01-01

Abstract:Topology reconstruction enables optical data center networks (DCNs) to adapt to dynamic traffic patterns, but may interrupt ongoing data transmissions. We propose a cross-layer mechanism to deliver traffic over multiple optical paths and adjust their TCP congestion windows coordinately. The experimental results show that it can effectively reduce the impacts on flow transmission.
Integrated Topology and Traffic Engineering for Reconfigurable Datacenter Networks

Chen Griner,Chen Avin

2024-02-14

Abstract:The state-of-the-art topologies of datacenter networks are fixed, based on electrical switching technology, and by now, we understand their throughput and cost well. For the past years, researchers have been developing novel optical switching technologies that enable the emergence of reconfigurable datacenter networks (RDCNs) that support dynamic psychical topologies. The art of network design of dynamic topologies, i.e., 'Topology Engineering,' is still in its infancy. Different designs offer distinct advantages, such as faster switch reconfiguration times or demand-aware topologies, and to date, it is yet unclear what design maximizes the throughput.

Networking and Internet Architecture
A Scalable AWG-based Data Center Network for Cloud Computing.

Gang Wu,Huaxi Gu,Kun Wang,Xiaoshan Yu,Yantao Guo

DOI: https://doi.org/10.1016/j.osn.2014.12.001

IF: 1.828

2014-01-01

Optical Switching and Networking

Abstract:With the development of cloud computing and other online applications, the traffic for data center network (DCN) has increased significantly. Therefore, it is extremely important for DCNs to support more and more servers and provide high scalability, high throughput and low latency. Some current topologies for data centers have such inherent problems as poor scalability, lack of path diversity, cabling complexity, etc. This paper proposes a scalable AWG-based optical interconnection network for data centers, which is called OIT. OIT possesses good scalability and path diversity and benefits from the inherent parallelism and high capacity of WDM and AWG, which makes it a suitable candidate topology for data centers in the cloud computing era. A multi-path routing algorithm is also designed to utilize OIT׳s parallel links and distribute the load more evenly. The simulation results show that the packet latency and network throughput performance of OIT is better than that of fat tree topology under uniform random distribution or 50%, 80% intra pod traffic distribution and different packet sizes.
Reducing Reconfiguration Time in Hybrid Optical-Electrical Datacenter Networks (Extended Abstract)

Shuyuan Zhang,Shu Shan,Shizhen Zhao

2023-12-19

Abstract:We study how to reduce the reconfiguration time in hybrid optical-electrical Datacenter Networks (DCNs). With a layer of Optical Circuit Switches (OCSes), hybrid optical-electrical DCNs can reconfigure its logical topologies to better match the on-going traffic patterns, but the reconfiguration time may directly affect the benefits of reconfigurability. The reconfiguration time consists of the topology solver running time and the network convergence time after triggering reconfiguration. However, existing topology solvers either incur high algorithmic complexity or fail to minimize the reconfiguration overhead. In this paper, we propose a novel algorithm that combines the ideas of bipartition and Minimum Cost Flow (MCF) to reduce the overall reconfiguration time. For the first time, we formulate the topology solving problem as a MCF problem with piecewise-linear cost, which strikes a better balance between solver complexity and solution optimality. Our evaluation shows that our algorithm can significantly reduce the network convergence time while consuming less topology solver running time, making its overall performance superior to existing algorithms. Our code and test cases are available at a public repository.

Networking and Internet Architecture
Research on topoloty reconstruction mechanism based on traffic identification

祝绮爽,郭宏翔,王岑,朱勇

DOI: https://doi.org/10.18282/jnt.v2i1.836

2020-01-01

Journal of Networking and Telecommunications

Abstract:<p align="justify">Due to the growing variety of data center services, the bursty and variability of data traffic is increasing. In order to make the network better meet the needs of upper-layer services, it is necessary to design a more flexible optical internet topology reconstruction mechanisms to adapt the changing traffic demands. In the past research on optical internet, all topology reconstruction mechanisms are designed based on global data traffic. Although these mechanisms can fully utilize the flexibility of the data center optical interconnection network topology and adjust topology in real time according to the traffic demands, but when the traffic is presented at the regional level, this mechanism does not give optimal results. This paper proposes a topology reconstruction mechanism for data center optical interconnection network based on traffic identification for the previously proposed data center optical switching architecture—OpenScale. The simulation results show that it utilizes the flexibility of the network to save bandwidth resources and increase the wavelength connection bandwidth utilization with a little sacrifice of throughput.</p>
An Optimization Algorithm to Build Low Congestion Multi-Ring Topology for Optical Network-on-Chip.

Lijing Zhu,Kun Wang,Duan Zhou,Liangkai Liu,Huaxi Gu

DOI: https://doi.org/10.1587/transinf.2017edp7330

2018-01-01

IEICE Transactions on Information and Systems

Abstract:Ring-based topology is popular for optical network-on-chip. However, the network congestion is serious for ring topology, especially when optical circuit-switching is employed. In this paper, we proposed an algorithm to build a low congestion multi-ring architecture for optical network-on-chip without additional wavelength or scheduling overhead. A network congestion model is established with new network congestion factor defined. An algorithm is developed to optimize the low congestion multi-ring topology. Finally, a case study is shown and the simulation results by OPNET verify the superiority over the traditional ONoC architecture.
Topology-aware task placement in small-world optical data center network

Cen Wang,Hongxiang Guo,Dongxu Zhang,Jian Wu

DOI: https://doi.org/10.1109/OECC.2017.8114836

2017-01-01

Abstract:Based on the small-world optical data center network architecture, we propose a topology-aware task placement scheme. Simulation results verified that it can effectively shorten the completion time of computing tasks' data transfer.

OCBridge: an Efficient Topology Reconfiguration Strategy in Optical Data Center Network

Effectively Reconfigure the Optical Circuit Switching Layer Topology in Data Center Network by OCBridge

A progressive topology rconfiguration algorithm in optical data center networks

Experimental Demonstration Of Efficient Topology Reconstruction In Optical Switching Based Data Center Network

Enabling Quasi-Static Reconfigurable Networks With Robust Topology Engineering

Fast and Nondisruptive Reconfiguration Design for Optical Datacom Networks

Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

COUDER: Robust Topology Engineering for Optical Circuit Switched Data Center Networks

A new optical interconnection network for data centers

Dynamic Topology Management in Optical Data Center Networks

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Leaf: Improving QoS for Reconfigurable Datacenters with Multiple Optical Circuit Switches

Achieving Efficient Routing in Reconfigurable DCNs.

Optical Switching Based Small-World Data Center Network.

Dynamic TCP Congestion Window Adjustment for Effective Topology Reconstruction in Optical DCN

Integrated Topology and Traffic Engineering for Reconfigurable Datacenter Networks

A Scalable AWG-based Data Center Network for Cloud Computing.

Reducing Reconfiguration Time in Hybrid Optical-Electrical Datacenter Networks (Extended Abstract)

Research on topoloty reconstruction mechanism based on traffic identification

An Optimization Algorithm to Build Low Congestion Multi-Ring Topology for Optical Network-on-Chip.

Topology-aware task placement in small-world optical data center network