Topology-Adaptive Reconfigurable Network with Optical Circuit Switch for HPC Systems

Yu Shang,Bingli Guo,Wenzhe Li,Tao Gao,Yu Zhou,Xin Li,Shanguo Huang

DOI: https://doi.org/10.1364/acpc.2017.m1c.6

2017-01-01

Abstract:We propose a topology-adaptive hybrid packet/circuit network using optical circuit switches for HPC systems. The dynamically reconfigured topologies according to traffic patterns achieve low end-to-end latency and high throughput.

What problem does this paper attempt to address?

Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern

Shang Yu,Bingli Guo,Wenzhe Li,Yu Zhou,Xin Li,Shanguo Huang

DOI: https://doi.org/10.1364/ofc.2018.w4i.5

2018-01-01

Abstract:We propose a reconfigurable hybrid network architecture using optical circuit switches for HPC systems, and evaluate the performance of different topologies according to different traffic patterns through high throughput and low latency.
Traffic Pattern Adaptive Hybrid Electrical and Optical Switching Network for HPC System

Yu Shang,Bingli Guo,Xin Li,Xinzhu Sang,Shanguo Huang

DOI: https://doi.org/10.1109/lcomm.2018.2886014

IF: 3.5529

2018-01-01

IEEE Communications Letters

Abstract:As the performance requirements and scale of high-performance computing (HPC) systems grow rapidly, systems with such a large number of computing nodes present significant challenges in network architecture design because their peak performance is increasingly limited by communication rather than computation. Moreover, certain HPC application always shows some specific communication patterns, and different topologies have various performances with these patterns. To implement a traffic pattern adaptive HPC system, we propose a topology reconfigurable hybrid network architecture based on optical circuit switching (OCS), which could be adjusted into different classical topologies. And an algorithm of topology calculating and a permutation matrix-based optical switch configuration mechanism are proposed to construct network. We discuss network performances with limited OCS switches occupation, and results show that traffic pattern adaptive network improves the performance of latency and throughput to a large extent.
Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Zuoqing Zhao,Bingli Guo,Yu Shang,Shanguo Huang

DOI: https://doi.org/10.1364/jocn.377427

IF: 4.508

2019-01-01

Journal of Optical Communications and Networking

Abstract:Compared with electrical packet switches, optical switching technology could enable a more desirable high-performance computing (HPC) system with lower power consumption, lower delay, higher bandwidth, and more flexibility. In this article, we designed a hierarchical and reconfigurable optical/electrical HPC interconnection network. The traffic matrix of the target task can be decomposed into multiple matrix groups that are executed in parallel, and the network topology in each layer can be reconfigured according to the subtraffic matrix associated with this layer. For interlayer cross-connection, we use a shuffle network to offer a direct optical bypass for a huge aggregated amount of interlayer communication requirements, as well as multiple light paths. We propose a reconfiguration optimization algorithm and routing algorithm to optimize network performance. Simulation results show that, with the proposed architecture and algorithms, the average path length per unit of communication intensity is minimized by 13.7%–52.4%, the delay is reduced by more than 14.8%, and throughput is improved by 33% at least compared with Mesh, Torus, and Dragonfly.
Automatically Reconfigurable Optical Network for HPC System Based on Deep Reinforcement Learning

Yu Shang,Xingwen Guo,Bingli Guo,Haixi Wang,Jie Xiao,Shanguo Huang

DOI: https://doi.org/10.1109/acp55869.2022.10088485

2022-01-01

Abstract:High-density optical interconnects enable high-bandwidth, low-latency and energy-efficient communication. Also, in order to enhance the adaptability of High Performance Computing (HPC) networks for traffic variation, optical networking reconfiguration capability is a promising alternative to traditional fixed interconnection architecture. We propose a reconfigurable optical network for HPC systems that can automatically switch between different topologies controlled by a Deep Reinforcement Learning (DRL) agent. By varying the topology of our network, we evaluate it using an Advantage Actor-Critic (A2C) and a Deep Deterministic Policy Gradient (DDPG) algorithm-based scheme. Results show that our prototype achieves up to 1.7x performance improvement.
Benefits Of Employing Reconfigurable And Hybrid Interconnection Network For Hpc System

Yu Shang,Bingli Guo,Xin Li,Shan Yin,Shanguo Huang,Weiguo Ju,Yuan Yuan

DOI: https://doi.org/10.1109/acp.2018.8596196

2018-01-01

Abstract:We analyze benefits of a novel reconfigurable optical and electrical hybrid network for HPC system performances over different traffic patterns, and the proposed network architecture can bring up to 2.5x reduction of task completion time.
Circuit Switching under the Radar with REACToR.

He Liu,Feng Lu,Alex Forencich,Rishi Kapoor,Malveeka Tewari,Geoffrey M. Voelker,George Papen,Alex C. Snoeren,George Porter

DOI: https://doi.org/10.5555/2616448.2616450

2014-01-01

Abstract:The potential advantages of optics at high link speeds have led to significant interest in deploying optical switching technology in data-center networks. Initial efforts have focused on hybrid approaches that rely on millisecond-scale circuit switching in the core of the network, while maintaining the flexibility of electrical packet switching at the edge. Recent demonstrations of microsecond-scale optical circuit switches motivate considering circuit switching for more dynamic traffic such as that generated from a top-of-rack (ToR) switch. Based on these technology trends, we propose a prototype hybrid ToR, called REACToR, which utilizes a combination of packet switching and circuit switching to appear to end-hosts as a packet-switched ToR. In this paper, we describe a prototype REACToR control plane which synchronizes end host transmissions with end-to-end circuit assignments. This control plane can react to rapid, bursty changes in the traffic from end hosts on a time scale of 100s of microseconds, several orders of magnitude faster than previous hybrid approaches. Using the experimental data from a system of eight end hosts, we calibrate a hybrid network simulator and use this simulator to predict the performance of larger-scale hybrid networks.
A Reconfigurable Photonic Computing Chip with Easily Scalable Topology

Ying Sophie Huang,Hengsong Yue,Wei Ma,Yiyuan Zhang,Yao Xiao,Weiping Wang,Yong Tang,Xingjun Hu,He Tang,Nuo Chen,Tao Chu

DOI: https://doi.org/10.1364/iprsn.2023.im3a.2

2023-01-01

Abstract:We present an easily scalable photonic computing topology with Mach–Zehnder interferometers based on a single tunable phase shifter to implement arbitrary matrices, achieving high recognition accuracies on MNIST handwritten digit tasks experimentally.
A scalable silicon photonic chip-scale optical switch for high performance computing systems

Runxiang Yu,Stanley Cheung,Yuliang Li,Katsunari Okamoto,Roberto Proietti,Yawei Yin,S J B Yoo

DOI: https://doi.org/10.1364/OE.21.032655

2013-12-30

Abstract:This paper discusses the architecture and provides performance studies of a silicon photonic chip-scale optical switch for scalable interconnect network in high performance computing systems. The proposed switch exploits optical wavelength parallelism and wavelength routing characteristics of an Arrayed Waveguide Grating Router (AWGR) to allow contention resolution in the wavelength domain. Simulation results from a cycle-accurate network simulator indicate that, even with only two transmitter/receiver pairs per node, the switch exhibits lower end-to-end latency and higher throughput at high (>90%) input loads compared with electronic switches. On the device integration level, we propose to integrate all the components (ring modulators, photodetectors and AWGR) on a CMOS-compatible silicon photonic platform to ensure a compact, energy efficient and cost-effective device. We successfully demonstrate proof-of-concept routing functions on an 8 × 8 prototype fabricated using foundry services provided by OpSIS-IME.
Effectively Reconfigure the Optical Circuit Switching Layer Topology in Data Center Network by OCBridge

Yinan Tang,Hongxiang Guo,Yong Zhu,Tongtong Yuan,Xiong Gao,Cen Wang,Jian Wu

DOI: https://doi.org/10.1109/JLT.2018.2883387

IF: 4.7

2019-01-01

Journal of Lightwave Technology

Abstract:All optical or hybrid electrical/optical switching data center network (DCN) architectures are capable of adapting the optical-layer topology to various network traffic demands based on the flexibility of optical switching technology. The topology reconfiguration strategies in previous research simply attempt to reconfigure optical circuit switching (OCS) links to offload heavier rack-to-rack traf...
Fine-Grained All-Optical Switching Based on Optical Time Slice Switching for Hybrid Packet-Ocs Intra-Data Center Networks

Yao Li,Nan Hua,Xiaoping Zheng

DOI: https://doi.org/10.1364/ofc.2016.w3j.5

2016-01-01

Abstract:We propose a hybrid packet-OCS intra-datacenter network architecture with bufferless sub-wavelength all-optical time slice switching enabled by high-precision time synchronization. We experimentally demonstrate flex-capacity sub-wavelength circuit establishment among the ToR switches without buffers and contention.
Application-based Dynamically Reconfigurable Optical Network on Chip Architecture

Wenzhe Li,Bingli Guo,Guojun Yuan,Shanguo Huang,George N. Rouskas

DOI: https://doi.org/10.1049/cp.2019.1134

2019-01-01

Abstract:We propose an application based dynamically reconfigurable optical network on chip architecture and a power efficient reconfigurable optical router structure. The simulation results show the reconfigurable architecture can reduce path-setup delay by 70% compared with Torus and 43% compared with Firefly under a dynamic traffic.
NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Cong Liang,Xiangli Song,Jing Cheng,Mowei Wang,Yashe Liu,Zhenhua Liu,Shizhen Zhao,Yong Cui

DOI: https://doi.org/10.1145/3651890.3672222

2024-07-29

Abstract:Recent advances in fast optical switching technology show promise in meeting the high goodput and low latency requirements of datacenter networks (DCN). We present NegotiaToR, a simple network architecture for optical reconfigurable DCNs that utilizes on-demand scheduling to handle dynamic traffic. In NegotiaToR, racks exchange scheduling messages through an in-band control plane and distributedly calculate non-conflicting paths from binary traffic demand information. Optimized for incasts, it also provides opportunities to bypass scheduling delays. NegotiaToR is compatible with prevalent flat topologies, and is tailored towards a minimalist design for on-demand reconfigurable DCNs, enhancing practicality. Through large-scale simulations, we show that NegotiaToR achieves both small mice flow completion time (FCT) and high goodput on two representative flat topologies, especially under heavy loads. Particularly, the FCT of mice flows is one to two orders of magnitude better than the state-of-the-art traffic-oblivious reconfigurable DCN design.

Networking and Internet Architecture
Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

YANG Wen,GUO Bing-li,YANG Hong-zhen,WANG Yan-bo,FAN Chao,MENG Ling-yu,HUANG Shan-guo

DOI: https://doi.org/10.13756/j.gtxyj.2022.01.003

2022-01-01

Abstract:Aiming at preventing the network performance deterioration caused by fixed link topology connections in optically switched networks, this paper proposes and validates an interconnection and control mechanism that can automatically optimize and reconfigure network topology according to the network traffic volume. This mechanism combines deep reinforcement learning with software defined network technology. Based on the real-time network performance parameters collected by the software-defined network control plane and the performance feedback of the network simulation system, the continuous training of the topology structure can be realized in the model of deep reinforcement learning. The automatic network topology reconfiguration is achieved with improved network performance. The experimental results show that for a given traffic intensity, the model trained by deep reinforcement learning can learn the topology reconstruction strategy and realize automatic selection. The optimal network topology structure can be achieved in one step, with reduced average network delay and average packet loss.
A New Optoelectronic Hybrid Network Based on Scheduling Optimization of Optical Links

En Shao,Guangming Tan,Zhan Wang,Guojun Yuan,Zheng Cao,Ninghui Sun

DOI: https://doi.org/10.1109/tc.2021.3054308

IF: 3.183

2021-01-01

IEEE Transactions on Computers

Abstract:The emergence of exascale computers will represent a milestone in high-performance computing (HPC). Optoelectronic interconnections and configurable switches will change the traditional supercomputer architecture. However, new hardware is not easily adapted to dynamic running conditions. Based on scheduling optimization of optical links, we propose a new optoelectronic hybrid network, the software-defined network accelerator (sDNA), for an exascale computer. Our scheduling optimization contains an optical interconnection method and an adaptive routing method. The main contribution of our work is an extended edge forwarding index (E-EFI) optical interconnection method based on slow-switching optical devices. The optical link connections are established by evaluating the traffic offloading revenue for each optical link candidate. To support optical interconnection, sDNA selects a suitable routing strategy according to the job-schedule information and prior HPC application knowledge. We tested sDNA in a network simulator and a prototype exascale computer system using both the US Department of Energy (DOE) application and real-world communication benchmarks. The verification results for traffic offloading reveal that our optical interconnection method not only offloads traffic from electrical links to optical links but also avoids the congestion inherent to electrical links. sDNA maintains a throughput of more than 80 percent bandwidth and reduces the communication delay by 10 percent in our real prototype system and simulator. Thus, sDNA is an ideal candidate for accelerating the communication performance of exascale computers.
Design and Implementation of Reconfigurable Array Adaptive Optoelectronic Hybrid Interconnect Shunting Network

Bowen Yang,Yong Li,Chao Xi,Rui Shan,Yu Feng,Jiaying Luo

DOI: https://doi.org/10.3390/electronics13091668

IF: 2.9

2024-04-27

Electronics

Abstract:Addressing challenges regarding Hybrid Optoelectronic Network-on-Chip systems, such as congestion control, their limited adaptability, and their inability to facilitate optoelectronic co-simulation, this study introduces an adaptive hybrid optoelectronic interconnection shunt structure tailored for reconfigurable array processors. Within this framework, an adaptive shunt routing algorithm and a low-loss non-blocking five-port optical router are developed. Furthermore, an adaptive hybrid optoelectronic interconnection simulation model and a performance statistical model, established using SystemVerilog and Verilog, complement these designs. The experimental results showcase promising enhancements: the designed routing algorithm demonstrates an average 17.5% improvement in mitigating congestion at network edge nodes; substantial reductions in the required number of cross waveguides and micro-ring resonators for optical routers lead to an average path insertion loss of only 0.522 dB. Moreover, the hybrid optoelectronic interconnection performance statistical model supports the design of routing strategies and topology structures, enabling resource usage, power consumption, insertion loss, and other performance metrics to be accurately assessed.

engineering, electrical & electronic,computer science, information systems,physics, applied
Performance Analysis of Distributed Optical Routing Network Based on Tunable Lasers and Cyclic AWG Router

Yinxin Wang,Zhuping Fan,Shan-Shan Wang,Dengdong Zhang,Jiasheng Zhao,Jian-Jun He

DOI: https://doi.org/10.1109/icocn53177.2021.9563631

2021-01-01

Abstract:This paper introduces a scalable and reconfigurable distributed optical switching/routing network structure based on tunable lasers. The performance of the proposed network is greatly improved in resource utilization and queuing delay with resource scheduling strategy.
REACToR: A reconfigurable packet and circuit ToR switch

he liu,feng lu,ravikant kapoor,alex forencich,geoffrey m voelker,george c papen,alex c snoeren,george porter

DOI: https://doi.org/10.1109/PHOSST.2013.6614526

2013-01-01

Abstract:We are designing REACToR, a hybrid ToR that enables scalable, high-speed networks by pairing optical circuit switching with comparatively underprovisioned packet switching. The key insight driving our work is that by moving the vast majority-but not all-of the buffering out of the switch and into end hosts, more scalable, lower-cost interconnect fabrics can be supported.
COUDER: Robust Topology Engineering for Optical Circuit Switched Data Center Networks

Min Yee Teh,Shizhen Zhao,Peirui Cao,Keren Bergman

DOI: https://doi.org/10.48550/arXiv.2010.00090

2020-10-01

Abstract:Many optical circuit switched data center networks (DCN) have been proposed in the past to attain higher capacity and topology reconfigurability, though commercial adoption of these architectures have been minimal. One major challenge these architectures face is the difficulty of handling uncertain traffic demands using commercial optical circuit switches (OCS) with high switching latency. Prior works have generally focused on developing fast-switching OCS prototypes to quickly react to traffic changes through frequent reconfigurations. This approach, however, adds tremendous complexity to the control plane, and raises the barrier for commercial adoption of optical circuit switched data center networks. We propose COUDER, a robust topology and routing optimization framework for reconfigurable optical circuit switched data centers. COUDER optimizes topology and routing based on a convex set of traffic matrices, and offers strict throughput guarantees for any future traffic matrices bounded by the convex set. For the bursty traffic demands that are unbounded by the convex set, we employ a desensitization technique to reduce performance hit. This enables COUDER to generate topology and routing solutions capable of handling unexpected traffic changes without relying on frequent topology reconfigurations. Our extensive evaluations based on Facebook's production DCN traces show that, even with daily reconfiguration, COUDER achieves about 20\% higher throughput, and about 32\% lower average hop count compared to cost-equivalent static topologies. Our work shows that adoption of reconfigurable topologies in commercial DCNs is feasible even without fast OCSs.

Networking and Internet Architecture
Enabling Low Latency at Large-Scale Data Center and High-Performance Computing Interconnect Networks Using Fine-Grained All-Optical Switching Technology

Nan Hua,Zhizhen Zhong,Xiaoping Zheng

DOI: https://doi.org/10.23919/ondm.2017.7958532

2017-01-01

Abstract:In large-scale data center (DC) and high performance computing (HPC) interconnect networks, end-to-end latency becomes a fatal problem due to the processing and queuing delays of electronic packet switching (EPS) at intermediate switching points. Introducing optical switching into DC and HPC networks can provide a potential solution to the latency problem by establishing low-latency optical bypass (end-to-end lightpath). However, the number of connections that can be provided by current coarse-grained optical circuit switching (OCS) technology is far less than the required amount for all-to-all communication in a hundreds-of-thousands-nodes large-scale system, and this will weaken its effect in reducing latency. Optical packet switching has a much finer granularity compared with OCS; however, the lack of adequate technologies for optical buffering makes it difficult to avoid packet collision. In this paper, we investigate the relationship among network scale, granularity and latency, and introduce the use of our proposed fine-grained optical time slice switching (OTSS) in DC and HPC networks over arbitrary topologies. Simulation results under 6×6 2-D Torus topology demonstrate the advantage of OTSS in end-to-end latency compared with conventional EPS and spectrum-flexible wavelength switching (WS).
On the Performance of a Scalable Optical Switching Architecture for Flat Intercluster Data Center Network with Centralized Control

Qian Kong,Shanguo Huang,Yu Zhou,Bingli Guo,Yongli Zhao,Min Zhang,Jie Zhang,Wanyi Gu

DOI: https://doi.org/10.1117/1.oe.53.7.075101

IF: 1.3

2014-01-01

Optical Engineering

Abstract:Data centers have to sustain the rapid growth of data traffic due to the increasing demand of band-width-hungry Internet services. The current fat tree topology causes communication bottlenecks in the server interaction process, resulting in power-hungry O-E-O conversions that limit the minimum latency and the power efficiency of these systems. As a result, recent efforts have advocated that all optical data center networks (DCNs) have the capability to adapt to traffic requirements on demand. We present the design, implementation, and evaluation of a cascaded microelectromechanical systems switches-based DCN architecture which dynamically changes its topology and link capacities, thereby achieving unprecedented flexibility to adapt to dynamic traffic patterns. We analyze it under a data center traffic model to determine its suitability for this type of environment. The proposed architecture can be scaled to 3300 input/output ports by available experimental components with low blocking probability and latency. The blocking probability and latency are about 0.03 and 72 ms at a moderate traffic load for 32 input/output ports based on our numerical results, which are much smaller than the results for 4 input/output ports which are 0.13 and 235 ms, respectively. (c) 2014 Society of Photo-Optical Instrumentation Engineers (SPIE)

Topology-Adaptive Reconfigurable Network with Optical Circuit Switch for HPC Systems

Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern

Traffic Pattern Adaptive Hybrid Electrical and Optical Switching Network for HPC System

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Automatically Reconfigurable Optical Network for HPC System Based on Deep Reinforcement Learning

Benefits Of Employing Reconfigurable And Hybrid Interconnection Network For Hpc System

Circuit Switching under the Radar with REACToR.

A Reconfigurable Photonic Computing Chip with Easily Scalable Topology

A scalable silicon photonic chip-scale optical switch for high performance computing systems

Effectively Reconfigure the Optical Circuit Switching Layer Topology in Data Center Network by OCBridge

Fine-Grained All-Optical Switching Based on Optical Time Slice Switching for Hybrid Packet-Ocs Intra-Data Center Networks

Application-based Dynamically Reconfigurable Optical Network on Chip Architecture

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

A New Optoelectronic Hybrid Network Based on Scheduling Optimization of Optical Links

Design and Implementation of Reconfigurable Array Adaptive Optoelectronic Hybrid Interconnect Shunting Network

Performance Analysis of Distributed Optical Routing Network Based on Tunable Lasers and Cyclic AWG Router

REACToR: A reconfigurable packet and circuit ToR switch

COUDER: Robust Topology Engineering for Optical Circuit Switched Data Center Networks

Enabling Low Latency at Large-Scale Data Center and High-Performance Computing Interconnect Networks Using Fine-Grained All-Optical Switching Technology

On the Performance of a Scalable Optical Switching Architecture for Flat Intercluster Data Center Network with Centralized Control