Abstract:The expected exascale computer will comprise tens of thousands of computing nodes and nearly 5000 interconnected nodes in years to come. Such a large-scale system will represent a milestone in the progress of High-Performance Computing (HPC). The more efficient network hardware, like optoelectronic interconnection and configurable switches, is reforming the traditional architecture of supercomputers. However, the present architecture containing new hardware is not easy to adapt to the dynamically running condition, because the newly-developed hardware is normally unable to effectively improve overall performance. Here, we propose a new accelerated system called Software Defined Network Accelerator (sDNA) for the exascale computer. Inspired by edge forwarding index (EFI), the main contribution of our work is that it presents an extended EFI-based optical interconnection method with slow switching optical device. The optical link is connected by the evaluation of each optical link candidate's traffic offloading revenue. As the supporting method for optical interconnection, sDNA selects the most suitable routing configuration according to the job-schedule information and the prior-knowledge of HPC applications. We tested sDNA in a network simulator and a prototype system for the exascale computer, using both DOE application benchmarks and a real-world communication benchmark. From the result of verification of traffic offloading, we found that our optical interconnection method based on our extended EFI evaluation is not only able to offload the traffic from an electrical link to an optical link but is also able to avoid congestion inherent to electrical link. Furthermore, our experimental results show that sDNA maintains the throughput of more than 80% bandwidth and reduced the communication delay by 10% in our real prototype system and simulator. Together, our sDNA is an ideal candidate for accelerating communication performance of the exascale computer.

Accelerate Distributed Deep Learning with a Fast Reconfigurable Optical Network

Fast and scalable all-optical network architecture for distributed deep learning

Which Can Accelerate Distributed Machine Learning Faster: Hybrid Optical/Electrical or Optical Reconfigurable DCN?

Automatically Reconfigurable Optical Network for HPC System Based on Deep Reinforcement Learning

Scalable Data Center Network with distributed placement of component sets in optical networks

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

ODRAD: An optical wireless DCN dynamic-bandwidth reconfiguration with AWGR and deep reinforcement learning

A New Traffic Offloading Method with Slow Switching Optical Device in Exascale Computer.

Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern

Application-based Dynamically Reconfigurable Optical Network on Chip Architecture

Fast-Reconfigurable Optical Interconnect Architecture Based on Time-Synchronized Node Coordination for High Performance Computing

Poster: NegotiaToR: A Simple On-Demand Reconfigurable Data Center Network

Software-defined optical networking applications enabled by programmable integrated photonics

A New Optoelectronic Hybrid Network Based on Scheduling Optimization of Optical Links

Fast Parallel Lightpath Re-Optimization for Crosstalk Reduction in Multi-Core Fiber Networks.

SL-Hyper-FleX: a cognitive and flexible-bandwidth optical datacom network by self-supervised learning [Invited]

Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters

FRED: Flexible REduction-Distribution Interconnect and Communication Implementation for Wafer-Scale Distributed Training of DNN Models

A Hierarchical Communication Algorithm for Distributed Deep Learning Training.

RGAIA: a Reconfigurable AWGR Based Optical Data Center Network.