Abstract:The expected exascale computer will comprise tens of thousands of computing nodes and nearly 5000 interconnected nodes in years to come. Such a large-scale system will represent a milestone in the progress of High-Performance Computing (HPC). The more efficient network hardware, like optoelectronic interconnection and configurable switches, is reforming the traditional architecture of supercomputers. However, the present architecture containing new hardware is not easy to adapt to the dynamically running condition, because the newly-developed hardware is normally unable to effectively improve overall performance. Here, we propose a new accelerated system called Software Defined Network Accelerator (sDNA) for the exascale computer. Inspired by edge forwarding index (EFI), the main contribution of our work is that it presents an extended EFI-based optical interconnection method with slow switching optical device. The optical link is connected by the evaluation of each optical link candidate's traffic offloading revenue. As the supporting method for optical interconnection, sDNA selects the most suitable routing configuration according to the job-schedule information and the prior-knowledge of HPC applications. We tested sDNA in a network simulator and a prototype system for the exascale computer, using both DOE application benchmarks and a real-world communication benchmark. From the result of verification of traffic offloading, we found that our optical interconnection method based on our extended EFI evaluation is not only able to offload the traffic from an electrical link to an optical link but is also able to avoid congestion inherent to electrical link. Furthermore, our experimental results show that sDNA maintains the throughput of more than 80% bandwidth and reduced the communication delay by 10% in our real prototype system and simulator. Together, our sDNA is an ideal candidate for accelerating communication performance of the exascale computer.

Fast-Reconfigurable Optical Interconnect Architecture Based on Time-Synchronized Node Coordination for High Performance Computing

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Technology research and performance analysis of optical interconnection network based on FPGA

On Fully Reconfigurable Optical Torus-Based Networks-On-Chip Architecture

Acceleration of Coflows with all-optical interconnects in Hyper-FleX-LION

Application-based Dynamically Reconfigurable Optical Network on Chip Architecture

Achieving Ultralow-Latency Optical Interconnection For High Performance Computing (Hpc) Systems By Joint Allocation Of Computation And Communication Resources

Accelerate Distributed Deep Learning with a Fast Reconfigurable Optical Network

Fast Parallel Lightpath Re-Optimization for Crosstalk Reduction in Multi-Core Fiber Networks.

Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern

Unlocking Diversity of Fast-Switched Optical Data Center Networks with Unified Routing

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Poster: NegotiaToR: A Simple On-Demand Reconfigurable Data Center Network

A high performance inter-chip fiber communication scheme with short frame protocol

Approximate Multicast Coflow Scheduling in Reconfigurable Data Center Networks.

Low-latency Wavelength-Switched Clock-Synchronized Intra-Data Center Interconnects Enabled by Hollow Core Fiber

Topology-Adaptive Reconfigurable Network with Optical Circuit Switch for HPC Systems

Lighthouse: An Open Research Framework for Optical Data Center Networks

A New Traffic Offloading Method with Slow Switching Optical Device in Exascale Computer.

Automatically Reconfigurable Optical Network for HPC System Based on Deep Reinforcement Learning

Design and Implementation of Reconfigurable Array Adaptive Optoelectronic Hybrid Interconnect Shunting Network