Abstract:The expected exascale computer will comprise tens of thousands of computing nodes and nearly 5000 interconnected nodes in years to come. Such a large-scale system will represent a milestone in the progress of High-Performance Computing (HPC). The more efficient network hardware, like optoelectronic interconnection and configurable switches, is reforming the traditional architecture of supercomputers. However, the present architecture containing new hardware is not easy to adapt to the dynamically running condition, because the newly-developed hardware is normally unable to effectively improve overall performance. Here, we propose a new accelerated system called Software Defined Network Accelerator (sDNA) for the exascale computer. Inspired by edge forwarding index (EFI), the main contribution of our work is that it presents an extended EFI-based optical interconnection method with slow switching optical device. The optical link is connected by the evaluation of each optical link candidate's traffic offloading revenue. As the supporting method for optical interconnection, sDNA selects the most suitable routing configuration according to the job-schedule information and the prior-knowledge of HPC applications. We tested sDNA in a network simulator and a prototype system for the exascale computer, using both DOE application benchmarks and a real-world communication benchmark. From the result of verification of traffic offloading, we found that our optical interconnection method based on our extended EFI evaluation is not only able to offload the traffic from an electrical link to an optical link but is also able to avoid congestion inherent to electrical link. Furthermore, our experimental results show that sDNA maintains the throughput of more than 80% bandwidth and reduced the communication delay by 10% in our real prototype system and simulator. Together, our sDNA is an ideal candidate for accelerating communication performance of the exascale computer.

Achieving Ultralow-Latency Optical Interconnection For High Performance Computing (Hpc) Systems By Joint Allocation Of Computation And Communication Resources

Optical Amplification-Free High Baudrate Links for Intra-Data Center Communications

Low Cost Virtual Parallel Optical Fiber Pci Link

Enabling Low Latency at Large-Scale Data Center and High-Performance Computing Interconnect Networks Using Fine-Grained All-Optical Switching Technology

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Fast-Reconfigurable Optical Interconnect Architecture Based on Time-Synchronized Node Coordination for High Performance Computing

Joint Communication and Computation Resource Allocation for Cloud-Edge Collaborative System.

Optical Caching Network: A Seamless Bridge Between Electrical Packet Switching and Optical Circuit Switching

Development of Low Cost Optical Interconnection Data Link

Optical experimental solution for the multiway number partitioning problem and its application to computing power scheduling

Flexible Low-Latency Metro-Access Converged Network Architecture Based on Optical Time Slice Switching

A Physical-Layer Collision Awared All-Optical Time Slice Routing Optimization Method for High Reliable Low-Latency Communication in Transmission and Computing Resource Integration Networks

A New Optoelectronic Hybrid Network Based on Scheduling Optimization of Optical Links

A New Traffic Offloading Method with Slow Switching Optical Device in Exascale Computer.

Towards Low-Latency Distributed Tasks Collaboration by Joint Optimization of Transmission, Computation and Storage Resources Allocation in Edge Computing

Low-Latency and High-Speed Hollow-Core Fiber Optical Interconnection at 2-Micron Waveband

Large-Scale High-Density Optical Interconnects

Acceleration of Coflows with all-optical interconnects in Hyper-FleX-LION

Joint Computation and Traffic Loads Balancing Task Offloading in Multi-Access Edge Computing Systems Interconnected by Elastic Optical Networks

Ultra-Low Latency Service Provision in Edge Computing.

Low Latency Fiber Communication System Equalizer Based on Photonic Reservoir Computing