Abstract:The expected exascale computer will comprise tens of thousands of computing nodes and nearly 5000 interconnected nodes in years to come. Such a large-scale system will represent a milestone in the progress of High-Performance Computing (HPC). The more efficient network hardware, like optoelectronic interconnection and configurable switches, is reforming the traditional architecture of supercomputers. However, the present architecture containing new hardware is not easy to adapt to the dynamically running condition, because the newly-developed hardware is normally unable to effectively improve overall performance. Here, we propose a new accelerated system called Software Defined Network Accelerator (sDNA) for the exascale computer. Inspired by edge forwarding index (EFI), the main contribution of our work is that it presents an extended EFI-based optical interconnection method with slow switching optical device. The optical link is connected by the evaluation of each optical link candidate's traffic offloading revenue. As the supporting method for optical interconnection, sDNA selects the most suitable routing configuration according to the job-schedule information and the prior-knowledge of HPC applications. We tested sDNA in a network simulator and a prototype system for the exascale computer, using both DOE application benchmarks and a real-world communication benchmark. From the result of verification of traffic offloading, we found that our optical interconnection method based on our extended EFI evaluation is not only able to offload the traffic from an electrical link to an optical link but is also able to avoid congestion inherent to electrical link. Furthermore, our experimental results show that sDNA maintains the throughput of more than 80% bandwidth and reduced the communication delay by 10% in our real prototype system and simulator. Together, our sDNA is an ideal candidate for accelerating communication performance of the exascale computer.

A New Traffic Offloading Method with Slow Switching Optical Device in Exascale Computer.

A New Optoelectronic Hybrid Network Based on Scheduling Optimization of Optical Links

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Toward Scalable and Low-Cost Traffic Testing for Evaluating DDoS Defense Solutions

Wormhole Optical Network: a New Architecture to Solve Long Diameter Problem in Exascale Computer

OeIM - An Optoelectronic Interconnection Middleware for the Exascale Computer.

Traffic Pattern Adaptive Hybrid Electrical and Optical Switching Network for HPC System

Software-defined optical networking applications enabled by programmable integrated photonics

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

OEHadoop: Accelerate Hadoop Applications by Co-Designing Hadoop with Data Center Network

Scalable Data Center Network with distributed placement of component sets in optical networks

Enabling Low Latency at Large-Scale Data Center and High-Performance Computing Interconnect Networks Using Fine-Grained All-Optical Switching Technology

Optimizing Bulk Transfers with Software-Defined Optical WAN

Accelerate Distributed Deep Learning with a Fast Reconfigurable Optical Network

Switch-Less Dragonfly on Wafers: A Scalable Interconnection Architecture based on Wafer-Scale Integration

On the Performance of a Scalable Optical Switching Architecture for Flat Intercluster Data Center Network with Centralized Control

OSA: an Optical Switching Architecture for Data Center Networks with Unprecedented Flexibility

Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks

Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern

Toward A Scalable, Fault-Tolerant, High-Performance Optical Data Center Architecture.

Numerical and Experimental Study of A Cascaded Microelectromechanical System-Based All-Optical Data Center Interconnect