Abstract:The expected exascale computer will comprise tens of thousands of computing nodes and nearly 5000 interconnected nodes in years to come. Such a large-scale system will represent a milestone in the progress of High-Performance Computing (HPC). The more efficient network hardware, like optoelectronic interconnection and configurable switches, is reforming the traditional architecture of supercomputers. However, the present architecture containing new hardware is not easy to adapt to the dynamically running condition, because the newly-developed hardware is normally unable to effectively improve overall performance. Here, we propose a new accelerated system called Software Defined Network Accelerator (sDNA) for the exascale computer. Inspired by edge forwarding index (EFI), the main contribution of our work is that it presents an extended EFI-based optical interconnection method with slow switching optical device. The optical link is connected by the evaluation of each optical link candidate's traffic offloading revenue. As the supporting method for optical interconnection, sDNA selects the most suitable routing configuration according to the job-schedule information and the prior-knowledge of HPC applications. We tested sDNA in a network simulator and a prototype system for the exascale computer, using both DOE application benchmarks and a real-world communication benchmark. From the result of verification of traffic offloading, we found that our optical interconnection method based on our extended EFI evaluation is not only able to offload the traffic from an electrical link to an optical link but is also able to avoid congestion inherent to electrical link. Furthermore, our experimental results show that sDNA maintains the throughput of more than 80% bandwidth and reduced the communication delay by 10% in our real prototype system and simulator. Together, our sDNA is an ideal candidate for accelerating communication performance of the exascale computer.

Experimental Demonstration of Disaggregating Optical Interconnection Network to Enable Application Performance Optimization

Demonstration of Elastic Optical Network Node with Defragmentation Functionality and SDN Control

Experimental Demonstration of 10 Gigabit Ethernet-Based Optical Interconnection Network Interface for Large-Scale Computing Systems

Hierarchical and Reconfigurable Optical/electrical Interconnection Network for High-Performance Computing

Demonstration of Optically Connected Disaggregated Memory with Hitless Wavelength-Selective Switch

Experimental Demonstration Of Efficient Topology Reconstruction In Optical Switching Based Data Center Network

Demonstration of latency control for distributed data aggregation in a micro-data center empowered metro optical network

A New Traffic Offloading Method with Slow Switching Optical Device in Exascale Computer.

Experimental demonstration of software-defined optical network for heterogeneous packet and optical networks

OEHadoop: Accelerate Hadoop Applications by Co-Designing Hadoop with Data Center Network

On the Performance of a Scalable Optical Switching Architecture for Flat Intercluster Data Center Network with Centralized Control

Experimental Demonstration of an AWGR-based Nanoseconds Optical Switching DCN.

Poster: NegotiaToR: A Simple On-Demand Reconfigurable Data Center Network

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Demonstration of Application-Driven Network Slicing and Orchestration in Optical/packet Domains: On-Demand Vdc Expansion for Hadoop MapReduce Optimization.

Experimental Demonstration of Multicast in an Optical-Label Switching Router with Mixed Data Rates of 10 Gb/s and 2.5 Gb/s

Numerical and Experimental Study of A Cascaded Microelectromechanical System-Based All-Optical Data Center Interconnect

Hyperoptics: a High Throughput and Low Latency Multicast Architecture for Datacenters

Experimental Demonstration of Optical Packet Assembly and Segmentation for Gigabit Ethernet Optical Label Switching Networks

Experimental Demonstration of EON Node Supporting Reconfigurable Optical Superchannel Multicasting

Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks