Abstract:Abstract A new era of computing has begun with the development of high-performance computing (HPC), artificial intelligence (AI), machine learning (ML), and cognitive systems. Dramatic increases in the power density of the electronic components have led to the design and architecture of efficient thermal management technologies on these systems. IBM designed and delivered in 2018 the most powerful and fastest supercomputers of the world known as Summit and Sierra having 200 petaflops peak computing performance through LINPACK benchmarks. These systems which are called as IBM POWER AC922 are both air and liquid cooled, where water is employed in liquid-cooled systems to cool the high-power electronic components including IBM POWER9 processors and NVIDIA graphics processing units (GPUs). In this paper, we highlight the overview of the thermal and mechanical design strategies applied to these systems. Testing and experimental analysis with comparison to computational modeling is provided. Thermal control strategies are investigated for the optimization of overall system efficiency. In air cooled systems, we discuss the fan and heat sink designs, as well as the preheating effect on the PCIe section. In liquid-cooled systems, which have a unique cold plate design cooling the processors and the GPUs with water, we examine the water flow path design for the central processing units (CPUs), the GPUs, and the thermal performance of the cold plate. An overview of the cooling assemblies such as TIMs and air baffles in these systems is discussed. Unit and rack manifolds and rear door heat exchanger (RDHx) are investigated. Water flow and pressure distribution at the node and rack-level are provided.

Co-Design and System for the Supercomputer “Fugaku”

Ookami: An A64FX Computing Resource

Comparing OpenMP Implementations With Applications Across A64FX Platforms

Enhance the Strong Scaling of LAMMPS on Fugaku

Bridge++ 2.0: Benchmark results on supercomputer Fugaku

Design and performance optimization of a popular high performance computing system KD-90

Ookami: Deployment and Initial Experiences

Dawning Nebulae: A PetaFLOPS Supercomputer with a Heterogeneous Structure

Simulating Stellar Merger using HPX/Kokkos on A64FX on Supercomputer Fugaku

Digital transformation of droplet/aerosol infection risk assessment realized on "Fugaku" for the fight against COVID-19

Execution‐Cache‐Memory modeling and performance tuning of sparse matrix‐vector multiplication and Lattice quantum chromodynamics on A64FX

Design and performance evaluation of UCX for the Tofu Interconnect D on Fugaku towards efficient multithreaded communication

Thermal and Mechanical Design of the Fastest Supercomputer of the World in Cognitive Systems: IBM POWER AC 922

Performance Evaluation of a Next-Generation SX-Aurora TSUBASA Vector Supercomputer

ECM modeling and performance tuning of SpMV and Lattice QCD on A64FX

A homegrown many-core processor architecture for high-performance computing

Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

An Overview of Thermal and Mechanical Design, Control, and Testing of the World's Most Powerful and Fastest Supercomputer

152K-computer-node parallel scalable implicit solver for dynamic nonlinear earthquake simulation

Preparing for the Future -- Rethinking Proxy Apps

Performance optimizations for scalable CFD applications on hybrid CPU+MIC heterogeneous computing system with millions of cores