Shaoqing Zhang,Haohuan Fu,Lixin Wu,Yuxuan Li,Hong Wang,Yunhui Zeng,Xiaohui Duan,Wubing Wan,Li Wang,Yuan Zhuang,Hongsong Meng,Kai Xu,Ping Xu,Lin Gan,Zhao Liu,Sihai Wu,Yuhu Chen,Haining Yu,Shupeng Shi,Lanning Wang,Shiming Xu,Wei Xue,Weiguo Liu,Qiang Guo,Jie Zhang,Guanghui Zhu,Yang Tu,Jim Edwards,Allison Baker,Jianlin Yong,Man Yuan,Yangyang Yu,Qiuying Zhang,Zedong Liu,Mingkui Li,Dongning Jia,Guangwen Yang,Zhiqiang Wei,Jingshan Pan,Ping Chang,Gokhan Danabasoglu,Stephen Yeager,Nan Rosenbloom,Ying Guo

Abstract:Abstract. With semiconductor technology gradually approaching its physical and thermal limits, recent supercomputers have adopted major architectural changes to continue increasing the performance through more power-efficient heterogeneous many-core systems. Examples include Sunway TaihuLight that has four management processing elements (MPEs) and 256 computing processing elements (CPEs) inside one processor and Summit that has two central processing units (CPUs) and six graphics processing units (GPUs) inside one node. Meanwhile, current high-resolution Earth system models that desperately require more computing power generally consist of millions of lines of legacy code developed for traditional homogeneous multicore processors and cannot automatically benefit from the advancement of supercomputer hardware. As a result, refactoring and optimizing the legacy models for new architectures become key challenges along the road of taking advantage of greener and faster supercomputers, providing better support for the global climate research community and contributing to the long-lasting societal task of addressing long-term climate change. This article reports the efforts of a large group in the International Laboratory for High-Resolution Earth System Prediction (iHESP) that was established by the cooperation of Qingdao Pilot National Laboratory for Marine Science and Technology (QNLM), Texas A&M University (TAMU), and the National Center for Atmospheric Research (NCAR), with the goal of enabling highly efficient simulations of the high-resolution (25 km atmosphere and 10 km ocean) Community Earth System Model (CESM-HR) on Sunway TaihuLight. The refactoring and optimizing efforts have improved the simulation speed of CESM-HR from 1 SYPD (simulation years per day) to 3.4 SYPD (with output disabled) and supported several hundred years of pre-industrial control simulations. With further strategies on deeper refactoring and optimizing for remaining computing hotspots, as well as redesigning architecture-oriented algorithms, we expect an equivalent or even better efficiency to be gained on the new platform than traditional homogeneous CPU platforms. The refactoring and optimizing processes detailed in this paper on the Sunway system should have implications for similar efforts on other heterogeneous many-core systems such as GPU-based high-performance computing (HPC) systems.

Efficient Executions of Community Earth System Model Onto Accelerators Using GPUs.

Improving the Parallelism of CESM on GPU

Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform

Heterogeneous acceleration algorithms for shallow cumulus convection scheme over GPU clusters

Solving global shallow water equations on heterogeneous supercomputers

Accelerating the 3D Euler Atmospheric Solver Through Heterogeneous CPU-GPU Platforms

A GPU-enabled acceleration algorithm for the CAM5 cloud microphysics scheme

An MPI+OpenACC-based PRM Scalar Advection Scheme in the GRAPES Model over a Cluster with Multiple CPUs and GPUs

Porting the Princeton Ocean Model to GPUs.

A customized GPU acceleration of the princeton ocean model

Unleashing the Performance Potential of CPU-GPU Platforms for the 3D Atmospheric Euler Solver.

GPU-HADVPPM V1.0: a high-efficiency parallel GPU design of the piecewise parabolic method (PPM) for horizontal advection in an air quality model (CAMx V6.10)

CPSA: A Coordinated Process Scheduling Algorithm for Coupled Earth System Model

GPU-RRTMG_SW: Accelerating a Shortwave Radiative Transfer Scheme on GPU

Parallel computation of compressible turbulence using multi-GPU clusters

Multidisciplinary simulation acceleration using multiple shared memory graphical processing units

A Peta-Scalable CPU-GPU Algorithm for Global Atmospheric Simulations

CPU/GPU Computing for Long-Wave Radiation Physics on Large GPU Clusters.

GPU-HADVPPM4HIP V1.0: using the heterogeneous-compute interface for portability (HIP) to speed up the piecewise parabolic method in the CAMx (v6.10) air quality model on China's domestic GPU-like accelerator

Ultra-Scalable CPU-MIC Acceleration of Mesoscale Atmospheric Modeling on Tianhe-2

POM.gpu-v1.0: a GPU-based Princeton Ocean Model