Abstract:The scientific demand for more accurate modeling of the climate system calls for more computing power to support higher resolutions, inclusion of more component models, more complicated physics schemes, and larger ensembles. As the recent improvements in computing power mostly come from the increasing number of nodes in a system and the integration of heterogeneous accelerators, how to scale the computing problems onto more nodes and various kinds of accelerators has become a challenge for the model development. This paper describes our efforts on developing a highly scalable framework for performing global atmospheric modeling on heterogeneous supercomputers equipped with various accelerators, such as GPU (Graphic Processing Unit), MIC (Many Integrated Core), and FPGA (Field Programmable Gate Arrays) cards. We propose a generalized partition scheme of the problem domain, so as to keep a balanced utilization of both CPU resources and accelerator resources. With optimizations on both computing and memory access patterns, we manage to achieve around 8 to 20 times speedup when comparing one hybrid GPU or MIC node with one CPU node with 12 cores. Using a customized FPGA-based data-flow engines, we see the potential to gain another 5 to 8 times improvement on performance. On heterogeneous supercomputers, such as Tianhe-1A and Tianhe-2, our framework is capable of achieving ideally linear scaling efficiency, and sustained double-precision performances of 581 Tflops on Tianhe-1A (using 3750 nodes) and 3.74 Pflops on Tianhe-2 (using 8644 nodes). Our study also provides an evaluation on the programming paradigm of various accelerator architectures (GPU, MIC, FPGA) for performing global atmospheric simulation, to form a picture about both the potential performance benefits and the programming efforts involved.

Chapter Four - Data Flow Computing in Geoscience Applications.

Large Scale Numerical Simulation Via Parallelization and Reconfigurable Computing Hardware

Solving Mesoscale Atmospheric Dynamics Using a Reconfigurable Dataflow Architecture

Beyond Traditional Microprocessors for Geoscience High-Performance Computing Applications

Translating Novel HPC Techniques into Efficient Geoscience Solutions

Solving the Global Atmospheric Equations Through Heterogeneous Reconfigurable Platforms.

Designing, Modeling, and Optimizing Data-Intensive Computing Systems

ESFLOW: Mapping Large-Scale Earthquake Simulation to Spatial Computing Systems

A highly-efficient and green data flow engine for solving euler atmospheric equations

Solving global shallow water equations on heterogeneous supercomputers

Scaling Reverse Time Migration Performance Through Reconfigurable Dataflow Engines

A Scalable Software Framework for Stateful Stream Data Processing on Multiple GPUs and Applications

It's all about data movement: Optimising FPGA data access to boost performance

Massively Distributed Finite-Volume Flux Computation

Generalized Gpu Acceleration For Applications Employing Finite-Volume Methods

High Performance Reconfigurable Computing for Numerical Simulation and Deep Learning

Dataflow Optimized Reconfigurable Acceleration for FEM-based CFD Simulations

Towards a Peta-scale Unstructured Computational Fluid Dynamics (CFD) Acceleration Toolkit Based on Sunway Architectures?

Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

Introduction to Harp: when Big Data Meets HPC

Accelerating CFD simulation with high order finite difference method on curvilinear coordinates for modern GPU clusters