Abstract:(ABSTRACT) Today, heterogeneous computing has truly reshaped the way scientists think and approach high-performance computing (HPC). Hardware accelerators such as general-purpose graphics processing units (GPUs) and Intel Many Integrated Core (MIC) architecture continue to make inroads in accelerating large-scale scientific applications. These advancements, however, introduce new sets of challenges to the scientific community such as: selection of best processor for an application, effective performance optimization strategies, maintaining performance portability across architectures etc. In this thesis, we present our techniques and approach to address some of these significant issues. Firstly, we present a fully automated approach to project the relative performance of an OpenCL program over different GPUs. Performance projections can be made within a small amount of time, and the projection overhead stays relatively constant with the input data size. As a result, the technique can help runtime tools make dynamic decisions about which GPU would run faster for a given kernel. Usage cases of this technique include scheduling or migrating GPU workloads over a heterogeneous cluster with different types of GPUs. We then present our approach to accelerate a seismology modeling application that is based on the finite difference method (FDM), using MPI and CUDA over a hybrid CPU+GPU cluster. We describe the generic computational complexities involved in porting such applications to the GPUs and present our strategy of efficient performance optimization and characterization. We also show how performance modeling can be used to reason and drive the hardware-specific optimizations on the GPU. The performance evaluation of our approach delivers a maximum speedup of 23-fold with a single GPU and 33-fold with dual GPUs per node over the serial version of the application, which in turn results in a many-fold speedup when coupled with the MPI distribution of the computation across the cluster. We also study the efficacy of GPU-integrated MPI, with MPI-ACC as an example implementation, on a seismology modeling application and discuss the lessons learned. Dedication I dedicate this thesis to my mom, dad, and sister. iii Acknowledgments I would like to express my heartfelt gratitude to my advisor Dr. Wu-chun Feng, foremost, for his invaluable guidance and support throughout my M.S. studies. His belief in his students and encouragement to think independently to develop solutions to the research problems made the overall research experience greatly rewarding. His diligent work-ethic and dynamic personality had been a wonderful source of inspiration to me. It has been a pleasure …

Characterizing uncertainties of Earth system modeling with heterogeneous many-core architecture computing

Data and Codes of Characterizing Uncertainties of Earth System Modeling with Heterogeneous Many-core Architecture Computing

Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform

A Deep Learning-Based Consistency Test Approach for Earth System Models on Heterogeneous Many-Core Systems

Toward Earth system modeling with resolved clouds and ocean submesoscales on heterogeneous many-core HPCs

Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development

Solving global shallow water equations on heterogeneous supercomputers

Improving Computational Efficiency of GLUE Method for Hydrological Model Uncertainty and Parameter Estimation Using CPU-GPU Hybrid High Performance Computer Cluster

Solving the Global Atmospheric Equations Through Heterogeneous Reconfigurable Platforms.

Accelerating the 3D Euler Atmospheric Solver Through Heterogeneous CPU-GPU Platforms

Efficient Uncertainty Modeling for System Design via Mixed Integer Programming

Interactive comment on “Optimizing High-Resolution Community Earth System Model on a Heterogeneous Many-Core Supercomputing Platform (CESM-HR_sw1.0)” by Shaoqing Zhang et al

Performance Modeling, Optimization, and Characterization on Heterogeneous Architectures

High-performance Supercomputing As a Risk Evaluation Tool for Geologic Carbon Dioxide Storage

Parallel Model Research on the Heterogeneous Computer System

The Feature,Programming Model and Performance Optimization Strategy of Heterogeneous Many-Core System:A Review

A Peta-Scalable CPU-GPU Algorithm for Global Atmospheric Simulations

HiRM: Hierarchical Resource Management for Earth System Models on Many-Core Clusters

Heterogeneous computing in a strongly-connected CPU-GPU environment: fast multiple time-evolution equation-based modeling accelerated using data-driven approach

Modeling I/O performance variability in high-performance computing systems using mixture distributions

Automatic Multi-Parameter Performance Modeling of HPC Applications on a New Sunway Supercomputer