Abstract:The solution of large sparse linear systems arises in many applications, such as computational fluid dynamics and oil reservoir simulation. In realistic cases the matrices are often so large that they require large scale distributed parallel computing to obtain the solution of interest in a reasonable time. In this paper we discuss the design and implementation of the AmgX library, which provides drop-in GPU acceleration of distributed algebraic multigrid (AMG) and preconditioned iterative methods. The AmgX library implements both classical and aggregation-based AMG methods with different selector and interpolation strategies, along with a variety of smoothers and preconditioners, including block-Jacobi, Gauss--Seidel, and incomplete-LU factorization. The library contains many of the standard and flexible preconditioned Krylov subspace iterative methods, which can be combined with any of the available multigrid methods or simpler preconditioners. The parallelism in the aggregation scheme exploits parallel graph matching techniques, while the smoothers and preconditioners often rely on parallel graph coloring algorithms. The AMG algorithm implemented in the AmgX library achieves $2$--$5\times$ speedup on a single GPU against a competitive implementation on the CPU. As will be shown in the numerical experiments section, both setup and solve phases scale well across multiple nodes, sustaining this performance advantage.

Optimizing Multi-Grid Preconditioned Conjugate Gradient Method on Multi-Cores

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor

HyGrid: A CPU-GPU Hybrid Convolution-Based Gridding Algorithm in Radio Astronomy.

Power Grid Analysis and Optimization Using Algebraic Multigrid

Integrating Multi-Preconditioned Conjugate Gradient with Additive Multigrid Strategy

Accelerating HPCG on Tianhe-2: A hybrid CPU-MIC algorithm

CUDA-based PCG algorithm optimization for a large sparse matrix

POSTER: StructMG: A Fast and Scalable Structured Multigrid

Optimizing and Scaling HPCG on Tianhe-2: Early Experience

Manycore Parallel Computing for a Hybridizable Discontinuous Galerkin Nested Multigrid Method

Reducing Communication Overhead in the High Performance Conjugate Gradient Benchmark on Tianhe-2

Enhancing data locality of the conjugate gradient method for high-order matrix-free finite-element implementations

Enabling and Scaling the HPCG Benchmark on the Newest Generation Sunway Supercomputer with 42 Million Heterogeneous Cores

High Performance Matrix Multiplication on General Purpose Graphics Processing Units

Performance Optimization of the HPCG Benchmark on the Sunway TaihuLight Supercomputer.

MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring

Collective Communication Optimization for Solving Linear Algebraic Equations

Optimization of Sparse Matrix Computation for Algebraic Multigrid on GPUs

A geometric multigrid preconditioning strategy for DPG system matrices

623 Tflop/s HPCG Run on Tianhe-2: Leveraging Millions of Hybrid Cores.

AmgX: A Library for GPU Accelerated Algebraic Multigrid and Preconditioned Iterative Methods