Abstract:The preconditioned conjugate gradient (PCG) algorithm is a well-known iterative method for solving sparse linear systems in scientific computations. GPU-accelerated PCG algorithms for large-sized problems have attracted considerable attention recently. However, on a specific multi-GPU platform, producing a highly parallel PCG implementation for any large-sized problem requires significant time because several manual steps are involved in adjusting the related parameters and selecting an appropriate storage format for the matrix block that is assigned to each GPU. This motivates us to propose adaptive optimization modeling of PCG on multi-GPUs, which mainly involves the following parts: (1) an optimization multi-GPU parallel framework of PCG and (2) the profile-based optimization modeling for each one of the main components of the PCG algorithm, including vector operation, inner product, and sparse matrix-vector multiplication (SpMV). Our model does not construct a new storage format or kernel but automatically and rapidly generates an optimal parallel PCG algorithm for any problem on a specific multi-GPU platform by integrating existing storage formats and kernels. We take a vector operation kernel, an inner-product kernel, and five popular SpMV kernels for an example to present the idea of constructing the model. Given that our model is general, independent of the problems, and dependent on the resources of devices, this model is constructed only once for each type of GPU. The experiments validate the high efficiency of our proposed model.

Optimizing Multi-grid Computation and Parallelization on Multi-cores.

Optimizing Multi-Grid Preconditioned Conjugate Gradient Method on Multi-Cores

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor

POSTER: StructMG: A Fast and Scalable Structured Multigrid

Optimization of Sparse Matrix Computation for Algebraic Multigrid on GPUs

Manycore Parallel Computing for a Hybridizable Discontinuous Galerkin Nested Multigrid Method

Optimizing General Matrix Multiplications on Modern Multi-core DSPs

Optimizing Full-Spectrum Matrix Multiplications on ARMv8 Multi-Core CPUs

Numerical Study of Geometric Multigrid Methods on CPU--GPU Heterogeneous Computers

Task Parallel Implementation of Matrix Multiplication on Multi-socket Multi-core Architectures.

Parallel Efficient Sparse Matrix-Matrix Multiplication on Multicore Platforms

Adaptive Optimization Modeling of Preconditioned Conjugate Gradient on Multi-GPUs.

Accelerating Sparse Matrix Vector Multiplication on Many-Core GPUs

Improving the Scalability of A Symmetric Iterative Eigensolver for Multi-Core Platforms

Multi-GPU Implementation and Performance Optimization for CSR-Based Sparse Matrix-Vector Multiplication

JXPAMG: a Parallel Algebraic Multigrid Solver for Extreme-Scale Numerical Simulations.

Parallel scalability analysis for multigrid solvers in HYPRE

Accelerating HPCG on Tianhe-2: A hybrid CPU-MIC algorithm

NUMA-Aware DGEMM Based on 64-Bit ARMv8 Multicore Processors Architecture

Parallel Smoothers for Matrix-Based Geometric Multigrid Methods on Locally Refined Meshes Using Multicore CPUs and GPUs

ApSpGEMM: Accelerating Large-scale SpGEMM with Heterogeneous Collaboration and Adaptive Panel