Abstract:The preconditioned conjugate gradient (PCG) algorithm is a well-known iterative method for solving sparse linear systems in scientific computations. GPU-accelerated PCG algorithms for large-sized problems have attracted considerable attention recently. However, on a specific multi-GPU platform, producing a highly parallel PCG implementation for any large-sized problem requires significant time because several manual steps are involved in adjusting the related parameters and selecting an appropriate storage format for the matrix block that is assigned to each GPU. This motivates us to propose adaptive optimization modeling of PCG on multi-GPUs, which mainly involves the following parts: (1) an optimization multi-GPU parallel framework of PCG and (2) the profile-based optimization modeling for each one of the main components of the PCG algorithm, including vector operation, inner product, and sparse matrix-vector multiplication (SpMV). Our model does not construct a new storage format or kernel but automatically and rapidly generates an optimal parallel PCG algorithm for any problem on a specific multi-GPU platform by integrating existing storage formats and kernels. We take a vector operation kernel, an inner-product kernel, and five popular SpMV kernels for an example to present the idea of constructing the model. Given that our model is general, independent of the problems, and dependent on the resources of devices, this model is constructed only once for each type of GPU. The experiments validate the high efficiency of our proposed model.

Modified Incomplete Cholesky Preconditioned Conjugate Gradient Algorithm on Gpu for the 3d Parabolic Equation

Research on the Conjugate Gradient Algorithm with a Modified Incomplete Cholesky Preconditioner on GPU

Parallel Dynamic Sparse Approximate Inverse Preconditioning Algorithm on GPU

Mixed precision CGS algorithm based on GPU

Adaptive Optimization Modeling of Preconditioned Conjugate Gradient on Multi-GPUs.

GPU-accelerated Preconditioned GMRES Method for Two-Dimensional Maxwell's Equations

A multi-GPU parallel optimization model for the preconditioned conjugate gradient algorithm.

A Fast GPU Based Bidiagonal Solver for Computational Aeroacoustics

A Hybrid Parallel Solving Algorithm on GPU for Quasi-Tridiagonal System of Linear Equations

Preconditioned GMRES Solver on Multiple-Gpu Architecture

GPU-based multifrontal optimizing method in sparse Cholesky factorization

A Hybrid CPU-GPU Multifrontal Optimizing Method in Sparse Cholesky Factorization

FSAI preconditioned CG algorithm combined with GPU technique for the finite element analysis of electromagnetic scattering problems

Complex incomplete cholesky factorization preconditioned Bi-conjugate gradient method

CUDA-based PCG algorithm optimization for a large sparse matrix

BPX-Like Preconditioned Conjugate Gradient Solvers for Poisson Problem and Their CUDA Implementations

A Mixed-Integer Quadratic Programming Solver Based on Gpu

Parallel L-BFGS-B Algorithm on GPU.

GPU Accelerated Parallel Cholesky Factorization

Parallel least squares problems on massively distributed memory computers

Efficient Same-Dimensional Implicit Time Advancement Parallel Scheme and Optimization Methods for the Iteration Parameters Using a Graphics-Processing Unit