Abstract:In this paper, we propose an efficient parallel dynamic linear solver, called GPU-GMRES, for transient analysis of large linear dynamic systems such as large power grid networks. The new method is based on the preconditioned generalized minimum residual (GMRES) iterative method implemented on heterogeneous CPU–GPU platforms. The new solver is very robust and can be applied to power grids with different structures as well as for general analysis problems for large linear dynamic systems with asymmetric matrices. The proposed GPU-GMRES solver adopts the very general and robust incomplete LU based preconditioner. We show that by properly selecting the right amount of fill-ins in the incomplete LU factors, a good trade-off between GPU efficiency and convergence rate can be achieved for the best overall performance. Such tunable feature can make this algorithm very adaptive to different problems. GPU-GMRES solver properly partitions the major computing tasks in GMRES solver to minimize the data traffic between CPU and GPUs to enhance performance of the proposed method. Furthermore, we propose a new fast parallel sparse matrix–vector (SpMV) multiplication algorithm to further accelerate the GPU-GMRES solver. The new algorithm, called segSpMV, can enjoy full coalesced memory access compared to existing approaches. To further improve the scalability and efficiency, segSpMV method is further extended to multi-GPU platforms, which leads to more scalable and faster multi-GPU GMRES solver. Experimental results on the set of the published IBM benchmark circuits and mesh-structured power grid networks show that the GPU-GMRES solver can deliver order of magnitudes speedup over the direct LU solver, UMFPACK. The resulting multi-GPU-GMRES can also deliver 3–12×speedup over the CPU implementation of the same GMRES method on transient analysis.

GPU Implementation for Solving Eigenvalues of a Matrix

Implementation in FPGAs of eigenvalue calculation with Jacobi algorithm for symmetric matrix

GPU Implementation of Conjugate Gradient Method

Accelerating Gaussian Elimination Method for Linear Systems on GPU

Accelerating Parallel Jacobi Method for Matrix Eigenvalue Computation in DOA Estimation Algorithm

Matrix Decomposition Graphics Processing Unit Solver for Poisson Image Editing

A Fast Parallel Matrix Inversion Algorithm Based on Heterogeneous Multicore Architectures

Computing Low-Rank Approximation of a Dense Matrix on Multicore CPUs with a GPU and Its Application to Solving a Hierarchically Semiseparable Linear System of Equations

Towards Optimal Fast Matrix Multiplication on CPU-GPU Platforms

Acceleration of Approximate Matrix Multiplications on GPUs

Research on Multi-Level Parallel Algorithm of GPU Based QR Decomposition

High Performance Matrix Multiplication on General Purpose Graphics Processing Units

Investigation of implement of Jacobi iteration on GPU

Accelerating Pqmrcgstab Algorithm On Gpu

Parallel Triangular Solvers on GPU

Extracting the Potential of Emerging Hardware Accelerators for Symmetric Eigenvalue Decomposition

Parallel singular value decomposition on heterogeneous multi-core and multi-GPU platforms

CPU Versus GPU: Which Can Perform Matrix Computation Faster—performance Comparison for Basic Linear Algebra Subprograms

Improving Dense Linear Equation Solver on Hybrid CPU-GPU System.

Parallel GMRES solver for fast analysis of large linear dynamic systems on GPU platforms

Gpusgd: A Gpu-Accelerated Stochastic Gradient Descent Algorithm for Matrix Factorization