Abstract:High fidelity scientific simulations modeling physical phenomena typically require solving large linear systems of equations which result from discretization of a partial differential equation (PDE) by some numerical method. This step often takes a vast amount of computational time to complete, and therefore presents a bottleneck in simulation work. Solving these linear systems efficiently requires the use of massively parallel hardware with high computational throughput, as well as the development of algorithms which respect the memory hierarchy of these hardware architectures to achieve high memory bandwidth. In this paper, we present an algorithm to accelerate Jacobi iteration for solving structured problems on graphics processing units (GPUs) using a hierarchical approach in which multiple iterations are performed within on-chip shared memory every cycle. A domain decomposition style procedure is adopted in which the problem domain is partitioned into subdomains whose data is copied to the shared memory of each GPU block. Jacobi iterations are performed internally within each block's shared memory, avoiding the need to perform expensive global memory accesses every step. We test our algorithm on the linear systems arising from discretization of Poisson's equation in 1D and 2D, and observe speedup in convergence using our shared memory approach compared to a traditional Jacobi implementation which only uses global memory on the GPU. We observe a x8 speedup in convergence in the 1D problem and a nearly x6 speedup in the 2D case from the use of shared memory compared to a conventional GPU approach.

Iterative Algorithm for Linear Equations on GPU

Investigation of implement of Jacobi iteration on GPU

Research and Implementation of Effective Jacobi Iteration Algorithms on GPU

Optimizing Algorithm of Sparse Linear Systems on GPU

Matrix Decomposition Graphics Processing Unit Solver for Poisson Image Editing

A GPU-Based Parallel Algorithm for Large Scale Linear Programming Problem

Iterative Methods in GPU-Resident Linear Solvers for Nonlinear Constrained Optimization

Implementation of Jacobi Iterative Method on Graphics Processor Unit

Implementing the Jacobi Algorithm for Solving Eigenvalues of Symmetric Matrices with CUDA

Accelerating Gaussian Elimination Method for Linear Systems on GPU

GPU-based Parallel Solver Via the Kantorovich Theorem for the Nonlinear Bernstein Polynomial Systems.

A Parallel Iterative Method for Solving Periodical Block-Tridiagonal Linear Equations.

Parallel Algorithms for Separable Elliptic Equation based on GPU

Accelerating Iterative Linear Solvers Using Multiple Graphical Processing Units

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

A Hybrid Parallel Solving Algorithm on GPU for Quasi-Tridiagonal System of Linear Equations

A Parallel Algorithm Based on Galerkin Theory for Block-Tridiagonal Linear Systems

An efficient algorithm for global interval solution of nonlinear algebraic equations and its GPGPU implementation

Parallel Iteration Space Alternate Tiling Gauss-Seidel Solver

Improving Dense Linear Equation Solver on Hybrid CPU-GPU System.

Hierarchical Jacobi Iteration for Structured Matrices on GPUs using Shared Memory