Abstract:Large-scale supercomputers equipped with GPUs as accelerators are potential to satisfy the future Exascale computing. In this work the solution of large and sparse linear systems of equations by using the Krylov subspace methods, which is crucial for the overall performance of many industrial and scientific applications, is chosen to be accelerated by GPUs’ greatly enlarged computing power. To fulfill this objective on the target hardware with a large amount of heterogeneous computing nodes, two main contributions are included in this work. First we propose a communication avoiding variant of the BICGStab solution method which reduces the global synchronization points per iteration from 3 in the classical BICGStab method to 1 in the improved variant. The superiority in terms of a reduction of the expensive global communications via all computing processes can be expected on a large-scale distributed memory cluster. Second, to handle the host-to-accelerator data transfers, the main challenge encountered in the usage of heterogeneous architecture, a communication overlapped implementation of the sparse matrix–vector multiplication is proposed since this kernel features heavily in the Krylov subspace methods. Linear systems of equations arising from the incompressible Navier–Stokes equations are used to evaluate the proposed solution and optimization methods. Evaluations of the GPU and CPU implementations are conducted on up to 256 GPUs and 4096 CPU cores, respectively. It is revealed that to obtain the same computation time a two times reduction of the number of computing nodes is achieved by using the GPU implementation on the heterogeneous node equipped with 4 GPUs and a 32-core CPU. This result can be seen as the advantage of the heterogeneous architecture from the view point of applications, which motivates a wide utilization in other related areas.

Jacobi solver: A fast FPGA-based engine system for Jacobi method

Implementation in FPGAs of eigenvalue calculation with Jacobi algorithm for symmetric matrix

Implementation of elliptic curve cryptography accelerator

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

Accelerating Parallel Jacobi Method for Matrix Eigenvalue Computation in DOA Estimation Algorithm

GPU-based Parallel Solver Via the Kantorovich Theorem for the Nonlinear Bernstein Polynomial Systems.

Reconfigurable Hardware Generation of Multigrid Solvers with Conjugate Gradient Coarse-Grid Solution

Research and Implementation of Effective Jacobi Iteration Algorithms on GPU

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Field Programmable Gate Array (FPGA) Implementation of Parallel Jacobi for Eigen-Decomposition in Direction of Arrival (DOA) Estimation Algorithm

Hierarchical Jacobi Iteration for Structured Matrices on GPUs using Shared Memory

Fpga Accelerated Parallel Sparse Matrix Factorization For Circuit Simulations

Parallel Implementations of the Jacobi Linear Algebraic Systems Solve

A Fast Tridiagonal Solver for Intel MIC Architecture

Parallel Computation Method For Solving Large Scale Equation-Oriented Models

Accelerating Solvers for Global Atmospheric Equations Through Mixed-Precision Data Flow Engine

A highly-efficient and green data flow engine for solving euler atmospheric equations

Accelerating the iterative linear solver for reservoir simulation on multicore architectures

Towards a Heterogeneous Architecture Solver for the Incompressible Navier–Stokes Equations

Parallel optimization and application of unstructured sparse triangular solver on new generation of Sunway architecture

An efficient open-source implementation to compute the Jacobian matrix for the Newton-Raphson power flow algorithm