Abstract:On current computer architectures, GMRES' performance can be limited by its communication cost to generate orthonormal basis vectors of the Krylov subspace. To address this performance bottleneck, its $s$-step variant orthogonalizes a block of $s$ basis vectors at a time, potentially reducing the communication cost by a factor of $s$. Unfortunately, for a large step size $s$, the solver can generate extremely ill-conditioned basis vectors, and to maintain stability in practice, a conservatively small step size is used, which limits the performance of the $s$-step solver. To enhance the performance using a small step size, in this paper, we introduce a two-stage block orthogonalization scheme. Similar to the original scheme, the first stage of the proposed method operates on a block of $s$ basis vectors at a time, but its objective is to maintain the well-conditioning of the generated basis vectors with a lower cost. The orthogonalization of the basis vectors is delayed until the second stage when enough basis vectors are generated to obtain higher performance. Our analysis shows the stability of the proposed two-stage scheme. The performance is improved because while the same amount of computation as the original scheme is required, most of the communication is done at the second stage of the proposed scheme, reducing the overall communication requirements. Our performance results with up to 192 NVIDIA V100 GPUs on the Summit supercomputer demonstrate that when solving a 2D Laplace problem, the two-stage approach can reduce the orthogonalization time and the total time-to-solution by the respective factors of up to $2.6\times$ and $1.6\times$ over the original $s$-step GMRES, which had already obtained the respective speedups of $2.1\times$ and $1.8\times$ over the standard GMRES. Similar speedups were obtained for 3D problems and for matrices from the SuiteSparse Matrix Collection.

Performance Evaluation of Parallel Gram-Schmidt Re-orthogonalization Methods

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Parallel computing of a meshfree method and its application in geotechnical engineering

Improving the Performance of the GMRES Method using Mixed-Precision Techniques

Performance Evaluation of Parallel Algorithms

Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

Two-Stage Block Orthogonalization to Improve Performance of $s$-step GMRES

s-Step Orthomin and GMRES implemented on parallel computers

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Nearest Neighbors GParareal: Improving Scalability of Gaussian Processes for Parallel-in-Time Solvers

Parallelizable Algorithms for Optimization Problems with Orthogonality Constraints

Performance Analysis and Optimization of a Hybrid Distributed Reverse Time Migration Application

Performance Comparison of HPX Versus Traditional Parallelization Strategies for the Discontinuous Galerkin Method

Performance Acceleration of Kernel Polynomial Method Applying Graphics Processing Units

Parallel Computing Study for the Large-Scale Generalized Eigenvalue Problems in Modal Analysis

Parallel GPU Implementation of Iterative PCA Algorithms

Performance Evaluations of Multiple GPUs based on MPI Environments

Performance Evaluation Between Non-parallel Communication and Parallel Communication

Breaking Down the Parallel Performance of GROMACS, a High-Performance Molecular Dynamics Software

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matrices