Abstract:This paper proposes a combination of a hybrid CPU--GPU and a pure GPU software implementation of a direct algorithm for solving shifted linear systems $(A - \sigma I)X = B$ with large number of complex shifts $\sigma$ and multiple right-hand sides. Such problems often appear e.g. in control theory when evaluating the transfer function, or as a part of an algorithm performing interpolatory model reduction, as well as when computing pseudospectra and structured pseudospectra, or solving large linear systems of ordinary differential equations. The proposed algorithm first jointly reduces the general full $n\times n$ matrix $A$ and the $n\times m$ full right-hand side matrix $B$ to the controller Hessenberg canonical form that facilitates efficient solution: $A$ is transformed to a so-called $m$-Hessenberg form and $B$ is made upper-triangular. This is implemented as blocked highly parallel CPU--GPU hybrid algorithm; individual blocks are reduced by the CPU, and the necessary updates of the rest of the matrix are split among the cores of the CPU and the GPU. To enhance parallelization, the reduction and the updates are overlapped. In the next phase, the reduced $m$-Hessenberg--triangular systems are solved entirely on the GPU, with shifts divided into batches. The benefits of such load distribution are demonstrated by numerical experiments. In particular, we show that our proposed implementation provides an excellent basis for efficient implementations of computational methods in systems and control theory, from evaluation of transfer function to the interpolatory model reduction.

BiCR-type Methods for Families of Shifted Linear Systems

On Krylov subspace methods for skew-symmetric and shifted skew-symmetric linear systems

Lanczos-type Variants of the COCR Method for Complex Nonsymmetric Linear Systems

Flexible and deflated variants of the block shifted GMRES method

Modified CRI iteration methods for complex symmetric indefinite linear systems

A Joint Diagonalisation Approach for Linear Stochastic Systems

The SCBiCG class of algorithms for complex symmetric linear systems with applications in several electromagnetic model problems

On restarted and deflated block FOM and GMRES methods for sequences of shifted linear systems

Parallel solver for shifted systems in a hybrid CPU-GPU framework

Gradient-based iterative approach for solving constrained systems of linear matrix equations

An Enhancement of the Accuracy of the BiCGStab Method for Solving Linear Systems with Single or Multiple Right-Hand Sides

Stable Solutions of Linear Systems Involving Long Chain of Matrix Multiplications

A comparison of Krylov methods for Shifted Skew-Symmetric Systems

The shifted inner-outer iteration methods for solving Sylvester matrix equations

A Type of Multigrid Method Based on the Fixed-Shift Inverse Iteration for the Steklov Eigenvalue Problem

Fixed-Point Iteration Schemes to Solve Symmetric Algebraic Riccati Equation $$XBX-XA-A^{T}X-C=0$$

GPBiLQ and GPQMR: Two iterative methods for unsymmetric partitioned linear systems

The Shifted-Inverse Iteration Based on the Multigrid Discretizations for Eigenvalue Problems

A New Algorithm Applied in Control-Relevant Discretization of Nonlinear Systems

An Efficient Iterative Approach to Large Sparse Nonlinear Systems with Non-Hermitian Jacobian Matrices

The Shift-Invert Residual Arnoldi Method and the Jacobi-Davidson Method: Theory and Algorithms ∗