Abstract:Since the development of the conjugate gradient (CG) method in 1952 by Hestenes and Stiefel, CG, has become an indispensable tool in computational mathematics for solving positive definite linear systems. On the other hand, the conjugate residual (CR) method, closely related CG and introduced by Stiefel in 1955 for the same settings, remains relatively less known outside the numerical linear algebra community. Since their inception, these methods -- henceforth collectively referred to as conjugate direction methods -- have been extended beyond positive definite to indefinite, albeit consistent, settings. Going one step further, in this paper, we investigate the theoretical and empirical properties of these methods under inconsistent systems. Among other things, we show that small modifications to the original algorithms allow for the pseudo-inverse solution. Furthermore, we show that CR is essentially equivalent to the minimum residual method, proposed by Paige and Saunders in 1975, in such contexts. Lastly, we conduct a series of numerical experiments to shed lights on their numerical stability (or lack thereof) and their performance for inconsistent systems. Surprisingly, we will demonstrate that, unlike CR and contrary to popular belief, CG can exhibit significant numerical instability, bordering on catastrophe in some instances.

The characteristic invariant manifolds of the adjoint system

LMI condition of robust D stability for singular systems with polytopic uncertainties

Condition of Reliable D-Stability for a Class of Dynamic Systems-an LMI Approach

Necessary and sufficient condition for quadratic stability of interval matrices

On Pole Placement In Lmi Region For Descriptor Linear Systems

Calculation of Two- Dimensional Characteristic Invariant Manifolds on the Boundary of Transient Stability Region in Power System

Calculation of Characteristic Invariant Manifolds on the Boundary of Transient Stability Region in Power Systems

Immersion and Invariance Adaptive Control of a Class of Continuous Stirred Tank Reactors

The Credible Regions on the Approximate Stability Boundaries of Nonlinear Dynamic Systems

Invariant Approximations and Disturbance Attenuation for Constrained Linear Discrete-Time Systems

Immersion and Invariance Stabilization of Nonlinear Systems: A Horizontal Contraction Approach

On Some Applications of Invariant Manifolds

Impulsive Control on Invariant Surfaces

Two geometrical invariants for three‐dimensional systems

Complete Characterization of Quadratic Lyapunov Functions for Planar Systems in LMI Regions.

Constrained Common Invariant Subspace and Its Application

Control contraction metrics on Lie groups

The Cantor Manifold Theorem with Symmetry and Applications to Pdes

Invariant Manifolds for a PDE-ODE Coupled System

Conjugate Direction Methods Under Inconsistent Systems

Transversality for Cyclic Negative Feedback Systems