Abstract:This is the first paper of a two-long series in which we study linear generalized inverses that minimize matrix norms. Such generalized inverses are famously represented by the Moore-Penrose pseudoinverse (MPP) which happens to minimize the Frobenius norm. Freeing up the degrees of freedom associated with Frobenius optimality enables us to promote other interesting properties. In this Part I, we look at the basic properties of norm-minimizing generalized inverses, especially in terms of uniqueness and relation to the MPP. We first show that the MPP minimizes many norms beyond those unitarily invariant, thus further bolstering its role as a robust choice in many situations. We then concentrate on some norms which are generally not minimized by the MPP, but whose minimization is relevant for linear inverse problems and sparse representations. In particular, we look at mixed norms and the induced $\ell^p \rightarrow \ell^q$ norms. An interesting representative is the sparse pseudoinverse which we study in much more detail in Part II. Next, we shift attention from norms to matrices with interesting behaviors. We exhibit a class whose generalized inverse is always the MPP-even for norms that normally result in different inverses-and a class for which many generalized inverses coincide, but not with the MPP. Finally, we discuss efficient computation of norm-minimizing generalized inverses.

Pseudo-inverse Multivariate/matrix-Variate Distributions

A Genuine Extension of The Moore-Penrose Inverse to Dual Matrices

On Matrices Whose Moore-Penrose Inverses Are Ray Unique

Reviving pseudo-inverses: Asymptotic properties of large dimensional Moore-Penrose and Ridge-type inverses with applications

Inverse and Moore–Penrose inverse of conditional matrices via convolution

Moore-Penrose inverse of some linear maps on infinite-dimensional vector spaces

Pseudo Principal Pivot Transform: The Group Inverse Case

Perturbations of Moore-Penrose Inverse and Dual Moore-Penrose Generalized Inverse

Characterization of Matrices Satisfying the Reverse Order Law for the Moore-Penrose Pseudoinverse

Beyond Moore-Penrose Part I: Generalized Inverses that Minimize Matrix Norms

On (B,C)-MP-inverses of rectangular matrices

Method of Elementary Transformation to Compute Moore-Penrose Inverse

Moore–Penrose inverse of tensors via Einstein product

Constructions and characterizations of mixed reverse-order laws for the Moore–Penrose inverse and group inverse

Pseudo-Drazin Inverse and Its Condition Numbers

Some comments about measures, Jacobians and Moore-Penrose inverse

A combinatorial approach to categorical Möbius inversion and pseudoinversion

Least Squares Properties of Generalized Inverses

Singular value decomposition and Moore-penrose inverse for unitary extended matrix

Multimatrix variate distributions

Solvability of a system of linear equations – an approach based on the generalized inverses determined by the Penrose equations