Abstract:Inversion of operators is a fundamental concept in data processing. Inversion of linear operators is well studied, supported by established theory. When an inverse either does not exist or is not unique, generalized inverses are used. Most notable is the Moore-Penrose inverse, widely used in physics, statistics, and various fields of engineering. This work investigates generalized inversion of nonlinear operators. We first address broadly the desired properties of generalized inverses, guided by the Moore-Penrose axioms. We define the notion for general sets, and then a refinement, termed pseudo-inverse, for normed spaces. We present conditions for existence and uniqueness of a pseudo-inverse and establish theoretical results investigating its properties, such as continuity, its value for operator compositions and projection operators, and others. Analytic expressions are given for the pseudo-inverse of some well-known, non-invertible, nonlinear operators, such as hard- or soft-thresholding and ReLU. We analyze a neural layer and discuss relations to wavelet thresholding. Next, the Drazin inverse, and a relaxation, are investigated for operators with equal domain and range. We present scenarios where inversion is expressible as a linear combination of forward applications of the operator. Such scenarios arise for classes of nonlinear operators with vanishing polynomials, similar to the minimal or characteristic polynomials for matrices. Inversion using forward applications may facilitate the development of new efficient algorithms for approximating generalized inversion of complex nonlinear operators.

Invertibility of matrix type operators of infinite order with exponential off-diagonal decay

Infinite Matrix Method, ($\boldsymbol~{op}$) Type Space, Invariance and Demi-Linear Analysis

On infinite matrices

Exponential decay estimates for fundamental matrices of generalized Schrödinger systems

On Additional Property of Drazin Inverse Operators

Diagonal Entries of Inverses of Diagonally Dominant Matrices

Lanczos-like algorithm for the time-ordered exponential: The $\ast$-inverse problem

Tropical Matrix Exponential

The Inverses of Block Toeplitz Matrices

Exponential Erdős-Szekeres theorem for matrices

Krylov complexity in the IP matrix model II

On the finite section method for computing exponentials of doubly-infinite skew-Hermitian matrices

Generalized Inversion of Nonlinear Operators

The g-Drazin Invertibility of a Block Operator Matrix

Characterization of the inverses of tridiagonal matrices

On positive Jacobi matrices with compact inverses

Transference inequalities for multiplicative Diophantine exponents

Strong Weighted GDMP Inverse for Operators

Almost Invertible Operators

Explicit inverse of symmetric, tridiagonal near Toeplitz matrices with strictly diagonally dominant Toeplitz part