Abstract:Singular value decomposition is the key tool in the analysis and understanding of linear regularization methods. In the last decade nonlinear variational approaches such as $\ell^1$ or total variation regularizations became quite prominent regularization techniques with certain properties being superior to standard methods. In the analysis of those, singular values and vectors did not play any role so far, for the obvious reason that these problems are nonlinear, together with the issue of defining singular values and singular vectors. In this paper however we want to start a study of singular values and vectors for nonlinear variational regularization of linear inverse problems, with particular focus on singular one-homogeneous regularization functionals. A major role is played by the smallest singular value, which we define as the ground state of an appropriate functional combining the (semi-)norm introduced by the forward operator and the regularization functional. The optimality condition for the ground state further yields a natural generalization to higher singular values and vectors involving the subdifferential of the regularization functional. We carry over two main properties from the world of linear regularization. The first one is gaining information about scale, respectively the behavior of regularization techniques at different scales. This also leads to novel estimates at different scales, generalizing the estimates for the coefficients in the linear singular value expansion. The second one is to provide exact solutions for variational regularization methods. We will show that all singular vectors can be reconstructed up to a scalar factor by the standard Tikhonov-type regularization approach even in the presence of (small) noise. Moreover, we will show that they can even be reconstructed without any bias by the recently popularized inverse scale space method.

A note on the singular value decomposition of (skew-)involutory and (skew-)coninvolutory matrices

A note on the singular value decomposition of idempotent and involutory matrices

A note on the hyperbolic singular value decomposition without hyperexchange matrices

The Singular Value Decomposition, Applications and Beyond.

A Power Method for Computing Singular Value Decomposition

Inverting the sum of two singular matrices

The eigenvalue decomposition of normal matrices by the decomposition of the skew-symmetric part with applications to orthogonal matrices

Desingularization of generic symmetric and generic skew-symmetric determinantal singularities

A Skew-Symmetric Lanczos Bidiagonalization Method for Computing Several Extremal Eigenpairs of a Large Skew-Symmetric Matrix

Better than best low-rank approximation with the singular value decomposition

On Properties and Structure of the Analytic Singular Value Decomposition

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

High Order Numerical Methods To Approximate The Singular Value Decomposition

Commutators of Skew-Involutions

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Singular value decomposition of complexes

Characterizing GSVD by singular value expansion of linear operators and its computation

Ground States and Singular Vectors of Convex Variational Regularization Methods

Correlation functions between singular values and eigenvalues

Singular Value Decomposition For Unitary Symmetric Matrix