Abstract:Singular value decomposition is the key tool in the analysis and understanding of linear regularization methods. In the last decade nonlinear variational approaches such as $\ell^1$ or total variation regularizations became quite prominent regularization techniques with certain properties being superior to standard methods. In the analysis of those, singular values and vectors did not play any role so far, for the obvious reason that these problems are nonlinear, together with the issue of defining singular values and singular vectors. In this paper however we want to start a study of singular values and vectors for nonlinear variational regularization of linear inverse problems, with particular focus on singular one-homogeneous regularization functionals. A major role is played by the smallest singular value, which we define as the ground state of an appropriate functional combining the (semi-)norm introduced by the forward operator and the regularization functional. The optimality condition for the ground state further yields a natural generalization to higher singular values and vectors involving the subdifferential of the regularization functional. We carry over two main properties from the world of linear regularization. The first one is gaining information about scale, respectively the behavior of regularization techniques at different scales. This also leads to novel estimates at different scales, generalizing the estimates for the coefficients in the linear singular value expansion. The second one is to provide exact solutions for variational regularization methods. We will show that all singular vectors can be reconstructed up to a scalar factor by the standard Tikhonov-type regularization approach even in the presence of (small) noise. Moreover, we will show that they can even be reconstructed without any bias by the recently popularized inverse scale space method.

Perturbation Identities for Regularized Tikhonov Inverses and Weighted Pseudoinverses

Condition Numbers and Perturbation Analysis for the Tikhonov Regularization of Discrete Ill-Posed Problems.

Weighted Tikhonov Filter Matrices for Ill-Posed Problems

Perturbation bounds for constrained and weighted least squares problems

Condition Numbers and Perturbation of the Weighted Moore-Penrose Inverse and Weighted Linear Least Squares Problem.

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

Fictitious null spaces for improving the solution of injective inverse problems

Generalizing the SVD of a matrix under non-standard inner product and its applications to linear ill-posed problems

Perturbation Theory for the Generalized Inverse A(2)T,S

Ill-Conditioning Of The Truncated Singular Value Decomposition, Tikhonov Regularization And Their Applications To Numerical Partial Differential Equations

Structured Condition Numbers of Structured Tikhonov Regularization Problem and Their Estimations

Small noise analysis for Tikhonov and RKHS regularizations

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

Regularization of linear ill-posed problems involving multiplication operators

Perturbation and Inverse Problems of Stochastic Matrices

The Index Function and Tikhonov Regularization for Ill-Posed Problems

Learning the optimal Tikhonov regularizer for inverse problems

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Tikhonov Regularization for Weighted Total Least Squares Problems

Ground States and Singular Vectors of Convex Variational Regularization Methods