Abstract:We exploit the similarities between Tikhonov regularization and Bayesian hierarchical models to propose a regularization scheme that acts like a distributed Tikhonov regularization where the amount of regularization varies from component to component. In the standard formulation, Tikhonov regularization compensates for the inherent ill-conditioning of linear inverse problems by augmenting the data fidelity term measuring the mismatch between the data and the model output with a scaled penalty functional. The selection of the scaling is the core problem in Tikhonov regularization. If an estimate of the amount of noise in the data is available, a popular way is to use the Morozov discrepancy principle, stating that the scaling parameter should be chosen so as to guarantee that the norm of the data fitting error is approximately equal to the norm of the noise in the data. A too small value of the regularization parameter would yield a solution that fits to the noise while a too large value would lead to an excessive penalization of the solution. In many applications, it would be preferable to apply distributed regularization, replacing the regularization scalar by a vector valued parameter, allowing different regularization for different components of the unknown, or for groups of them. A distributed Tikhonov-inspired regularization is particularly well suited when the data have significantly different sensitivity to different components, or to promote sparsity of the solution. The numerical scheme that we propose, while exploiting the Bayesian interpretation of the inverse problem and identifying the Tikhonov regularization with the Maximum A Posteriori (MAP) estimation, requires no statistical tools. A combination of numerical linear algebra and optimization tools makes the scheme computationally efficient and suitable for problems where the matrix is not explicitly available.

Tikhonov regularization for large scale problems

Generalized Tikhonov regularization method for large-scale linear inverse problems

A Special Modified Tikhonov Regularization Matrix for Discrete Ill-Posed Problems

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

Modulus-based Iterative Methods for Constrained Tikhonov Regularization

Regularization Total Least Squares and Randomized Algorithms

Special Regularized HSS Iteration Method for Tikhonov Regularization

Adaptive choice of the Tikhonov regularization parameter to solve ill-posed linear algebraic equations via Liapunov Optimizing Control

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

A relaxed iterated Tikhonov regularization for linear ill-posed inverse problems

Multi-Parameter Tikhonov Regularization for Linear Ill-Posed Operator Equations

A fast iterative regularization method for ill-posed problems

Projected Newton Method for noise constrained Tikhonov regularization

Distributed Tikhonov regularization for ill-posed inverse problems from a Bayesian perspective

A Joint Bidiagonalization Based Algorithm for Large Scale Linear Discrete Ill-posed Problems in General-Form Regularization

Tikhonov regularization with conjugate gradient least squares method for large-scale discrete ill-posed problem in image restoration

A dual based semismooth Newton-type algorithm for solving large-scale sparse Tikhonov regularization problems

The Regularization Theory of the Krylov Iterative Solvers LSQR, CGLS, LSMR and CGME for Linear Discrete Ill-Posed Problems

A Multi-Scale Tikhonov Regularization Scheme for Implicit Surface Modelling

Automatic nonstationary anisotropic Tikhonov regularization through bilevel optimization

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption