Abstract:We exploit the similarities between Tikhonov regularization and Bayesian hierarchical models to propose a regularization scheme that acts like a distributed Tikhonov regularization where the amount of regularization varies from component to component. In the standard formulation, Tikhonov regularization compensates for the inherent ill-conditioning of linear inverse problems by augmenting the data fidelity term measuring the mismatch between the data and the model output with a scaled penalty functional. The selection of the scaling is the core problem in Tikhonov regularization. If an estimate of the amount of noise in the data is available, a popular way is to use the Morozov discrepancy principle, stating that the scaling parameter should be chosen so as to guarantee that the norm of the data fitting error is approximately equal to the norm of the noise in the data. A too small value of the regularization parameter would yield a solution that fits to the noise while a too large value would lead to an excessive penalization of the solution. In many applications, it would be preferable to apply distributed regularization, replacing the regularization scalar by a vector valued parameter, allowing different regularization for different components of the unknown, or for groups of them. A distributed Tikhonov-inspired regularization is particularly well suited when the data have significantly different sensitivity to different components, or to promote sparsity of the solution. The numerical scheme that we propose, while exploiting the Bayesian interpretation of the inverse problem and identifying the Tikhonov regularization with the Maximum A Posteriori (MAP) estimation, requires no statistical tools. A combination of numerical linear algebra and optimization tools makes the scheme computationally efficient and suitable for problems where the matrix is not explicitly available.

Tikhonov-type regularization for nonlinear inverse problems with multiple repeated measurement data

Combining Regularization Frameworks for Solving the Electrocardiography Inverse Problem.

A relaxed iterated Tikhonov regularization for linear ill-posed inverse problems

Learning the optimal Tikhonov regularizer for inverse problems

Distributed Tikhonov regularization for ill-posed inverse problems from a Bayesian perspective

A new approach to nonlinear constrained Tikhonov regularization

Convergence rates for critical point regularization

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

Nonstationary iterated frozen Tikhonov regularization with uniformly convex penalty terms for solving inverse problems

Automatic nonstationary anisotropic Tikhonov regularization through bilevel optimization

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Regularization of linear inverse problems with irregular noise using embedding operators

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

An optimal transport approach for solving dynamic inverse problems in spaces of measures

Weighted inhomogeneous regularization for inverse problems with indirect and incomplete measurement data

Shearlet-based regularization in statistical inverse learning with an application to X-ray tomography

Regularization of the discrete source problem in the nonlinear diffusive-logistic equation

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

A fast iterative regularization method for ill-posed problems

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint