Abstract:Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy principle. However, most approaches require the solution of the Tikhonov problem for many different values of the regularization parameter, which is computationally demanding for large scale problems. We propose a new and efficient algorithm which simultaneously solves the Tikhonov problem and finds the corresponding regularization parameter such that the discrepancy principle is satisfied. We achieve this by formulating the problem as a nonlinear system of equations and solving this system using a line search method. We obtain a good search direction by projecting the problem onto a low dimensional Krylov subspace and computing the Newton direction for the projected problem. This projected Newton direction, which is significantly less computationally expensive to calculate than the true Newton direction, is then combined with a backtracking line search to obtain a globally convergent algorithm, which we refer to as the Projected Newton method. We prove convergence of the algorithm and illustrate the improved performance over current state-of-the-art solvers with some numerical experiments.

A discretizing Tikhonov regularization method via modified parameter choice rules

Generalized Tikhonov regularization method for large-scale linear inverse problems

A Special Modified Tikhonov Regularization Matrix for Discrete Ill-Posed Problems

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

Projected Newton Method for noise constrained Tikhonov regularization

Multi-parameter Regularization and Its Numerical Realization

A PRIORI STRATEGY IN DISCRETIZATION OF THE TIKHONOV REGULARIZATION

Heuristic parameter choice in Tikhonov method from minimizers of the quasi-optimality function

Multi-Parameter Tikhonov Regularization for Linear Ill-Posed Operator Equations

Multiscale Analysis for Ill-Posed Problems with Semi-Discrete Tikhonov Regularization

Optimal order conditions for filter based regularization methods, with applications to variants of the Tikhonov method

Heuristic Parameter Selection Based on Functional Minimization: Optimality and Model Function Approach

A Posteriori Regularization Parameter Choice Rule for the Quasi-Boundary Value Method for the Backward Time-Fractional Diffusion Problem

An adaptive Tikhonov regularization parameter estimation method

Optimal Error Bound and Simplified Tikhonov Regularization Method for a Backward Problem for the Time-Fractional Diffusion Equation

Heuristic parameter-choice rules for convex variational regularization based on error estimates

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

A Study on Regularization Parameter Choice for Interior Tomography Based on Truncated Hilbert Transform

Convergence of Chebyshev Type Regularization Method under Morozov Discrepancy Principle.

New Model Function Methods for Determining Regularization Parameters in Linear Inverse Problems

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint