Abstract:With computational inverse problems, it is desirable to develop an efficient inversion algorithm to find a solution from measurement data through a mathematical model connecting the unknown solution and measurable quantity based on the first principles. However, most of mathematical models represent only a few aspects of the physical quantity of interest, and some of them are even incomplete in the sense that one measurement corresponds to many solutions satisfying the forward model. In this paper, in light of the recently developed iNETT method in (\emph{Inverse Problems}, 39: 055002, 2023), we propose a novel iterative regularization method for efficiently solving non-linear ill-posed inverse problems with potentially non-injective forward mappings and (locally) non-stable inversion mappings. Our approach integrates the inexact Newton iteration, the non-stationary iterated Tikhonov regularization, the two-point gradient acceleration method, and the structure-free feature-selection rule. The main difficulty in the regularization technique is how to design an appropriate regularization penalty, capturing the key feature of the unknown solution. To overcome this difficulty, we replace the traditional regularization penalty with a deep neural network, which is structure-free and can identify the correct solution in a huge null space. A comprehensive convergence analysis of the proposed algorithm is performed under standard assumptions of regularization theory. Numerical experiments with comparisons with other state-of-the-art methods for two model problems are presented to show the efficiency of the proposed approach.

On the order optimality of the regularization via inexact Newton iterations

Inexact Newton regularization methods in Hilbert scales

Generalized Inexact Newton Regularization for Nonlinear Ill-Posed Problems in Banach Spaces

Inexact Newton Regularization in Banach Spaces Based on Two-Point Gradient Method with Uniformly Convex Penalty Terms

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Local Convergence of Inexact Methods under the Hölder Condition

Heuristic Rule for Inexact Newton-Landweber Iteration with Convex Penalty Terms of Nonlinear: Ill-Posed Problems

An asymptotical regularization with convex constraints for inverse problems

An inexact regularized proximal Newton method for nonconvex and nonsmooth optimization

A convergence analysis of the iteratively regularized Gauss-Newton method under Lipschitz condition

REGINN-IT Method with General Convex Penalty Terms for Nonlinear Inverse Problems

An accelerated inexact Newton regularization scheme with a learned feature-selection rule for non-linear inverse problems

Convergence Analysis of Inexact Newton–Landweber Iteration under Hölder Stability

A Regularization Method for Solving Nonlinear Inverse Problems

Adaptive regularized quasi-newton method using inexact first-order information

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

A Proximal Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems

Bouligand-Newton type methods for non-smooth ill-posed problems

A hybrid inexact regularized Newton and negative curvature method

Inexact quasi-Newton methods under a relaxed metric regularity assumption