Abstract:Recently, the stochastic asymptotical regularization (SAR) has been developed in (\emph{Inverse Problems}, 39: 015007, 2023) for the uncertainty quantification of the stable approximate solution of linear ill-posed inverse problems. In this paper, we extend the regularization theory of SAR for nonlinear inverse problems. By combining techniques from classical regularization theory and stochastic analysis, we prove the regularizing properties of SAR with regard to mean-square convergence. The convergence rate results under the canonical sourcewise condition are also studied. Several numerical examples are used to show the accuracy and advantages of SAR: compared with the conventional deterministic regularization approaches for deterministic inverse problems, SAR can quantify the uncertainty in error estimates for ill-posed problems, improve accuracy by selecting the optimal path, escape local minima for nonlinear problems, and identify multiple solutions by clustering samples of obtained approximate solutions.

What problem does this paper attempt to address?

This paper attempts to solve the problems of stable solutions to nonlinear ill - posed problems and their uncertainty quantification. Specifically, the author extends the existing regularization theory by introducing the Stochastic Asymptotical Regularization (SAR) method and proves the regularization properties of SAR in terms of mean - square convergence. ### Problem Background Nonlinear ill - posed problems usually have the following characteristics: 1. **Existence of solutions**: Solutions may not exist. 2. **Uniqueness of solutions**: Even if solutions exist, they may not be unique. 3. **Stability of solutions**: Solutions are very sensitive to perturbations of the right - hand side, that is, a tiny input error may lead to a huge output error. For such problems, although traditional deterministic regularization methods (such as the Landweber iteration method) can provide a certain degree of stability, they have limitations in dealing with uncertainty and global optimal solutions. ### Advantages of the SAR Method The SAR method proposed in the paper has the following advantages: 1. **Quantifying uncertainty**: It can quantify error estimates in inverse problems and provide posterior (point - wise) error estimates. 2. **Revealing hidden information**: It can reveal and explain information that is masked in many practical problems due to incomplete mathematical modeling and large - scale noise. 3. **Improving accuracy**: It improves the accuracy of solutions by choosing the optimal path. 4. **Identifying multiple solutions**: It identifies multiple solutions by clustering approximate solution samples obtained. 5. **Avoiding local minima**: For some nonlinear inverse problems, SAR can effectively avoid getting trapped in local minima. ### Mathematical Model Consider the general nonlinear inverse problem: \[F(x)=y\] where the mapping \(F: D(F)\subset X\rightarrow Y\) is a nonlinear operator from the separable Hilbert space \(X\) to \(Y\). Given noisy data \(y^{\delta}\), satisfying: \[\left\|y^{\delta}-y\right\|\leq\delta,\quad\delta\in(0,\delta_{0}]\] The core of the SAR method is to apply continuous - time stochastic differential equations to the regularization process: \[dx^{\delta}(t)=F^{\prime}(x^{\delta}(t))^{*}(y^{\delta}-F(x^{\delta}(t)))dt + f(t)dB_{t},\quad x^{\delta}(0)=\bar{x}\] where \(B_{t}\) is an \(X\)-valued Q - Wiener process, and the auxiliary function \(f(t)\) controls the noise intensity. ### Convergence Analysis The paper analyzes the convergence of the SAR method in detail, including: 1. **Bias - variance decomposition**: Decomposing the total regularization error into a bias term and a variance term. 2. **Bias error estimation**: Estimating the bias error using classical regularization theory techniques. 3. **Variance error estimation**: Handling variance errors from infinite - dimensional stochastic integrals. ### Conclusion By introducing the SAR method, the paper not only solves the problem of stable solutions to nonlinear ill - posed problems but also provides a method for quantifying their uncertainty. Compared with traditional methods, SAR can provide more accurate and stable solutions in a wider range of scenarios, and can effectively avoid local minima and identify multiple solutions.

Stochastic asymptotical regularization for nonlinear ill-posed problems

Stochastic asymptotical regularization for linear inverse problems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Stochastic Convergence of Regularized Solutions and Their Finite Element Approximations to Inverse Source Problems

An asymptotical regularization with convex constraints for inverse problems

Superiorized Regularization of Inverse Problems

A stochastic two-step inertial Bregman proximal alternating linearized minimization algorithm for nonconvex and nonsmooth problems

Stochastic variance reduced gradient method for linear ill-posed inverse problems

On the Convergence of A Data-Driven Regularized Stochastic Gradient Descent for Nonlinear Ill-Posed Problems

On the Asymptotical Regularization for Linear Inverse Problems in Presence of White Noise

On the Convergence of SARAH and Beyond

A stochastic regularized second-order iterative scheme for optimal control and inverse problems in stochastic partial differential equations

Stochastic Data-Driven Bouligand Landweber Method for Solving Non-smooth Inverse Problems

Shearlet-based regularization in statistical inverse learning with an application to X-ray tomography

Regularization of Linear Inverse Problems with Irregular Noise Using Embedding Operators

Well-posedness and Tikhonov regularization of an inverse source problem for a parabolic equation with an integral constraint

Stochastic gradient descent for linear inverse problems in variable exponent Lebesgue spaces

Subspace projection regularization for large-scale Bayesian linear inverse problems

Convergence Analysis of Asymptotical Regularization and Runge-Kutta Integrators for Linear Inverse Problems under Variational Source Conditions

On Learning the Optimal Regularization Parameter in Inverse Problems

Regularization with two differential operators and its application to inverse problems