Abstract:Solutions to differential equations, which are used to model physical systems, are computed numerically by solving a set of discretized equations. This set of discretized equations is reduced to a large linear system, whose solution is typically found using an iterative solver. We start with an initial guess, $x_0$, and iterate the algorithm to obtain a sequence of solution vectors, $x_k$, which are approximations to the exact solution of the linear system, $x$. The iterative algorithm is said to converge to $x$, in the field of reals, if and only if $x_k$ converges to $x$ in the limit of $k \to \infty$. In this paper, we formally prove the asymptotic convergence of a particular class of iterative methods called the stationary iterative methods, in the Coq theorem prover. We formalize the necessary and sufficient conditions required for the iterative convergence, and extend this result to two classical iterative methods: the Gauss--Seidel method and the Jacobi method. For the Gauss--Seidel method, we also formalize a set of easily testable conditions for iterative convergence, called the Reich theorem, for a particular matrix structure, and apply this on a model problem of the one-dimensional heat equation. We also apply the main theorem of iterative convergence to prove convergence of the Jacobi method on the model problem.

A convergence analysis of iterative methods for the solution of nonlinear ill-posed problems under affinely invariant conditions

Analysis of Generalized Iteratively Regularized Landweber Iterations driven by data

On the Convergence of the Accelerated Riccati Iteration Method.

A data-driven iteratively regularized Landweber iteration

A modified iteratively regularized Landweber iteration method: Hölder stability and convergence rates

Convergence Analysis of a Method for Variational Inclusions

A compressive Landweber iteration for solving ill-posed inverse problems

A convergence analysis of the iteratively regularized Gauss-Newton method under Lipschitz condition

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Local Convergence of Inexact Methods under the Hölder Condition

Generalized Convergence Rates Results for Linear Inverse Problems in Hilbert Spaces

Local Analysis Of Inverse Problems: Holder Stability And Iterative Reconstruction

Convergence of General Nonstationary Iterative Methods for Solving Singular Linear Equations

Convergence analysis of equilibrium methods for inverse problems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Convergence Results of Landweber Iterations for Linear Systems

A novel two-point Landweber-type method for Regularization of non-smooth inverse problems in Banach spaces

Convergence Analysis of Projection Method for Variational Inequalities

Formalization of Asymptotic Convergence for Stationary Iterative Methods

Linear convergence of first order methods for non-strongly convex optimization

Strong convergence of an inertial iterative algorithm for variational inequality problem, generalized equilibrium problem, and fixed point problem in a Banach space