Abstract:Solving large-scale systems of nonlinear equations/inequalities is a fundamental problem in computing and optimization. In this paper, we propose a generic successive projection (SP) framework for this problem. The SP sequentially projects the current iterate onto the constraint set corresponding to each nonlinear (in)equality. It extends von Neumann's alternating projection for finding a point in the intersection of two linear subspaces, Bregman's method for finding a common point of convex sets and the Kaczmarz method for solving systems of linear equations to the more general case of multiple nonlinear and nonconvex sets. The existing convergence analyses on randomized Kaczmarz are merely applicable to linear case. There are no theoretical convergence results of the SP for solving nonlinear equations. This paper presents the first proof that the SP locally converges to a solution of nonlinear equations/inequalities at a linear rate. Our work establishes the convergence theory of the SP for the case of multiple nonlinear and nonconvex sets. Besides cyclic and randomized projections, we devise two new greedy projection approaches that significantly accelerate the convergence. Furthermore, the theoretical bounds of the convergence rates are derived. We reveal that the convergence rates are related to the Hoffman constants of the Jacobian matrix of the nonlinear functions at the solution. Applying the SP to solve the graph realization problem, which attracts much attention in theoretical computer science, is discussed.

A Projection Method for Solving Monotone Nonlinear Equations with Application

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

The convergence of conjugate gradient method with nonmonotone line search

Enhanced Projection Method for the Solution of the System of Nonlinear Equations Under a More General Assumption than Pseudo-Monotonicity and Lipschitz Continuity

A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

A Modified Spectral PRP Conjugate Gradient Projection Method for Solving Large-Scale Monotone Equations and Its Application in Compressed Sensing

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

A hybrid BFGS-Like method for monotone operator equations with applications

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

A three-term subspace projection method for solving systems of nonlinear monotone equations

A Modified Three-Term Conjugate Descent Derivative-Free Method for Constrained Nonlinear Monotone Equations and Signal Reconstruction Problems

Two Descent Dai-Yuan Conjugate Gradient Methods for Systems of Monotone Nonlinear Equations

Successive Projection for Solving Systems of Nonlinear Equations/Inequalities

Iterative algorithms for equilibrium problems based on proximal-like methods

An inertia projection method for nonlinear pseudo-monotone equations with convex constraints

A Two-Step Spectral Gradient Projection Method for System of Nonlinear Monotone Equations and Image Deblurring Problems

An efficient inertial subspace minimization CG algorithm with convergence rate analysis for constrained nonlinear monotone equations

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network.