Abstract:Solving large-scale systems of nonlinear equations/inequalities is a fundamental problem in computing and optimization. In this paper, we propose a generic successive projection (SP) framework for this problem. The SP sequentially projects the current iterate onto the constraint set corresponding to each nonlinear (in)equality. It extends von Neumann's alternating projection for finding a point in the intersection of two linear subspaces, Bregman's method for finding a common point of convex sets and the Kaczmarz method for solving systems of linear equations to the more general case of multiple nonlinear and nonconvex sets. The existing convergence analyses on randomized Kaczmarz are merely applicable to linear case. There are no theoretical convergence results of the SP for solving nonlinear equations. This paper presents the first proof that the SP locally converges to a solution of nonlinear equations/inequalities at a linear rate. Our work establishes the convergence theory of the SP for the case of multiple nonlinear and nonconvex sets. Besides cyclic and randomized projections, we devise two new greedy projection approaches that significantly accelerate the convergence. Furthermore, the theoretical bounds of the convergence rates are derived. We reveal that the convergence rates are related to the Hoffman constants of the Jacobian matrix of the nonlinear functions at the solution. Applying the SP to solve the graph realization problem, which attracts much attention in theoretical computer science, is discussed.

Several Acceleration Schemes for Solving the Multiple-Sets Split Feasibility Problem

Self-adaptive relaxed CQ algorithms for solving split feasibility problem with multiple output sets

Inertial Halpern-type iterative algorithm for the generalized multiple-set split feasibility problem in Banach spaces

Two Relaxed CQ Methods for the Split Feasibility Problem with Multiple Output Sets

On Descent-Projection Method for Solving the Split Feasibility Problems

MILP Acceleration: A Survey from Perspectives of Simplex Initialization and Learning-Based Branch and Bound

A Relaxed Tseng's Method-based Algorithm for Solving Split Variational Inequalities with Multiple Output Sets

Linear Regularity and Linear Convergence of Projection-Based Methods for Solving Convex Feasibility Problems

A Strongly Convergent Algorithm for Solving Multiple set Split Equality Equilibrium and Fixed Point Problems in Banach Spaces

Convergence Study on Strictly Contractive Peaceman–Rachford Splitting Method for Nonseparable Convex Minimization Models with Quadratic Coupling Terms

Strong convergence of Bregman projection algorithms for solving split feasibility problems

Randomized Douglas-Rachford methods for linear systems: Improved accuracy and efficiency

Successive Projection for Solving Systems of Nonlinear Equations/Inequalities

Solving min–max linear fractional programs based on image space branch-and-bound scheme

New inertial self-adaptive algorithms for the split feasibility problem with multiple output sets

A Parallel Line Search Subspace Correction Method for Composite Convex Optimization

An accelerated active-set algorithm for a quadratic semidefinite program with general constraints

Flexible and deflated variants of the block shifted GMRES method

On the Convergence of Subproper (Multi)-Splitting Methods for Solving Rectangular Linear Systems

An Iterative Method for Solving the Multiple-Sets Split Variational Inequality Problem

A Partially Parallel Splitting Method for Multiple-Block Separable Convex Programming with Applications to Robust Pca