Abstract:We prove global convergence of classical projection algorithms for feasibility problems involving union convex sets, which refer to sets expressible as the union of a finite number of closed convex sets. We present a unified strategy for analyzing global convergence by means of studying fixed-point iterations of a set-valued operator that is the union of a finite number of compact-valued upper semicontinuous maps. Such a generalized framework permits the analysis of a class of proximal algorithms for minimizing the sum of a piecewise smooth function and the difference between pointwise minimum of finitely many weakly convex functions and a piecewise smooth convex function. When realized on two-set feasibility problems, this algorithm class recovers alternating projections and averaged projections as special cases, and thus we obtain global convergence criterion for these projection algorithms. Using these general results, we derive sufficient conditions to guarantee global convergence for several projection algorithms for solving the sparse affine feasibility problem and a feasibility reformulation of the linear complementarity problem. Notably, we obtain global convergence of both the alternating and the averaged projection methods to the solution set for linear complementarity problems involving $P$-matrices. By leveraging the structures of the classes of problems we consider, we also propose acceleration algorithms with guaranteed global convergence. Numerical results further exemplify that the proposed acceleration schemes significantly improve upon their non-accelerated counterparts in efficiency.

Some Remarks on the Convex Feasibility Problem and Best Approximation Problem

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

A Modification of Convex Approximation Methods for Structural Optimization

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

PROJECTION ALGORITHMS FOR CONVEX FEASIBILITY PROBLEMS ON HADAMARD MANIFOLDS

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

Linear Regularity and Linear Convergence of Projection-Based Methods for Solving Convex Feasibility Problems

Some Modified Relaxed Alternating Projection Methods for Solving the Two-Sets Convex Feasibility Problem

Constraint Qualification, the Strong CHIP, and Best Approximation with Convex Constraints in Banach Spaces.

Global convergence and acceleration of projection methods for feasibility problems involving union convex sets

Nonlinearly Constrained Best Approximation in Hilbert Spaces: the Strong CHIP and the Basic Constraint Qualification.

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Gradient projection algorithm for solving the convex feasibility problem

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

STRONG CONVERGENCE OF GENERAL PROJECTION METHODS FOR SOLVING CONVEX FEASIBILITY PROBLEM

THE SELECTIVE PROJECTION METHOD FOR CONVEX FEASIBILITY AND SPLIT FEASIBILITY PROBLEMS

Algorithms and Convergence Results of Projection Methods for Inconsistent Feasibility Problems: A Review

Modified Block Iterative Method for Solving Convex Feasibility Problem, Equilibrium Problems and Variational Inequality Problems

The Relaxed Inexact Projection Methods for the Split Feasibility Problem

A finitely convergent circumcenter method for the Convex Feasibility Problem

Approximating Curve and Strong Convergence of the CQ Algorithm for the Split Feasibility Problem