Abstract:Given closed convex sets $C_i$, $i=1,\ldots,\ell$, and some nonzero linear maps $A_i$, $i = 1,\ldots,\ell$, of suitable dimensions, the multi-set split feasibility problem aims at finding a point in $\bigcap_{i=1}^\ell A_i^{-1}C_i$ based on computing projections onto $C_i$ and multiplications by $A_i$ and $A_i^T$. In this paper, we consider the associated best approximation problem, i.e., the problem of computing projections onto $\bigcap_{i=1}^\ell A_i^{-1}C_i$; we refer to this problem as the best approximation problem in multi-set split feasibility settings (BA-MSF). We adapt the Dykstra's projection algorithm, which is classical for solving the BA-MSF in the special case when all $A_i = I$, to solve the general BA-MSF. Our Dykstra-type projection algorithm is derived by applying (proximal) coordinate gradient descent to the Lagrange dual problem, and it only requires computing projections onto $C_i$ and multiplications by $A_i$ and $A_i^T$ in each iteration. Under a standard relative interior condition and a genericity assumption on the point we need to project, we show that the dual objective satisfies the Kurdyka-Lojasiewicz property with an explicitly computable exponent on a neighborhood of the (typically unbounded) dual solution set when each $C_i$ is $C^{1,\alpha}$-cone reducible for some $\alpha\in (0,1]$: this class of sets covers the class of $C^2$-cone reducible sets, which include all polyhedrons, second-order cone, and the cone of positive semidefinite matrices as special cases. Using this, explicit convergence rate (linear or sublinear) of the sequence generated by the Dykstra-type projection algorithm is derived. Concrete examples are constructed to illustrate the necessity of some of our assumptions.

Convergence Rate Analysis of a Dykstra-Type Projection Algorithm

Convergence rate analysis of a Dykstra-type projection algorithm

Convergence Analysis of Alternating Projection Method for Nonconvex Sets

Global convergence and acceleration of projection methods for feasibility problems involving union convex sets

Linear Optimization by Conical Projection

Local Convergence Analysis of Projection-Type Algorithms: Unified Approach

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Convergence rate analysis of distributed optimization with projected subgradient algorithm.

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

Proximal Gradient/Semismooth Newton Methods for Projection Onto a Polyhedron Via the Duality-Gap-Active-Set Strategy

On Convergence Rate of Projection Neural Networks

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

The splitting algorithms by Ryu and by Malitsky-Tam applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

Convergence rate of alternating projection method for the intersection of an affine subspace and the second-order cone

Projection Algorithms for Finite Sum Constrained Optimization

Convergence Rate of A Derivative-free Projection Method for Nonlinear Equations

Linear Convergence Rates for Extrapolated Fixed Point Algorithms

A Richer Theory of Convex Constrained Optimization with Reduced Projections and Improved Rates

Local Convergence Properties of Douglas–Rachford and Alternating Direction Method of Multipliers