Abstract:This article addresses the problem of seeking a common fixed point for a finite collection of nonexpansive operators over time-varying multi-agent networks in real Hilbert spaces. Each operator is assumed to be only privately and approximately known to each individual agent, and all agents need to cooperate to solve this problem by local communications over time-varying networks. To handle this problem, inspired by the centralized inexact Krasnoselski$\breve{\i}$Mann iteration, we propose a distributed algorithm, called distributed inexact averaged operator algorithm (DIO). It is shown that the DIO can converge weakly to a common fixed point of the family of nonexpansive operators. Moreover, under the assumption that all operators and their own fixed point sets are (boundedly) linearly regular, it is proved that the distributed averaged operator algorithm converges with a rate $O(\gamma ^{\log _{16}(\text{4}k)})$ for some constant $\gamma \in (0,1)$, where $k$ is the iteration number. To reduce computational complexity, a scenario, where only a random part of coordinates of each operator is computed at each iteration, is further considered. In this case, a corresponding algorithm, named distributed block-coordinate inexact averaged operator algorithm, is developed. The algorithm is proved to be weakly convergent to a common fixed point of the group of considered operators almost surely, and, with the extra assumption of (bounded) linear regularity, the distributed block-coordinate averaged operator algorithm is convergent in the mean square sense with a rate $O(\eta ^{\log _{4}(\text{4}k)})$ for some constant $\eta \in (0,1)$. Furthermore, it is shown that the same convergence rates can still be guaranteed under a more relaxed (bounded) power regularity condition. A couple of examples are finally presented to illustrate the effectiveness of the proposed algorithms.

A Linearly Convergent Algorithm for Multi-Agent Quasi-Nonexpansive Operators in Real Hilbert Spaces

Distributed Algorithms for Computing a Common Fixed Point of a Group of Nonexpansive Operators

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Convex Optimization over Fixed Value Point Set of Quasi-Nonexpansive Random Operators on Hilbert Spaces

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Decentralized Proximal Point-type Method for Non-convex Non-concave Saddle Point Problems

A Unified Algorithmic Framework for Distributed Composite Optimization.

On the Divergence of Decentralized Non-Convex Optimization

Distributed Stochastic Algorithm for Global Optimization in Networked System

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Approximating Iterations for Nonexpansive and Maximal Monotone Operators

Distributed Quasi-Newton Method for Multi-Agent Optimization

Fully Distributed Continuous-Time Algorithm for Nonconvex Optimization Over Unbalanced Digraphs

Quantized Distributed Nonconvex Optimization Algorithms with Linear Convergence under the Polyak--$Ł$ojasiewicz Condition

A Power Reformulation Continuous-Time Algorithm for Nonconvex Distributed Constrained Optimization over Multi-Agent Systems

A Communication Efficient Quasi-Newton Method for Large-scale Distributed Multi-agent Optimization

Exponential Convergence of Distributed Optimal Coordination for Linear Multi-Agent Systems over General Digraphs