Abstract:We consider a distributed personalized optimization problem over a network of nodes whose cost functions depend on a decision variable consisting of two parts: global (shared) part and local (node-specific) part. This problem structure arises in several important scenarios where the global part captures the common feature among nodes and the local part represents the personalized feature. To solve this problem, we develop a flexible algorithmic framework employing personalized distributed stochastic gradient tracking method, where each node updates variables locally and communicates the shared part with its neighbors for coordination in a stochastic way. Different from existing works, the proposed framework provides great flexibility in designing algorithms with uncoordinated stepsizes for updating local and global parts over changing topologies. Most importantly, it can eliminate the effect of heterogeneity among nodes thanks to the gradient tracking scheme. Leveraging a properly designed Lyapunov function, we prove the convergence of the proposed algorithm for both (strongly) convex and non-convex objective functions with cross-block Lipschitz gradients. The obtained rate results show clear dependence of the convergence performance on topology, heterogeneity of stepsize and properties of objective functions. Numerical examples are provided to demonstrate the effectiveness of the proposed algorithm accounting for node-specific heterogeneity.

Adaptive Distributed Optimization Algorithms for Euler–Lagrange Systems

Distributed Continuous-Time Algorithm for Constrained Optimization of Networked Euler–Lagrange Systems

Distributed cooperative optimization for multiple heterogeneous Euler-Lagrangian systems under global equality and inequality constraints

Fully Distributed Event-Triggered Optimal Coordinated Control for Multiple Euler–Lagrangian Systems

Distributed Optimization of Multi-Building Energy Systems with Spatially and Temporally Coupled Constraints

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Adaptive Time-Varying Optimization with Global Asymptotic Convergence

Distributed Optimal Consensus for EulerLagrange Systems Based on Event-Triggered Control

Distributed Robust Optimization in Networked System.

Distributed Optimization for a Class of High-order Nonlinear Multi-agent Systems with Unknown Dynamics

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Distributed Continuous-Time Optimization with Scalable Adaptive Event-Based Mechanisms

Communication-efficient distributed optimization with adaptability to system heterogeneity

Distributed Finite-Time Optimization for Second Order Continuous-Time Multiple Agents Systems with Time-Varying Cost Function.

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

Distributed Optimization With Personalization: A Flexible Algorithmic Framework

Fast and Stable Nonconvex Constrained Distributed Optimization: The ELLADA Algorithm

Distributed Optimization for Uncertain Nonlinear Interconnected Multi-Agent Systems

Distributed Nash Equilibrium Seeking for Multicluster Aggregative Game of Euler–Lagrange Systems With Coupled Constraints

Hierarchical optimization for task-space bipartite coordination of multiple uncertain Lagrange plants

Velocity-Free Distributed Optimization Algorithms for Second-Order Multi-Agent Systems