Distributed Consensus-Based Multi-Agent Convex Optimization Via Gradient Tracking Technique

Huaqing Li,Hao Zhang,Zheng Wang,Yifan Zhu,Qi Han

DOI: https://doi.org/10.1016/j.jfranklin.2019.01.050

2019-01-01

Abstract:This paper considers solving a class of optimization problems over a network of agents, in which the cost function is expressed as the sum of individual objectives of the agents. The underlying communication graph is assumed to be undirected and connected. A distributed algorithm in which agents employ time-varying and heterogeneous step-sizes is proposed by combining consensus of multi-agent systems with gradient tracking technique. The algorithm not only drives the agents' iterates to a global and consensual minimizer but also finds the optimal value of the cost function. When the individual objectives are convex and smooth, we prove that the algorithm converges at a rate of O(1/root t) if the homogeneous step-size does not exceed some upper bound, and it accelerates to O(1/t) if the homogeneous step-size is sufficiently small. When at least one of the individual objectives is strongly convex and all are smooth, we prove that the algorithm converges at a linear rate of O(lambda(t)) with 0 < lambda < 1 even though the step-sizes are time-varying and heterogeneous. Two numerical examples are provided to demonstrate the efficiency of the proposed algorithm and to validate the theoretical findings. (C) 2019 Published by Elsevier Ltd on behalf of The Franklin Institute.