Decentralized Bundle Method for Nonsmooth Consensus Optimization.

Zifeng Wang,Qing Ling,Wotao Yin
DOI: https://doi.org/10.1109/globalsip.2017.8309023
2017-01-01
Abstract:In this paper, we propose a decentralized bundle method (DBM) to solve a convex but nonsmooth consensus optimization problem defined over a network. At each iteration, each agent first refines a piecewise linear approximation of its local cost function by sampling a new subgradeint. Then the agent solves a quadratic program (QP) of minimizing the approximated cost function, regularized with a quadratic term that is constructed from its neighbors' iterates. A serious step test is conducted to determine whether to accept the solution ofthe QP as the agent's new iterate or not, and thus guarantees sufficient descent. To reduce costs of storing subgradients and solving the QP subproblems, we further apply a subgradient aggregation technique to bound the number of stored subgradients and thus the dimension of the subproblems. Numerical experiments demonstrate the superior convergence speed of the proposed decentralized bundle method over existing algorithms.
What problem does this paper attempt to address?