Distributed Nonsmooth Optimization with Different Local Constraints Via Exact Penalty

Shuyu Liu,Shu Liang,Yiguang Hong
DOI: https://doi.org/10.1109/cdc49753.2023.10383876
2023-01-01
Abstract:In this paper, we study a distributed optimization problem, where decision variables of agents need to satisfy different local constraints and the consensus constraint to minimize the sum of local cost functions. We propose a novel method to remove all these constraints by employing the exact penalty so that the derived equivalent unconstrained problem can be directly solved by subgradient descent type differential inclusions. The algorithm achieves $\mathcal{O}(\frac{1}{t})$ rate of convergence when the cost functions are convex. Moreover, it achieves exponential convergence when the cost functions are strongly convex. Our method needs no dual variable to deal with the constraints so that computation and communication resources are saved in comparison with primal-dual methods. In addition, the method overcomes a divergence problem arising from an existing exponentially convergent distributed algorithm based on the exact penalty when the local constraints are different.
What problem does this paper attempt to address?