Distributed Discrete-time Optimization in Multi-agent Networks Using only Sign of Relative State

Jiaqi Zhang,Keyou You,Tamer Başar

DOI: https://doi.org/10.1109/TAC.2018.2884998

2018-12-10

Abstract:This paper proposes distributed discrete-time algorithms to cooperatively solve an additive cost optimization problem in multi-agent networks. The striking feature lies in the use of only the sign of relative state information between neighbors, which substantially differentiates our algorithms from others in the existing literature. We first interpret the proposed algorithms in terms of the penalty method in optimization theory and then perform non-asymptotic analysis to study convergence for static network graphs. Compared with the celebrated distributed subgradient algorithms, which however use the exact relative state information, the convergence speed is essentially not affected by the loss of information. We also study how introducing noise into the relative state information and randomly activated graphs affect the performance of our algorithms. Finally, we validate the theoretical results on a class of distributed quantile regression problems.

Systems and Control

What problem does this paper attempt to address?

This paper attempts to solve the problem of distributed optimization in multi - agent networks, especially in the case where each agent can only obtain the sign (i.e., positive or negative, equivalent to one - bit information) of the relative state information of its neighbors. Specifically, the paper proposes a distributed discrete - time algorithm using such minimalist information to cooperatively solve an additive cost optimization problem. This is different from most existing distributed optimization algorithms, which usually require each agent to access the exact relative state information of neighbors or quantized absolute state information. The main contributions of the paper are as follows:

1. **Proposing a new distributed optimization algorithm**: This algorithm only needs to know the sign of the relative state information between neighbors, rather than specific numerical information. This method is particularly useful in practical applications because sometimes agents can only obtain very rough information.

2. **Explanation and analysis of the algorithm**: The authors theoretically explain the proposed algorithm through the penalty method, showing that these algorithms are actually exact sub - gradient iterations of the penalty optimization problem. In addition, they also conduct a non - asymptotic analysis to study the convergence in static network graphs.

3. **Performance evaluation**: The paper explores the impact of introducing noise into the relative state information and randomly activating graphs on the performance of the algorithm, and verifies the theoretical results through a class of distributed quantile regression problems.

4. **Theoretical contribution**: The authors prove that under appropriate conditions, the proposed algorithm can achieve the same convergence rate as the traditional distributed sub - gradient algorithm without the need for exact relative state information. This is of great significance for improving the applicability of distributed optimization algorithms in resource - constrained environments.

In summary, the main objective of this paper is to design and analyze an effective distributed optimization algorithm to solve optimization problems in multi - agent networks under extremely limited information.