Reaching an Optimal Consensus: Distributed Intersection Computation for Multi-agent Systems

Guodong Shi,Karl Henrik Johansson,Yiguang Hong

2011-01-01

Abstract:Reaching an optimal consensus : distributed intersection computation for multi-agent systems

What problem does this paper attempt to address?

Distributed Consensus of Multi-Agent Systems with Nonlinear Dynamics Via Adaptive Intermittent Control

Hongjie Li,Hongye Su

DOI: https://doi.org/10.1016/j.jfranklin.2015.07.004

IF: 4.246

2015-01-01

Journal of the Franklin Institute

Abstract:The consensus problem is investigated for a class of multi-agent systems with nonlinear dynamics on a fixed directed information network, where each agent is assumed to share information only with its neighbors on some disconnected time intervals. A novel adaptive intermittent control protocol is first introduced, where only intermittent relative local information is used. Based on the Lyapunov stability theory combined with the method of the adaptive control and intermittent control, some novel and simple consensus criteria are derived under a fixed strongly connected topology, it is proved that consensus can be reached if the measure of communication is larger than a threshold value. The results are then extended to consensus with a virtual leader where the underlying topology is not necessarily strong connected or contains a directed spanning tree. Finally, two numerical examples are provided to demonstrate the effectiveness of the obtained theoretical results.
An Efficient Distributed Parallel Algorithm for Optimal Consensus of Multi-Agent Systems

Nan Bai,Qishao Wang,Zhisheng Duan

DOI: https://doi.org/10.1109/tcns.2023.3338245

2024-01-01

Abstract:A parallel algorithm is presented in this paper to efficiently solve the optimal consensus problem of multi-agent systems. By utilizing a Jacobi -type proximal alternating direction multiplier framework, the optimization process is divided into two independent subproblems that can be solved in parallel to improve computational efficiency, followed by the Lagrangian multiplier update. The convergence analysis of the proposed algorithm is performed using the convex optimization theory, deriving the convergence conditions concerning the auxiliary parameters. Furthermore, the accelerated algorithm enjoys a convergence rate of $\mathcal {O}(\frac{1}{t^{2}})$ by adjusting the auxiliary parameters adaptively. To leverage the strengths of the collaboration of multi-agent systems, the distributed implementation of the proposed parallel algorithm is further developed, where each agent addresses its private subproblems only using its own and its neighbor's information. Numerical simulations demonstrate the effectiveness of the theoretical results.
Reach Almost Sure Consensus with Only Group Information.

Zhiyun Lin,Jian Hou,Gangfeng Yan,Changbin (Brad) Yu

DOI: https://doi.org/10.1016/j.automatica.2014.11.011

IF: 6.4

2015-01-01

Automatica

Abstract:This brief presents a new distributed scheme to solve the consensus problem for a group of agents if neither their absolute states nor inter-agent relative states are available. The new scheme considers a random partition of agents into two subgroupsat each step and then uses the relative group representativestate as feedback informationfor the consensuspurpose. It is then shown that almost sure consensus can be achieved under the proposed scheme in both discrete time and continuous time. For the discrete time case, almost sure consensus is achieved if and only if the weighting parameter for state update is greater than one. For the continuous time case, almost sure consensus is realized when the weighting parameter is positive. Moreover, it is shown that if a uniform probability is considered for group selection, then the group of agents can reach average consensus in mean.
Distributed Optimal Consensus of Multi-Agent Systems: A Randomized Parallel Approach

Nan Bai,Zhisheng Duan,Qishao Wang

DOI: https://doi.org/10.1016/j.automatica.2023.111339

IF: 6.4

2023-01-01

Automatica

Abstract:In this paper, a randomized parallel algorithm is proposed to solve the distributed optimal consensus problem of multi-agent systems. Involving both the transient response and the final consensus state, the problem is described as a constrained non-separable optimization problem. Inspired by the randomized Jacobi proximal alternating direction method of multipliers, the proposed algorithm makes it possible for only a fraction of agents to solve their private subproblems in parallel at each iteration, which greatly saves computational resources and enhances running efficiency. The convergence analysis of the algorithm gives fully distributed convergence conditions. A trade-off between the convergence speed and resource savings is then obtained, where the convergence rate is estimated to be at least O1t. Furthermore, the algorithm can be accelerated to enjoy a convergence rate of O1t2 by adaptively adjusting the auxiliary parameters properly. Numerical simulations demonstrate the effectiveness of the theoretical results.
Distributed Optimal Consensus Control Algorithm for Continuous-Time Multi-Agent Systems.

Qishao Wang,Zhisheng Duan,Jingyao Wang

DOI: https://doi.org/10.1109/tcsii.2019.2900758

2019-01-01

IEEE Transactions on Circuits & Systems II Express Briefs

Abstract:This brief proposes a distributed algorithm to solve the optimal consensus control problem of continuous-time multi-agent systems. With the definition of consensus manifold, the utility function of the optimization problem is formulated as a linear quadratic polynomial which indicates the tradeoff between convergence rate and energy cost in a finite horizon. Applying the alternating direction method of multiplier, the optimal consensus problem is separated into three subproblems: 1) an input optimization problem; 2) a consensus state optimization problem; and 3) a dual optimization problem, thereby separating the communication topology and the agents dynamics. Then, these subproblems can be analyzed and solved independently, following from which that a distributed control algorithm is proposed to allow the continuous-time multi-agent systems to reach optimal consensus. A numerical example is given to demonstrate the effectiveness of the proposed algorithm.
Optimal Dynamic Average Consensus of Multi-Agent Systems

Hangning Dong,Chaoyong Li,Sai Chen

DOI: https://doi.org/10.1016/j.ifacol.2019.12.403

2019-01-01

IFAC-PapersOnLine

Abstract:This paper studies the average tracking problem on the premise of networked systems where each node is only allowed to interact with its neighbours. To this end, new dynamic average consensus protocols for both continuous-time and discrete time systems are proposed, and the corresponding analysis provides the rules on the optimal settings of the proposed algorithm with respect to convergence rate and steady-state performance. Numerical simulations validate the theoretical contributions of this work.
Distributed Optimal Consensus Control of Constrained Multi-Agent Systems: A Non-Separable Optimization Perspective

Nan Bai,Qishao Wang,Zhisheng Duan,Guanrong Chen

DOI: https://doi.org/10.1109/tac.2024.3390849

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:The optimal consensus control problem of constrained multi-agent systems is studied in this paper. Considering the transient performance, the final consensus state and constraints simultaneously, the problem is formulated as a constrained non-separable optimization problem accounting for the control inputs and the final consensus state. A distributes hybrid gradient projection alternating direction method of multipliers is designed to separate the coupled problem to independent subproblems solved by each agent, with a fully distributed condition derived to ensure the convergence of the proposed algorithm. To guarantee the stability of the closed-loop system, the finite-time control input sequence is extended online by using the receding horizon control method. The stability of the closed-loop system is analyzed by the Lyapunov method, deriving distributed conditions for parameter selection. Numerical simulations demonstrate the effectiveness of the proposed algorithm.
Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Jinming Xu,Ye Tian,Ying Sun,Gesualdo Scutari

DOI: https://doi.org/10.1109/tsp.2021.3086579

IF: 4.875

2021-01-01

IEEE Transactions on Signal Processing

Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.
Distributed Optimal Consensus Control of Constrained Multiagent Systems: A Nonseparable Optimization Perspective

Nan Bai,Qishao Wang,Zhisheng Duan,Guanrong Chen

DOI: https://doi.org/10.1109/tac.2024.3390849

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:The optimal consensus control problem of constrained multiagent systems is studied in this article. Considering the transient performance, the final consensus state and constraints simultaneously, the problem is formulated as a constrained nonseparable optimization problem accounting for the control inputs and the final consensus state. A distributes hybrid gradient projection alternating direction method of multipliers is designed to separate the coupled problem to independent subproblems solved by each agent, with a fully distributed condition derived to ensure the convergence of the proposed algorithm. To guarantee the stability of the closed-loop system, the finite-time control input sequence is extended online by using the receding horizon control method. The stability of the closed-loop system is analyzed by the Lyapunov method, deriving distributed conditions for parameter selection. Numerical simulations demonstrate the effectiveness of the proposed algorithm.
Distributed Consensus of Multiagent Systems: an Integrated Adaptive Approach

Qishao Wang,Yuezu Lv,Qingyun Wang,Zhisheng Duan,Guanrong Chen

DOI: https://doi.org/10.1109/tnse.2024.3377443

IF: 6.6

2024-01-01

IEEE Transactions on Network Science and Engineering

Abstract:This paper considers the consensus problem of multi-agent systems. It is pointed out that the existing consensus protocols decouple the effects of the agent and protocol dynamics of the consensus stability from that of the communication topology. In this paper, an integrated design approach is presented, under which a novel distributed adaptive consensus protocol is proposed to achieve consensus of multi-agent systems with undirected graphs. For the case there exist bounded external disturbances, by using the s modification technique, a distributed robust adaptive consensus protocol is presented to ensure the ultimate boundedness of the consensus error. Both of the proposed adaptive protocols are fully distributed, depending on only relative states of neighboring agents.
Consensus Control of Multi-agent Systems with Optimal Performance

Juanjuan Xu,Huanshui Zhang

DOI: https://doi.org/10.48550/arXiv.1803.09412

2018-03-26

Optimization and Control

Abstract:The consensus control with optimal cost remains major challenging although consensus control problems have been well studied in recent years. In this paper, we study the consensus control of multi-agent system associated with a given cost function. The main contribution is to present the distributed control protocol while minimizing the given cost function with positive semi-definite weighting matrix of control. The derived controller is composed of two parts: One part is the feedback of the individual state which minimizes the cost function and the other part is the feedback of the relative states between the neighbours which guarantees the consensus. The presented results are new to the best of our knowledge.
Distributed Model Predictive Control for Optimal Consensus of Constrained Multi-Agent Systems

Nan Bai,Qishao Wang,Zhisheng Duan

DOI: https://doi.org/10.23919/CCC58697.2023.10239795

2023-01-01

Abstract:This paper develops a framework based on distributed model predictive control to solve the optimal consensus problem for constrained multiagent systems. Taking both transient performance and final consensus state into consideration, the optimization problem in each prediction horizon is formed as a coupled optimization problem containing a nonseparable cost function with constraints. An efficient distributed algorithm is proposed with the distributed convergence conditions on the auxiliary parameters, which makes each agent solve its subproblems in parallel iterations, enhancing the running efficiency of the algorithm. The stability of the closed-loop system is analyzed, providing distributed stability conditions that only depend on the local information of each agent. Numerical simulations verify the validity of theoretical results by utilizing the proposed approach to a multi-robot system.
Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Zilun Hu,Jianying Yang

DOI: https://doi.org/10.23919/chicc.2019.8866418

2019-01-01

Abstract:This paper addresses a distributed convex optimization problem with objective functions for arbitrary order continuous time multiply agents systems with unknown parameters. In this paper, the control objective is not only to drive the multiply agents to reach a consensus, but also to cooperatively minimize the team objective function with consensus requirement. Different from the traditional optimization problems, in this paper, the proposed method is distributed, which means that the agent can only acquire the information of its neighbors' objective function through the network connection. Theoretical studies indicate that the proposed algorithms can minimize the team objective function and all agents will reach a consensus. Some simulation examples are presented to show the validity of the theoretical results.
Distributed Optimal Consensus of Multiagent Systems with Markovian Switching Topologies: Synchronous and Asynchronous Communications

Juan Zhang,Huaguang Zhang,Bowen Zhou,Xiangpeng Xie

DOI: https://doi.org/10.1007/s11432-023-3843-7

2023-01-01

Science China Information Sciences

Abstract:Considering limited system configurations and communication network bandwidths, this paper proposes two fully distributed event-triggered control schemes, namely synchronous and asynchronous communication, to solve the optimal consensus problem of linear multiagent systems (MASs) with Markovian switching topologies. The concept here is to design a novel composite dynamic event-triggered mechanism for each agent (using the information of all neighbors and one of them), based on which two fully distributed event-triggered protocols are designed to reach consensus and minimize a global convex team performance function. The effectiveness of the proposed control schemes is analyzed theoretically, that is, the optimal consensus problem can be realized, and the MAS does not exhibit Zeno behavior. Compared with existing optimal consensus results, the outstanding advantage of the proposed schemes is that a fully distributed asynchronous event-triggered communication scheme is designed, which fills the gap of optimal consensus results in this respect.
Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

Yao Zou,Kewei Xia,Bomin Huang,Ziyang Meng

DOI: https://doi.org/10.1109/tnnls.2021.3130173

IF: 14.255

2021-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:The optimization problem of second-order discrete-time multiagent systems with set constraints is studied in this article. In particular, the involved agents cooperatively search an optimal solution of a global objective function summed by multiple local ones within the intersection of multiple constrained sets. We also consider that each pair of local objective function and constrained set is exclusively accessible to the respective agent, and each agent just interacts with its local neighbors. By borrowing from the consensus idea, a projection-based distributed optimization algorithm resorting to an auxiliary dynamics is first proposed without interacting the gradient information of local objective functions. Next, by considering the local objective functions being strongly convex, selection criteria of step size and algorithm parameter are built such that the unique solution to the concerned optimization problem is obtained. Moreover, by fixing a unit step size, it is also shown that the optimization result can be relaxed to the case with just convex local objective functions given a properly chosen algorithm parameter. Finally, practical and numerical examples are taken to verify the proposed optimization results.
A Unified Algorithmic Framework for Distributed Composite Optimization.

Jinming Xu,Ye Tian,Ying Sun,Gesualdo Scutari

DOI: https://doi.org/10.1109/CDC42340.2020.9303791

2020-01-01

Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions-the agents' sum-utility-plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems, whose unified convergence analysis leverages the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; and (iii) A byproduct of our analysis is a tuning recommendation for several existing (non-accelerated) distributed algorithms yielding the fastest provable (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.
Fast Consensus for Fully Distributed Multi-Agent Task Allocation

Joanna Turner,Qinggang Meng,Gerald Schaefer,Andrea Soltoggio

DOI: https://doi.org/10.1145/3167132.3167224

2018-01-01

Abstract:In distributed multi-agent task allocation problems, the time to find a solution and a guarantee of reaching a solution, i.e. an execution plan, is critical to ensure a fast response. The problem is made more difficult by time constraints on tasks and on agents, which may prevent some tasks from being executed. This paper proposes a new distributed consensus-based task allocation algorithm that reduces convergence time with respect to previous methods, i.e. the time required for the network of agents to agree on a task allocation, while maximising the number of allocated tasks. The novel idea is to reduce the time to reach consensus among agents by using a hierarchy or rank-based conflict resolution among agents. Unlike other existing algorithms, this method enables different agents to construct their task schedules using any insertion heuristic, and still guarantee convergence. Simulation results demonstrate that the proposed approach can allocate a greater number of tasks in a shorter time than an established baseline method. Additionally, the analysis delineates dependencies between optimal insertion strategies and number of tasks per agent, providing insights for further optimisation strategies.
An Accelerated Algorithm for Linear Quadratic Optimal Consensus of Heterogeneous Multiagent Systems.

Qishao Wang,Zhisheng Duan,Jingyao Wang,Qingyun Wang,Guanrong Chen

DOI: https://doi.org/10.1109/tac.2021.3056363

IF: 6.549

2022-01-01

IEEE Transactions on Automatic Control

Abstract:An accelerated algorithm is proposed in this article for solving the linear quadratic optimal consensus problem of multiagent systems. To optimize the linear quadratic response and the final consensus state simultaneously, a nonseparable multiobjective optimization problem with coupled constraints on decision variables is formulated. The main difficulty in solving the optimization problem lies in the nonlinear coupling of objectives, which is overcome by separating the problem into two independent and solvable single-objective optimization subproblems using the alternating direction method of multipliers. The proximal gradient decent scheme is then introduced to approximate the precise optimal solutions of the subproblems so as to improve the computing efficiency. Convergence analysis is performed to estimate the convergence rate and derive the convergence condition, which is independent of any global information of the system and, therefore, is fully distributed. Furthermore, the solution of each subproblem is obtained in a distributed form, allowing the multiagent system to achieve optimal consensus. Numerical examples show the effectiveness of the accelerated algorithm.
A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Xingnan Wen,Sitian Qin

DOI: https://doi.org/10.1007/s40747-020-00265-x

2021-01-11

Abstract:Abstract Multi-agent systems are widely studied due to its ability of solving complex tasks in many fields, especially in deep reinforcement learning. Recently, distributed optimization problem over multi-agent systems has drawn much attention because of its extensive applications. This paper presents a projection-based continuous-time algorithm for solving convex distributed optimization problem with equality and inequality constraints over multi-agent systems. The distinguishing feature of such problem lies in the fact that each agent with private local cost function and constraints can only communicate with its neighbors. All agents aim to cooperatively optimize a sum of local cost functions. By the aid of penalty method, the states of the proposed algorithm will enter equality constraint set in fixed time and ultimately converge to an optimal solution to the objective problem. In contrast to some existed approaches, the continuous-time algorithm has fewer state variables and the testification of the consensus is also involved in the proof of convergence. Ultimately, two simulations are given to show the viability of the algorithm.

computer science, artificial intelligence
Distributed optimization via multi-agent systems

Long WANG,Kai-hong LU,Yong-qiang GUAN

DOI: https://doi.org/10.7641/CTA.2019.90502

2019-01-01

Abstract:Distributed optimization via multi-agent systems WANG Long1†, LU Kai-hong2, GUAN Yong-qiang3 (1. Center for Systems and Control, College of Engineering, Peking University, Beijing 100871, China; 2. School of Electrical and Information Engineering, Jiangsu University, Zhenjiang Jiangsu 212013, China; 3. Center for Complex Systems, School of Mechano-electronic Engineering, Xidian University, Xi’an Shaanxi 710071, China) Abstract: As a basic and significant topic in the field of distributed coordination control, distributed optimization via multi-agent systems has attracted great interest in recent years. An overview on the state-of-the-art of the distributed optimization is presented in this paper, where results on offline/online distributed optimization are introduced, respectively. In the study of distributed optimization, algorithm design and convergence analysis are two key issues, which are discussed in detail. Furthermore, we introduce a related work: distributed strategies for solving mixed equilibrium problems. Finally, open problems and future research directions are presented.

Reaching an Optimal Consensus: Distributed Intersection Computation for Multi-agent Systems

Distributed Consensus of Multi-Agent Systems with Nonlinear Dynamics Via Adaptive Intermittent Control

An Efficient Distributed Parallel Algorithm for Optimal Consensus of Multi-Agent Systems

Reach Almost Sure Consensus with Only Group Information.

Distributed Optimal Consensus of Multi-Agent Systems: A Randomized Parallel Approach

Distributed Optimal Consensus Control Algorithm for Continuous-Time Multi-Agent Systems.

Optimal Dynamic Average Consensus of Multi-Agent Systems

Distributed Optimal Consensus Control of Constrained Multi-Agent Systems: A Non-Separable Optimization Perspective

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Optimal Consensus Control of Constrained Multiagent Systems: A Nonseparable Optimization Perspective

Distributed Consensus of Multiagent Systems: an Integrated Adaptive Approach

Consensus Control of Multi-agent Systems with Optimal Performance

Distributed Model Predictive Control for Optimal Consensus of Constrained Multi-Agent Systems

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Distributed Optimal Consensus of Multiagent Systems with Markovian Switching Topologies: Synchronous and Asynchronous Communications

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

A Unified Algorithmic Framework for Distributed Composite Optimization.

Fast Consensus for Fully Distributed Multi-Agent Task Allocation

An Accelerated Algorithm for Linear Quadratic Optimal Consensus of Heterogeneous Multiagent Systems.

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Distributed optimization via multi-agent systems