Abstract:This article investigates the optimally distributed consensus control problem for discrete-time multiagent systems with completely unknown dynamics and computational ability differences. The problem can be viewed as solving nonzero-sum games with distributed reinforcement learning (RL), and each agent is a player in these games. First, to guarantee the real-time performance of learning algorithms, a data-based distributed control algorithm is proposed for multiagent systems using offline system interaction data sets. By utilizing the interactive data produced during the run of a real-time system, the proposed algorithm improves system performance based on distributed policy gradient RL. The convergence and stability are guaranteed based on functional analysis and the Lyapunov method. Second, to address asynchronous learning caused by computational ability differences in multiagent systems, the proposed algorithm is extended to an asynchronous version in which executing policy improvement or not of each agent is independent of its neighbors. Furthermore, an actor-critic structure, which contains two neural networks, is developed to implement the proposed algorithm in synchronous and asynchronous cases. Based on the method of weighted residuals, the convergence and optimality of the neural networks are guaranteed by proving the approximation errors converge to zero. Finally, simulations are conducted to show the effectiveness of the proposed algorithm.

Distributed consensus for nonlinear multi-agent systems with two-time-scales: A hybrid reinforcement learning consensus algorithm

Distributed Consensus of Multi-Agent Systems with Nonlinear Dynamics Via Adaptive Intermittent Control

Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

A Nonlinear Transformation for Reaching Dynamic Consensus in Multi-Agent Systems

Data-Based Optimal Consensus Control for Multiagent Systems With Policy Gradient Reinforcement Learning

Distributed Model Predictive Control for Consensus of Nonlinear Second-Order Multi-Agent Systems

Optimal consensus control for unknown second-order multi-agent systems: Using model-free reinforcement learning method

Distributed Control of Nonlinear Multiagent Systems With Asymptotic Consensus

Distributed Optimal Consensus Control for Nonlinear Multiagent System with Unknown Dynamic.

Fully Distributed Hybrid Adaptive Learning Consensus Protocols for a Class of Non-Linearly Parameterized Multi-Agent Systems

Distributed learning consensus control based on neural networks for heterogeneous nonlinear multiagent systems

Fully Distributed Optimal Consensus for a Class of Second-Order Nonlinear Multiagent Systems with Switching Topologies.

Optimal Consensus Control for Heterogeneous Nonlinear Multiagent Systems with Partially Unknown Dynamics

Predictive Suboptimal Consensus of Multiagent Systems With Nonlinear Dynamics.

Adaptive Consensus Of Multi-Agent Systems With Unknown Nonlinear Dynamics

Adaptive near-optimal consensus of high-order nonlinear multi-agent systems with heterogeneity.

Consensus Control of Nonlinear Multiagent Systems with Time-Varying State Constraints

Model-Free Distributed Optimal Consensus Control of Nonlinear Multi-Agent Systems : A Graphical Game Approach

Fuzzy Adaptive Dynamic Programming-Based Optimal Leader-Following Consensus for Heterogeneous Nonlinear Multi-Agent Systems

Distributed fixed-time consensus for nonlinear heterogeneous multi-agent systems

Human-in-The-Loop Fuzzy Iterative Learning Control of Consensus for Unknown Mixed-Order Nonlinear Multi-Agent Systems