Abstract:This article is concerned with the optimal synchronization problem for discrete-time nonlinear heterogeneous multiagent systems (MASs) with an active leader. To overcome the difficulty in the derivation of the optimal control protocols for these systems, we develop an observer-based adaptive synchronization control approach, including the designs of a distributed observer and a distributed model reference adaptive controller with no prior knowledge of all agents' dynamics. To begin with, for the purpose of estimating the state of a nonlinear active leader for each follower, an adaptive neural network distributed observer is designed. Such an observer serves as a reference model in the distributed model reference adaptive control (MRAC). Then, a reinforcement learning-based distributed MRAC algorithm is presented to make every follower track its corresponding reference model on behavior in real time. In this algorithm, a distributed actor-critic network is employed to approximate the optimal distributed control protocols and the cost function. Through convergence analysis, the overall observer estimation error, the model reference tracking error, and the weight estimation errors are proved to be uniformly ultimately bounded. The developed approach further achieves the synchronization by means of synthesizing these results. The effectiveness of the developed approach is verified through a numerical example.

Dual ML-ADHDP Method for Heterogeneous Discrete-Time Nonlinear Multi-Agent Systems with Unknown Dynamics and Time Delay.

Optimal Consensus Control for Heterogeneous Nonlinear Multiagent Systems with Partially Unknown Dynamics

Distributed Optimal Consensus Control for Nonlinear Multiagent System with Unknown Dynamic.

Finite-horizon Approximate Optimal Consensus Control for Discrete-time Nonlinear Multi-Agent Systems with Unknown Dynamics

Optimal Consensus Control Of Unknown Nonlinear Multi-Agent Systems Using Adaptive Dynamic Programming Via Mrac

Optimal Consensus Control Design for Multiagent Systems With Multiple Time Delay Using Adaptive Dynamic Programming

Online optimal consensus control of unknown linear multi-agent systems via time-based adaptive dynamic programming

Data-Based Optimal Synchronization Control for Discrete-Time Nonlinear Heterogeneous Multiagent Systems

Leader-follower Optimal Coordination Tracking Control for Multi-Agent Systems with Unknown Internal States

Nonfragile Near-Optimal Control of Stochastic Time-Varying Multiagent Systems with Control- and State-Dependent Noises

Data-driven Distributed Output Consensus Control for Multi-Agent Systems with Unknown Internal State

Model-Free Distributed Optimal Consensus Control of Nonlinear Multi-Agent Systems : A Graphical Game Approach

Optimal State Synchronization for Discrete-Time Nonlinear Multi-Agent Systems under Switching Communication Graph.

MRAC Based Consensus Control for Heterogeneous Discrete-Time Nonlinear Multi Agent Systems under Switching Typology with Unknown Dynamics.

Optimal Consensus Control for Partially Unknown Multi-Agent Systems with Switching Communication Topology*

Action-dependent Heuristic Dynamic Programming for Hybrid-Order Systems Based on Dynamic Event-Triggered Mechanism

Observer-Based Adaptive Synchronization Control of Unknown Discrete-Time Nonlinear Heterogeneous Systems

Distributed Adaptive Sliding Mode Control For Nonlinear Heterogeneous Multi-Agent Systems With Unknown Disturbances

Distributed model-free adaptive predictive control for heterogeneous nonlinear multi-agent systems

Event-Based Robust Optimal Consensus Control for Nonlinear Multiagent System with Local Adaptive Dynamic Programming.

A Robust Distributed Model Predictive Control Framework for Consensus of Multi-Agent Systems with Input Constraints and Varying Delays