Abstract:This paper studies a cooperative adaptive optimal output regulation problem for a class of strict-feedback nonlinear discrete-time (DT) multi-agent systems (MASs) with partially unknown dynamics. Adaptive distributed observer, reinforcement learning (RL) and output regulation techniques are integrated to compute an adaptive near-optimal tracker for each follower. First, under the output regulation theory, the cooperative adaptive optimal output regulation problem is decomposed into a feedforward control design problem which can be addressed by solving nonlinear regulator equations, and an adaptive optimal feedback control problem. Different from general adaptive optimal stabilization problem of nonlinear DT systems, the value function of the optimal output regulation problem is positive semidefinite. This paper analyzes the stability of the closed-loop system without relying on the Lyapunov stability theory and also proposes a policy iteration (PI) approach to approximate the value function with the convergence proof. Then, an adaptive distributed observer is designed for each follower so that they can estimate the state of the leader. A model-state-input structure is developed to find the solutions to regulator equations for each follower and a critic–actor structure is employed to solve the optimal feedback control problem using the measured data based on the neural network (NN) and RL. It is shown that using the estimate values, the tracking errors are uniformly ultimately bounded. A simulation example is given to show the effectiveness of the proposed method.

Output-feedback Optimized Consensus for Directed Graph Multi-Agent Systems Based on Reinforcement Learning and Subsystem Error Derivatives.

Data-driven Distributed Output Consensus Control for Multi-Agent Systems with Unknown Internal State

Optimized backstepping consensus control using adaptive observer-critic-actor reinforcement learning for strict-feedback multi-agent systems

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Data-Driven Optimal Consensus Control for Switching Multiagent Systems Via Joint Communication Graph

Optimal Bipartite Consensus Control for Heterogeneous Unknown Multi-Agent Systems Via Reinforcement Learning

Optimal consensus control for unknown second-order multi-agent systems: Using model-free reinforcement learning method

Adaptive Optimal Output-Feedback Consensus Tracking Control of Nonlinear Multiagent Systems Using Two-Player Stackelberg Game

Optimized leader-follower consensus control for high-order nonlinear multi-agent system modeled in canonical dynamic form

Output Feedback Consensus Tracking for Second-Order Nonlinear Multi-Agent Systems with Directed Communication Graphs

Distributed Optimal Output Consensus of Uncertain Nonlinear Multi-Agent Systems over Unbalanced Directed Networks Via Output Feedback

Data-Driven Optimal Bipartite Consensus Control for Second-Order Multiagent Systems via Policy Gradient Reinforcement Learning

Cooperative Adaptive Optimal Output Regulation of Nonlinear Discrete-Time Multi-Agent Systems

Observer-based Reinforcement Learning for Optimal Fault-Tolerant Consensus Control of Nonlinear Multi-Agent Systems Via a Dynamic Event-Triggered Mechanism

Data-driven output consensus for a class of discrete-time multiagent systems by reinforcement learning techniques

Dynamic Event-Triggered Reinforcement Learning-Based Consensus Tracking of Nonlinear Multi-Agent Systems

Distributed consensus of linear multi-agent systems via decentralized output feedback control approach

Data-Driven Distributed Output Consensus Control for Partially Observable Multiagent Systems.

Distributed consensus tracking control of nonlinear multi-agent systems with dynamic output constraints and input saturation

Observer-Based Consensus Control for MASs With Prescribed Constraints via Reinforcement Learning Algorithm

Adaptive Learning Control for Group Consensus Tracking of Discrete Nonlinear Multiagent Systems