Abstract:This paper studies a cooperative adaptive optimal output regulation problem for a class of strict-feedback nonlinear discrete-time (DT) multi-agent systems (MASs) with partially unknown dynamics. Adaptive distributed observer, reinforcement learning (RL) and output regulation techniques are integrated to compute an adaptive near-optimal tracker for each follower. First, under the output regulation theory, the cooperative adaptive optimal output regulation problem is decomposed into a feedforward control design problem which can be addressed by solving nonlinear regulator equations, and an adaptive optimal feedback control problem. Different from general adaptive optimal stabilization problem of nonlinear DT systems, the value function of the optimal output regulation problem is positive semidefinite. This paper analyzes the stability of the closed-loop system without relying on the Lyapunov stability theory and also proposes a policy iteration (PI) approach to approximate the value function with the convergence proof. Then, an adaptive distributed observer is designed for each follower so that they can estimate the state of the leader. A model-state-input structure is developed to find the solutions to regulator equations for each follower and a critic–actor structure is employed to solve the optimal feedback control problem using the measured data based on the neural network (NN) and RL. It is shown that using the estimate values, the tracking errors are uniformly ultimately bounded. A simulation example is given to show the effectiveness of the proposed method.

Adaptive Dynamic Programming and Cooperative Output Regulation of Discrete-time Multi-agent Systems

Cooperative Output Regulation of Linear Multi-Agent Network Systems with Dynamic Edges.

Cooperative Output Regulation of Multi-Agent Systems Coupled by Dynamic Edges

Data-driven cooperative optimal output regulation for linear discrete-time multi-agent systems by online distributed adaptive internal model approach

Adaptive Dynamic Programming and Data-Driven Cooperative Optimal Output Regulation with Adaptive Observers

New Results in Cooperative Adaptive Optimal Output Regulation

Distributed Adaptive Output Feedback Control for Multiagent Systems with Unknown Dynamics

Cooperative Adaptive Optimal Output Regulation of Nonlinear Discrete-Time Multi-Agent Systems

Model-Free Cooperative Optimal Output Regulation for Linear Discrete-Time Multi-Agent Systems Using Reinforcement Learning

Data-driven cooperative output regulation of multi-agent systems under distributed denial of service attacks

Data-Driven Cooperative Output Regulation of Linear Discrete-Time Multiagent Systems With Unknown Dynamics

Leader-Following Constrained Distributed Adaptive Dynamic Programming Design for Multiagent Systems

Distributed Adaptive Output Regulation Controllers of Heterogeneous Linear Multi-Agent Systems with Directed Graphs

Optimal Output Regulation for Heterogeneous Multiagent Systems Via Adaptive Dynamic Programming

Cooperative Output Regulation for Networked Multi-Agent Systems Based on the Self-Tuning Adaptive Distributed Observer

Adaptive Cooperative Output Regulation Of Multi-Agent Systems In Nonlinear Lower Triangular Form

Adaptive Control for Cooperative Linear Output Regulation of Heterogeneous Multi-Agent Systems with Periodic Switching Topology

Cooperative Output Regulation of Heterogeneous Linear Multi-Agent Systems Via Fully Distributed Event-Triggered Adaptive Control

Cooperative Output Regulation of Heterogeneous Nonlinear Multi-Agent Systems With Unknown Control Directions.

Neural-network-based Learning Algorithms for Cooperative Games of Discrete-Time Multi-Player Systems with Control Constraints Via Adaptive Dynamic Programming

The Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems by the Adaptive Distributed Observer