Abstract:This paper studies a cooperative adaptive optimal output regulation problem for a class of strict-feedback nonlinear discrete-time (DT) multi-agent systems (MASs) with partially unknown dynamics. Adaptive distributed observer, reinforcement learning (RL) and output regulation techniques are integrated to compute an adaptive near-optimal tracker for each follower. First, under the output regulation theory, the cooperative adaptive optimal output regulation problem is decomposed into a feedforward control design problem which can be addressed by solving nonlinear regulator equations, and an adaptive optimal feedback control problem. Different from general adaptive optimal stabilization problem of nonlinear DT systems, the value function of the optimal output regulation problem is positive semidefinite. This paper analyzes the stability of the closed-loop system without relying on the Lyapunov stability theory and also proposes a policy iteration (PI) approach to approximate the value function with the convergence proof. Then, an adaptive distributed observer is designed for each follower so that they can estimate the state of the leader. A model-state-input structure is developed to find the solutions to regulator equations for each follower and a critic–actor structure is employed to solve the optimal feedback control problem using the measured data based on the neural network (NN) and RL. It is shown that using the estimate values, the tracking errors are uniformly ultimately bounded. A simulation example is given to show the effectiveness of the proposed method.

Data-Driven Cooperative Output Regulation of Linear Discrete-Time Multiagent Systems With Unknown Dynamics

Cooperative Output Regulation of Unknown Linear Multiagent Systems: When Deadbeat Control Meets Data-Driven Framework

Robust Cooperative Output Regulation of Heterogeneous Uncertain Linear Multiagent Systems with Time-Varying Communication Topologies

Robust Cooperative Output Regulation of Uncertain Linear Multi-Agent Systems Not Detectable by Regulated Output

Cooperative Adaptive Optimal Output Regulation of Nonlinear Discrete-Time Multi-Agent Systems

Data-Driven Cooperative Output Regulation of Continuous-Time Multi-Agent Systems with Unknown Network Topology

Cooperative Output Regulation Quadratic Control for Discrete-Time Heterogeneous Multiagent Markov Jump Systems

Design of Cooperative Output Regulators for Heterogeneous Uncertain Nonlinear Multiagent Systems

Cooperative Output Regulation of Linear Multiagent Systems with Parameter Convergence

Adaptive Dynamic Programming and Cooperative Output Regulation of Discrete-time Multi-agent Systems

Distributed Event-Triggered Cooperative Output Regulation for Multiagent Systems

Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems with Markov Switching Topologies

New Results in Cooperative Adaptive Optimal Output Regulation

The Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems by the Adaptive Distributed Observer

Prescribed‐time cooperative output regulation of heterogeneous multi‐agent systems

Observer-based Output Regulation of Cooperative-Competitive High-Order Multi-Agent Systems

Cooperative Output Regulation of Singular Multi-Agent Systems under Adaptive Distributed Protocol and General Entirety Method

The adaptive distributed observer approach to the cooperative output regulation of linear multi-agent systems

Approximate Output Regulation of Discrete-Time Stochastic Multiagent Systems Subject to Heterogeneous and Unknown Dynamics.

Sampled‐data cooperative output regulation of linear multi‐agent systems