Abstract:This paper studies a cooperative adaptive optimal output regulation problem for a class of strict-feedback nonlinear discrete-time (DT) multi-agent systems (MASs) with partially unknown dynamics. Adaptive distributed observer, reinforcement learning (RL) and output regulation techniques are integrated to compute an adaptive near-optimal tracker for each follower. First, under the output regulation theory, the cooperative adaptive optimal output regulation problem is decomposed into a feedforward control design problem which can be addressed by solving nonlinear regulator equations, and an adaptive optimal feedback control problem. Different from general adaptive optimal stabilization problem of nonlinear DT systems, the value function of the optimal output regulation problem is positive semidefinite. This paper analyzes the stability of the closed-loop system without relying on the Lyapunov stability theory and also proposes a policy iteration (PI) approach to approximate the value function with the convergence proof. Then, an adaptive distributed observer is designed for each follower so that they can estimate the state of the leader. A model-state-input structure is developed to find the solutions to regulator equations for each follower and a critic–actor structure is employed to solve the optimal feedback control problem using the measured data based on the neural network (NN) and RL. It is shown that using the estimate values, the tracking errors are uniformly ultimately bounded. A simulation example is given to show the effectiveness of the proposed method.

The Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems by the Adaptive Distributed Observer

The adaptive distributed observer approach to the cooperative output regulation of linear multi-agent systems

Cooperative Output Regulation for Networked Multi-Agent Systems Based on the Self-Tuning Adaptive Distributed Observer

Distributed output regulation for a class of nonlinear multi-agent systems via controller network

Cooperative Adaptive Optimal Output Regulation of Nonlinear Discrete-Time Multi-Agent Systems

Observer-based Output Regulation of Cooperative-Competitive High-Order Multi-Agent Systems

Cooperative Output Regulation of Heterogeneous Linear Multi-Agent Systems by the Finite-Time Distributed Observer.

Model-Free Cooperative Optimal Output Regulation for Linear Discrete-Time Multi-Agent Systems Using Reinforcement Learning

Output Regulation of a Class of Switched Linear Multi-Agent Systems: a Distributed Observer Approach

Cooperative Adaptive H ∞ Output Regulation of Continuous-Time Heterogeneous Multi-Agent Markov Jump Systems

Sampled-Data Cooperative Output Regulation: an Adaptive Distributed Continuous-Discrete Observer Approach

Robust Cooperative Output Regulation of Uncertain Linear Multi-Agent Systems Not Detectable by Regulated Output

Cooperative output regulation for a group of nonlinear systems with limited information exchange: A distributed observer approach.

Robust Cooperative Output Regulation of Heterogeneous Uncertain Linear Multiagent Systems with Time-Varying Communication Topologies

Fully Distributed Adaptive Controllers for Cooperative Output Regulation of Heterogeneous Linear Multi-agent Systems with Directed Graphs

Distributed Adaptive Output Feedback Control for Multiagent Systems with Unknown Dynamics

Data-Driven Cooperative Output Regulation of Linear Discrete-Time Multiagent Systems With Unknown Dynamics

Hybrid Cooperative Output Regulation of Linear Multi-Agent Systems

Adaptive Observer-Based Output Regulation of Multiagent Systems With Communication Constraints

Cooperative Output Regulation of Heterogeneous Linear Multi-Agent Systems: A Distributed Output Feedback Control Approach

Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems with Markov Switching Topologies