Abstract:Unlike existing results on output tracking control in multi-agent systems, which mainly focus on the relative state among agents, in some cases the state of the system may not be available or measurable. In this paper, we investigate the model-free learning-based distributed optimal tracking control for heterogeneous multi-agent systems with dynamic output feedback under a switching reinforcement learning algorithm. First, a relative output-based distributed observer is developed without exchanging state information, which can significantly reduce the interaction load and broaden the range of applications. Then, a distributed feedback-feedforward controller is proposed, where the optimal feedback and feedforward gain matrices can be learned online by solving two optimization problems, employing policy iteration-based reinforcement learning instead of relying on the leader's state as in existing studies. Subsequently, the policy iteration algorithm (PI) is modified into the value iteration (VI) learning algorithm, which can relax the requirement for an initial stabilizing control policy and does not depend on the known dynamical model. Additionally, a switching reinforcement learning algorithm is put forward by fully integrating the merits of the previously mentioned methods. The new algorithm not only overcomes the initial stabilizing assumption, but also ensures the convergence of the algorithm in a model-free fashion. Finally, a simulation example is provided to illustrate the theoretical analysis.

Distributed Output Optimization for Discrete-time Linear Multi-agent Systems

Distributed output regulation for a class of nonlinear multi-agent systems via controller network

Distributed Optimization for a Class of High-order Nonlinear Multi-agent Systems with Unknown Dynamics

Distributed Optimization for Multiple Linear Systems with Bounded Inputs

Distributed Optimization of Nonlinear Multi-Agent Systems: A Small-Gain Approach

Distributed Optimization for Linear Multiagent Systems: Edge- and Node-Based Adaptive Designs

Distributed Optimization for Uncertain Nonlinear Interconnected Multi-Agent Systems

A game theoretical formulation for distributed optimization problems

Distributed optimization of general linear multi-agent systems with external disturbance

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

Output feedback distributed optimization algorithms of higher‐order uncertain nonlinear multi‐agent systems

Distributed Adaptive Output Regulation Controllers of Heterogeneous Linear Multi-Agent Systems with Directed Graphs

Predefined-time Distributed Optimization of General Linear Multi-Agent Systems

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Exponential convergence of distributed optimization for heterogeneous linear multi-agent systems

Dual Optimization-Based Distributed Tracking Control under Completely Unknown Dynamics

A Modified Distributed Optimization Method for Both Continuous-Time and Discrete-Time Multi-Agent Systems.

Distributed Finite-Time Optimization of Second-Order Multiagent Systems with Unknown Velocities and Disturbances

Distributed Optimization for Multiply High-Order Nonlinear Local Cost Functions

Exponential Convergence of Distributed Optimization for Heterogeneous Linear Multi-Agent Systems over Unbalanced Digraphs

Distributed Convex Optimization of Discrete-Time Multi-Agent Systems: a New Model