Abstract:This paper focuses on the optimal output synchronization control problem of heterogeneous multiagent systems (HMASs) subject to nonidentical communication delays by a reinforcement learning method. Compared with existing studies assuming that the precise model of the leader is globally or distributively accessible to all or some of the followers, the leader's precise dynamical model is entirely inaccessible to all the followers in this paper. A data-based learning algorithm is first proposed to reconstruct the leader's unknown system matrix online. A distributed predictor subject to communication delays is further devised to estimate the leader's state, where interaction delays are allowed to be nonidentical. Then, a learning-based local controller, together with a discounted performance function, is projected to reach the optimal output synchronization. Bellman equations and game algebraic Riccati equations are constructed to learn the optimal solution by developing a model-based reinforcement learning (RL) algorithm online without solving regulator equations, which is followed by a model-free off-policy RL algorithm to relax the requirement of all agents' dynamics faced by the model-based RL algorithm. The optimal tracking control of HMASs subject to unknown leader dynamics and communication delays is shown to be solvable under the proposed RL algorithms. Finally, the effectiveness of theoretical analysis is verified by numerical simulations.

Cooperative model predictive control for ship formation tracking with communication delays

Cooperative Learning Formation Control of Multiple Autonomous Underwater Vehicles with Prescribed Performance Based on Position Estimation

Low-complexity Formation Control of Marine Vehicle System Based on Prescribed Performance

Distributed Model Predictive Control for Vehicle Platoon With Mixed Disturbances and Model Uncertainties

MPC-Based Collaborative Control of Sail and Rudder for Unmanned Sailboat

Cooperative Control of Leader–follower Ships with Prescribed Performance

Reinforcement Learning-Based Unknown Reference Tracking Control of HMASs with Nonidentical Communication Delays

An Enhanced Trajectory Tracking Control of the Cooperative Ship Formation Based on Leader-Follower Strategy and Fixed Time Disturbance Observer

Decentralized Cooperative Control for Multivehicle Formation Without Velocity Measurement

Coordinated formation pattern control of multiple marine surface vehicles with model uncertainty and time-varying ocean currents

A Consensus-Based Model Predictive Control with Optimized Line-of-Sight Guidance for Formation Trajectory Tracking of Autonomous Underwater Vehicles

Relative Position Controller Design for Spacecraft Formation Flying with Communication Delay

Distributed MPC for Trajectory Tracking and Formation Control of Multi-UAVs With Leader-Follower Structure

Leaderless and Leader-Follower Cooperative Control of Multiple Marine Surface Vehicles with Unknown Dynamics

Robust Distributed Model Predictive Control for Formation Tracking of Nonholonomic Vehicles

Cooperative Anti-disturbance Control for Leader-Follower Ships with Disturbance and Loss-of-Effectiveness Fault

Distributed Model Predictive Contouring Control of Unmanned Surface Vessels

A nonlinear model predictive control method for ship path following in waves

Cooperative Learning-Based Formation Control of Autonomous Marine Surface Vessels with Prescribed Performance

CoNi-MPC: Cooperative Non-inertial Frame Based Model Predictive Control

Double-mode robust model predictive control of ship dynamic positioning system based on event-triggered mechanism