Abstract:This paper addresses the optimized leader-follower consensus control problem of nonlinear canonical dynamic multi-agent system (MAS). Since every agent is modeled in high-order dynamic, they contain the various state variables having derivative relations. Consequently, to attain the optimized consensus control, backstepping technique and reinforcement learning (RL) are combined together. In the first backstepping step, the virtual control is formulated to have the consensus error term consisting of neighbor agents' output states. In the last backstepping step, since the nonlinearity dynamic is arisen, the optimized actual control is derived by performing the critic-actor RL. It is worth mentioning that, in the traditional RL optimal control, the critic and actor updating laws are obtained by performing the gradient descent algorithm to square of the approximated Hamilton–Jacobi-Bellman (HJB) equation, which includes many nonlinearity items, as a result, the algorithm is very intricate. However, in this optimized consensus control, since the RL training laws are yielded in the light of negative gradient of a simple positive function that is relevant to the HJB equation, its algorithm is very simple. At the same time, it can also avoid the persistence excitation conditions. Finally, theory and simulation confirm the validity of this optimized consensus method.

Intermittent Event-Triggered Optimal Leader-Following Consensus for Nonlinear Multi-Agent Systems via Actor-Critic Algorithm

Aperiodically Intermittent Event-Triggered Optimal Average Consensus for Nonlinear Multi-Agent Systems

Event-Triggered Leader-Following Consensus for Nonlinear Multiagent Systems Subject to Actuator Saturation Using Dynamic Output Feedback Method

Adaptive Consensus Control of Linear Multiagent Systems with Dynamic Event-Triggered Strategies

RL-Based Adaptive Optimal Bipartite Consensus Control for Nonlinear Heterogeneous MASs Via Event-Triggered State Feedback

Optimal Distributed Leader-Following Consensus of Linear Multi-Agent Systems: A Dynamic Average Consensus-Based Approach

Model‐based Event‐triggered Leaderless Consensus Control for Nonlinear Pure‐feedback Multi‐agent Systems

Observer-based Reinforcement Learning for Optimal Fault-Tolerant Consensus Control of Nonlinear Multi-Agent Systems Via a Dynamic Event-Triggered Mechanism

Optimized adaptive consensus control for multi-agent systems with prescribed performance

Observer-Based Dynamic Event-Triggered Strategies for Leader-Following Consensus of Multi-Agent Systems with Disturbances

Distributed Control of Heterogeneous Linear Multi-Agent Systems by Intermittent Event-Triggered Control

Optimal Consensus Control for Continuous-Time Linear Multiagent Systems: A Dynamic Event-Triggered Approach.

Adaptive Impulsive Consensus of Nonlinear Multi-Agent Systems Via a Distributed Self-Triggered Strategy

Guaranteed-performance Consensus Control for Multi-Agent Systems with External Disturbances Via Event-Triggered Strategy

Dynamic Event-Triggered Reinforcement Learning-Based Consensus Tracking of Nonlinear Multi-Agent Systems

Designing Adaptive Continuous Event-Triggered Consensus Protocol for Nonlinear Multi-Agent Systems with a Nonautonomous Leader

Event-based Leader-Following Consensus for Uncertain Non-Linear Multiagent Systems

Leader-follower consensus control for linear multi-agent systems by fully distributed edge-event-triggered adaptive strategies

Optimized leader-follower consensus control for high-order nonlinear multi-agent system modeled in canonical dynamic form

Reinforcement learning-based consensus control for MASs with intermittent constraints

Model-Free Distributed Consensus Control Based on Actor–Critic Framework for Discrete-Time Nonlinear Multiagent Systems