Abstract:Developing a distributed bipartite optimal consensus scheme while ensuring user-predefined performance is essential in practical applications. Existing approaches to this problem typically require a complex controller structure due to adopting an identifier-actor-critic framework and prescribed performance cannot be guaranteed. In this work, an adaptive critic learning (ACL)-based optimal bipartite consensus scheme is developed to bridge the gap. A newly designed error scaling function, which defines the user-predefined settling time and steady accuracy without relying on the initial conditions, is then integrated into a cost function. The backstepping framework combines the ACL and integral reinforcement learning (IRL) algorithm to develop the adaptive optimal bipartite consensus scheme, which contributes a critic-only controller structure by removing the identifier and actor networks in the existing methods. The adaptive law of the critic network is derived by the gradient descent algorithm and experience replay to minimize the IRL-based residual error. It is shown that a compute-saving learning mechanism can achieve the optimal consensus, and the error variables of the closed-loop system are uniformly ultimately bounded (UUB). Besides, in any bounded initial condition, the evolution of bipartite consensus is limited to a user-prescribed boundary under bounded initial conditions. The illustrative simulation results validate the efficacy of the approach.

A Novel Optimal Bipartite Consensus Control Scheme for Unknown Multi-Agent Systems Via Model-Free Reinforcement Learning.

Data-Driven Optimal Bipartite Consensus Control for Second-Order Multiagent Systems via Policy Gradient Reinforcement Learning

Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

Optimal consensus control for unknown second-order multi-agent systems: Using model-free reinforcement learning method

Inverse optimal stabilization of cooperative control in networked multi-agent systems

Observer-Based Consensus Control for MASs With Prescribed Constraints via Reinforcement Learning Algorithm

Distributed Model Predictive Control for Optimal Consensus of Constrained Multi-Agent Systems

Learning-Based Robust Bipartite Consensus Control for a Class of Multiagent Systems

Data-Based Optimal Consensus Control for Multiagent Systems With Policy Gradient Reinforcement Learning

Optimal Leader-Following Consensus Control of Multi-Agent Systems: A Neural Network Based Graphical Game Approach

Optimized backstepping consensus control using adaptive observer-critic-actor reinforcement learning for strict-feedback multi-agent systems

Online optimal consensus control of unknown linear multi-agent systems via time-based adaptive dynamic programming

Finite-Time Asymmetric Bipartite Consensus for Multi-Agent Systems Using Data-Driven Iterative Learning Control

Adaptive Critic Learning-Based Optimal Bipartite Consensus for Multiagent Systems With Prescribed Performance

Distributed Optimal Consensus Control of Constrained Multiagent Systems: A Nonseparable Optimization Perspective

Data-driven output consensus for a class of discrete-time multiagent systems by reinforcement learning techniques

Distributed Optimal Consensus Control of Constrained Multi-Agent Systems: A Non-Separable Optimization Perspective

Adaptive scaled consensus control of coopetition networks with high-order agent dynamics

Observer-Based Adaptive Neural Inverse Optimal Consensus Control of Nonlinear Multiagent Systems

Reinforcement learning-based consensus control for MASs with intermittent constraints

Data‐based distributed consensus optimal control for nonlinear multi‐agent systems under switching topology