Abstract:The problem of intelligent L 2-L ∞ consensus design for leader-followers multiagent systems (MASs) under switching topologies is investigated based on switched control theory and fuzzy deep Q learning. It is supposed that the communication topologies are time-varying, and the model of MASs under switching topologies is constructed based on switched systems. By employing linear transformation, the problem of consensus of MASs is converted into the issue of L 2-L ∞ control. The consensus protocol is composed of the dynamics-based protocol and learning-based protocol, where the robust control theory and deep Q learning are applied for the two parts to guarantee the prescribed performance and improve the transient performance. The multiple Lyapunov function (MLF) method and mode-dependent average dwell time (MDADT) method are combined to give the scheduling interval, which ensures stability and prescribed attenuation performance. The sufficient existing conditions of consensus protocol are given, and the solutions of the dynamics-based protocol are derived based on linear matrix inequalities (LMIs). Then, the online design of the learning-based protocol is formulated as a Markov decision process, where the fuzzy deep Q learning is utilized to compensate for the uncertainties and achieve optimal performance. The variation of the learning-based protocol is modeled as the external compensation on the dynamics-based protocol. Therefore, the convergence of the proposed protocol can be guaranteed by employing the nonfragile control theory. In the end, a numerical example is given to validate the effectiveness and superiority of the proposed method.

Q -learning algorithm in solving consensusability problem of discrete-time multi-agent systems

Distributed Reduced-Order Observer-Based Approach to Consensus Problems for Linear Multi-Agent Systems

Consensusability and Global Optimality of Discrete-Time Linear Multiagent Systems

Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

Intelligent L 2- L∞ Consensus of Multiagent Systems under Switching Topologies via Fuzzy Deep Q Learning

Efficient off‐policy Q‐learning for multi‐agent systems by solving dual games

$QD$-Learning: A Collaborative Distributed Strategy for Multi-Agent Reinforcement Learning Through Consensus + Innovations

LQR-Based Optimal Leader-Follower Consensus of Second-Order Multi-agent Systems

Finite-Time Asymmetric Bipartite Consensus for Multi-Agent Systems Using Data-Driven Iterative Learning Control

Optimal consensus control for unknown second-order multi-agent systems: Using model-free reinforcement learning method

Reinforcement learning-based consensus control for MASs with intermittent constraints

LQR-based optimal topology of leader-following consensus: LQR-based optimal topology of leader-following consensus

Quantized model-free adaptive iterative learning bipartite consensus tracking for unknown nonlinear multi-agent systems

Iterative Learning Consensus Control for One-Sided Lipschitz Multi-Agent Systems

Iterative learning approach for consensus tracking of partial difference multi-agent systems with control delay under switching topology

Model‐free distributed optimal control for general discrete‐time linear systems using reinforcement learning

Stability Margin of Data-Driven LQR and Its Application to Consensus Problem

Necessary and Sufficient Conditions for Consensusability of Linear Multi-Agent Systems

A leader-following consensus of multi-agent systems with actuator saturation and semi-Markov switching topologies

Linear Quadratic Optimal Consensus of Discrete-Time Multi-Agent Systems with Optimal Steady State: A Distributed Model Predictive Control Approach

Consensus of Fractional-Order Multi -Agent Systems Via LMI Approach