Abstract:In this paper, we present a novel control method, combining observer-based optimized backstepping (OB) control, reinforcement learning (RL) strategy, and adaptive neural networks (NN), for strict-feedback multi-agent systems with unmeasurable states.The primary objective is to enhance the overall system backstepping controller by optimizing both virtual and actual controllers for corresponding subsystems. To achieve this, we develop an observer-critic-actor RL approach based on NN approximation in all backstepping steps. The observers are utilized to estimate the unmeasurable system states, while the critic-actor algorithm assesses the control performance and executes control actions. Our optimized control method offers advantages such as not requiring the state observer to satisfy the Hurwitz equation. Additionally, our designed RL algorithm is simple due to the critic-actor adaptive laws obtained by means of the negative gradient of a simple positive function associated with the partial derivative of Hamilton–Jacobi-Bellman (HJB) equation. Consequently, our proposed control method ensures that all error states of the multi-agent systems are semi-globally uniformly ultimately bounded (SGUUB), and that all outputs can synchronously follow the reference signal with desired accuracy. Finally, we demonstrate the efficacy of our control strategy by means of theoretical analysis and simulation results.

Observer-Based Optimal Backstepping Security Control for Nonlinear Systems Using Reinforcement Learning Strategy

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Adaptive Resilient Output Feedback Control Against Unknown Deception Attacks for Nonlinear Cyber-Physical Systems

Optimized Adaptive Fuzzy Security Control of Nonlinear Systems with Prescribed Tracking Performance

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Security Control for LPV System With Deception Attacks via Model Predictive Control: A Dynamic Output Feedback Approach

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

Output Feedback Adaptive Inverse OptimalSecurity Control for Stochastic NonlinearCyber-Physical Systems under Sensor andActuator Attacks

Event-triggered adaptive secure tracking control for nonlinear cyber–physical systems against unknown deception attacks

Adaptive Neural Security Control for Networked Singular Systems Under Deception Attacks

Output Feedback Adaptive Inverse Optimal Security Control for Stochastic Nonlinear Cyber-Physical Systems under Sensor and Actuator Attacks

Adaptive Resilient Neural Control of Uncertain Time-Delay Nonlinear CPSs with Full-State Constraints under Deception Attacks

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Resilient Adaptive Intermittent Control of Nonlinear Systems under Deception Attacks

Adaptive ELM-Based Security Control for a Class of Nonlinear-Interconnected Systems with DoS Attacks

Optimized backstepping consensus control using adaptive observer-critic-actor reinforcement learning for strict-feedback multi-agent systems

The Safety Region-Based Model Predictive Control for Discrete-Time Systems under Deception Attacks.