Abstract:Highlights • A novel NSDF can achieve the following three points in de-signing adaptive control scheme is proposed to deal with state constraints: (a) feasibility condition is no longer to be required. (b) the cases that with or without state constraints can be covered simultaneously. (c) the steady-state tracking error is not affected by the proposed novel NSDF. • A reinforcement learning based adaptive optimal controller for strict feedback nonlinear systems subject to asymmetric time-varying state constraints is developed. Existing schemes for state-constrained systems either impose feasibility conditions or ignore the optimality. In this article, an adaptive optimal control scheme for the strict-feedback nonlinear system is proposed, which benefits from two design steps. Firstly, a novel nonlinear state-dependent function (NSDF) is formulated to equivalently transform the system into a non-constrained one to deal with state constraints without the requirements on feasibility conditions. Secondly, an adaptive optimal control scheme is designed for the non-constrained system, in which reinforcement learning (RL) is utilized to yield the optimal controller in each designing procedure. Updating rules of the actor and critic neural network are driven by the modified adaptive laws, used to approximate the optimal virtual and actual controllers. It is proved that all the signals in the closed-loop system are bounded and the output tracking error converges to an adjustable neighborhood of the origin not affected by the proposed NSDF. Two simulation examples are presented illustrating the effectiveness of the proposed scheme.

Inverse Optimal Adaptive Neural Control for State-Constrained Nonlinear Systems

Decentralized Adaptive Neural Inverse Optimal Control of Nonlinear Interconnected Systems

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Adaptive Neural Inverse Optimal Control for a Class of Strict Feedback Stochastic Nonlinear Systems

Optimization-based Adaptive Neural Sliding Mode Control for Nonlinear Systems with Fast and Accurate Response under State and Input Constraints

Neural Networks Optimized Learning Control of State Constraints Systems

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems with State Constraints

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

Adaptive Finite-Time Neural Network Control of Nonlinear Systems With Multiple Objective Constraints and Application to Electromechanical System

Adaptive Neural Control of a Class of Pure-Feedback Nonlinear Systems with Full State Constrains

Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems with Full-State Constraints.

A small-gain approach to inverse optimal adaptive control of nonlinear systems with unmodeled dynamics

Neural Network Based Adaptive Inverse Optimal Control for Non-Affine Nonlinear Systems

Adaptive NN Controller of Nonlinear State-Dependent Constrained Systems With Unknown Control Direction

Neural Adaptive Optimal Control of Inequality-Constrained Nonlinear System with Partial Uncertain Time Delay

Inverse Optimal Design of Direct Adaptive Fuzzy Controllers for Uncertain Nonlinear Systems

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

Online Optimal Regulation and Tracking Control of Nonlinear Discrete-Time System with Control Constraints

Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems with Control Constraints