Abstract:In this paper an online single artificial neural network adaptive critic algorithm is proposed to address the constrained robust control problem of a nonlinear system subject to full state constraints, input saturation and mismatched disturbance. Firstly, the constrained robust control problem of the original system is transformed into an equivalent optimal control problem of an auxiliary system based on a constructive utility function and a pseudo control. Secondly, nonquadratic risk-aware penalty functions are incorporated into the constructive utility function to deal with constraints in terms of both system states and control inputs. Finally, a single artificial neural network adaptive critic learning architecture is adopted to get an approximation solution to the nonlinear Hamilton Jacobi Bellman equation, which in turn results in a constraint satisfying state feedback controller. With benefit of the concurrent learning technique, both current data and history data contribute to the weight estimation update law of the critic artificial neural network, the proposed weight estimation update law guarantees convergence of the critic artificial neural network weights to desired values without incorporating external signals to satisfy the persistence of excitation condition. The equivalence proof provided shows that the optimal solution of the auxiliary system can also robustly stabilize the original system without violating state constraints and input constraints. The system stability and weight convergence are proved. Simulation results reveal validity of the proposed single artificial neural network adaptive critic learning architecture.

Neural Network Control of Nonlinear Systems Based on Adaptive Critic

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Adaptive Critic Design Based Robust Neural Network Control for a Class of Continuous-Time Nonaffine Nonlinear System

Neural Network Robust Tracking Control with Adaptive Critic Framework for Uncertain Nonlinear Systems

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Neural-network-based Reinforcement Learning Controller for Nonlinear Systems with Non-Symmetric Dead-Zone Inputs

Adaptive critic design-based robust neural network control for nonlinear distributed parameter systems with unknown dynamics.

Adaptive critic design of nonlinear system with unknown control direction

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Reinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique

Online Single Artificial Neural Network Adaptive Critic Learning under Additive Disturbance, State Constraints and Input Saturation

A Novel Neural Network Discrete‐time Optimal Control Design for Nonlinear Time‐delay Systems Using Adaptive Critic Designs

Event-triggered optimal control with finite-time convergence critic networks for input-constrained nonlinear systems

Robust Adaptive Critic Control Design with Network-Based Event-Triggered Formulation

Adaptive Neural Network Control of Nonlinear Systems with Unmodeled Dynamics

Tracking Control Optimization Scheme of Continuous-Time Nonlinear System Via Online Single Network Adaptive Critic Design Method.

Adaptive Critic Designs for Event-Triggered Robust Control of Nonlinear Systems with Unknown Dynamics

Adaptive near optimal neural control for a class of discrete-time chaotic system

Decentralized Neurocontroller Design with Critic Learning for Nonlinear-Interconnected Systems

Online Adaptive Critic Robust Control of Discrete-Time Nonlinear Systems with Unknown Dynamics