Abstract:In this paper an online single artificial neural network adaptive critic algorithm is proposed to address the constrained robust control problem of a nonlinear system subject to full state constraints, input saturation and mismatched disturbance. Firstly, the constrained robust control problem of the original system is transformed into an equivalent optimal control problem of an auxiliary system based on a constructive utility function and a pseudo control. Secondly, nonquadratic risk-aware penalty functions are incorporated into the constructive utility function to deal with constraints in terms of both system states and control inputs. Finally, a single artificial neural network adaptive critic learning architecture is adopted to get an approximation solution to the nonlinear Hamilton Jacobi Bellman equation, which in turn results in a constraint satisfying state feedback controller. With benefit of the concurrent learning technique, both current data and history data contribute to the weight estimation update law of the critic artificial neural network, the proposed weight estimation update law guarantees convergence of the critic artificial neural network weights to desired values without incorporating external signals to satisfy the persistence of excitation condition. The equivalence proof provided shows that the optimal solution of the auxiliary system can also robustly stabilize the original system without violating state constraints and input constraints. The system stability and weight convergence are proved. Simulation results reveal validity of the proposed single artificial neural network adaptive critic learning architecture.

Online Single Artificial Neural Network Adaptive Critic Learning under Additive Disturbance, State Constraints and Input Saturation

Robust Adaptive Control of Uncertain Nonlinear Systems in the Presence of Input Saturation and External Disturbance.

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Neural Network Control of Nonlinear Systems Based on Adaptive Critic

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Event-triggered optimal control with finite-time convergence critic networks for input-constrained nonlinear systems

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Adaptive single neural network control for a class of uncertain discrete-time nonlinear strict-feedback systems with input saturation

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Intelligent Optimal Control With Critic Learning for a Nonlinear Overhead Crane System

Hierarchical Sliding-Mode Surface-Based Adaptive Actor–Critic Optimal Control for Switched Nonlinear Systems With Unknown Perturbation

Inverse Optimal Adaptive Neural Control for State-Constrained Nonlinear Systems

Adaptive optimized consensus control for a class of nonlinear multi-agent systems with asymmetric input saturation constraints and hybrid faults

Robust Actor-Critic Learning for Continuous-Time Nonlinear Systems with Unmodeled Dynamics