Abstract:In this paper an online single artificial neural network adaptive critic algorithm is proposed to address the constrained robust control problem of a nonlinear system subject to full state constraints, input saturation and mismatched disturbance. Firstly, the constrained robust control problem of the original system is transformed into an equivalent optimal control problem of an auxiliary system based on a constructive utility function and a pseudo control. Secondly, nonquadratic risk-aware penalty functions are incorporated into the constructive utility function to deal with constraints in terms of both system states and control inputs. Finally, a single artificial neural network adaptive critic learning architecture is adopted to get an approximation solution to the nonlinear Hamilton Jacobi Bellman equation, which in turn results in a constraint satisfying state feedback controller. With benefit of the concurrent learning technique, both current data and history data contribute to the weight estimation update law of the critic artificial neural network, the proposed weight estimation update law guarantees convergence of the critic artificial neural network weights to desired values without incorporating external signals to satisfy the persistence of excitation condition. The equivalence proof provided shows that the optimal solution of the auxiliary system can also robustly stabilize the original system without violating state constraints and input constraints. The system stability and weight convergence are proved. Simulation results reveal validity of the proposed single artificial neural network adaptive critic learning architecture.

Model-free Nonlinear Robust Control Design Via Online Critic Learning.

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Online Adaptive Critic Robust Control of Discrete-Time Nonlinear Systems with Unknown Dynamics

Robust Actor-Critic Learning for Continuous-Time Nonlinear Systems with Unmodeled Dynamics

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Robust Optimal Control Scheme for Unknown Constrained-Input Nonlinear Systems Via a Plug-n-Play Event-Sampled Critic-Only Algorithm

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Online Single Artificial Neural Network Adaptive Critic Learning under Additive Disturbance, State Constraints and Input Saturation

Adaptive critic design-based robust neural network control for nonlinear distributed parameter systems with unknown dynamics.

Robust Adaptive Critic Control Design with Network-Based Event-Triggered Formulation

Online Adaptive Controller Design Of Partially Unknown Nonlinear Systems With State Time-Delay Via Actor-Critic Architecture

Adaptive Critic Designs for Event-Triggered Robust Control of Nonlinear Systems with Unknown Dynamics

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Online Adaptive Critic Learning Control of Unknown Dynamics with Application to Deep Submergence Rescue Vehicle

Output-Feedback Robust Control of Uncertain Systems Via Online Data-Driven Learning

Online actor‐critic learning control with self‐triggered mechanism for nonlinear regulation problems

Adaptive Critic Design Based Robust Neural Network Control for a Class of Continuous-Time Nonaffine Nonlinear System