Abstract:In this paper an online single artificial neural network adaptive critic algorithm is proposed to address the constrained robust control problem of a nonlinear system subject to full state constraints, input saturation and mismatched disturbance. Firstly, the constrained robust control problem of the original system is transformed into an equivalent optimal control problem of an auxiliary system based on a constructive utility function and a pseudo control. Secondly, nonquadratic risk-aware penalty functions are incorporated into the constructive utility function to deal with constraints in terms of both system states and control inputs. Finally, a single artificial neural network adaptive critic learning architecture is adopted to get an approximation solution to the nonlinear Hamilton Jacobi Bellman equation, which in turn results in a constraint satisfying state feedback controller. With benefit of the concurrent learning technique, both current data and history data contribute to the weight estimation update law of the critic artificial neural network, the proposed weight estimation update law guarantees convergence of the critic artificial neural network weights to desired values without incorporating external signals to satisfy the persistence of excitation condition. The equivalence proof provided shows that the optimal solution of the auxiliary system can also robustly stabilize the original system without violating state constraints and input constraints. The system stability and weight convergence are proved. Simulation results reveal validity of the proposed single artificial neural network adaptive critic learning architecture.

Online actor‐critic learning control with self‐triggered mechanism for nonlinear regulation problems

Model-free Nonlinear Robust Control Design Via Online Critic Learning.

Robust Actor-Critic Learning for Continuous-Time Nonlinear Systems with Unmodeled Dynamics

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Event-triggered Receding Horizon Control Via Actor-Critic Design

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Optimal H∞ Control of Nonlinear Systems Via Static and Dynamic Triggering Critic Learning

Disturbance Observer Based Actor-Critic Learning Control for Uncertain Nonlinear Systems

Online Adaptive Critic Robust Control of Discrete-Time Nonlinear Systems with Unknown Dynamics

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Online Single Artificial Neural Network Adaptive Critic Learning under Additive Disturbance, State Constraints and Input Saturation

Tracking Control Optimization Scheme of Continuous-Time Nonlinear System Via Online Single Network Adaptive Critic Design Method.

Robust Optimal Control Scheme for Unknown Constrained-Input Nonlinear Systems Via a Plug-n-Play Event-Sampled Critic-Only Algorithm

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Event-triggered Optimal Control of Completely Unknown Nonlinear Systems Via Identifier-Critic Learning

Online Adaptive Controller Design Of Partially Unknown Nonlinear Systems With State Time-Delay Via Actor-Critic Architecture

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Online Event-Triggered Adaptive Critic Design for Multi-Player Zero-Sum Games of Partially Unknown Nonlinear Systems with Input Constraints