Abstract:In this paper an online single artificial neural network adaptive critic algorithm is proposed to address the constrained robust control problem of a nonlinear system subject to full state constraints, input saturation and mismatched disturbance. Firstly, the constrained robust control problem of the original system is transformed into an equivalent optimal control problem of an auxiliary system based on a constructive utility function and a pseudo control. Secondly, nonquadratic risk-aware penalty functions are incorporated into the constructive utility function to deal with constraints in terms of both system states and control inputs. Finally, a single artificial neural network adaptive critic learning architecture is adopted to get an approximation solution to the nonlinear Hamilton Jacobi Bellman equation, which in turn results in a constraint satisfying state feedback controller. With benefit of the concurrent learning technique, both current data and history data contribute to the weight estimation update law of the critic artificial neural network, the proposed weight estimation update law guarantees convergence of the critic artificial neural network weights to desired values without incorporating external signals to satisfy the persistence of excitation condition. The equivalence proof provided shows that the optimal solution of the auxiliary system can also robustly stabilize the original system without violating state constraints and input constraints. The system stability and weight convergence are proved. Simulation results reveal validity of the proposed single artificial neural network adaptive critic learning architecture.

Robust Adaptive Critic Control Design with Network-Based Event-Triggered Formulation

Event-triggered Robust Adaptive Control for Discrete Time Uncertain Systems with Unmodelled Dynamics and Disturbances

Adaptive Critic Designs for Event-Triggered Robust Control of Nonlinear Systems with Unknown Dynamics

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Event-Triggered Robust Stabilization of Nonlinear Input-Constrained Systems Using Single Network Adaptive Critic Designs

Event-trigger-based Robust Control for Nonlinear Constrained-Input Systems Using Reinforcement Learning Method

Online Event-Triggered Adaptive Critic Design for Multi-Player Zero-Sum Games of Partially Unknown Nonlinear Systems with Input Constraints

Event-triggered optimal control with finite-time convergence critic networks for input-constrained nonlinear systems

Event-Based Constrained Robust Control of Affine Systems Incorporating an Adaptive Critic Mechanism

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Online Single Artificial Neural Network Adaptive Critic Learning under Additive Disturbance, State Constraints and Input Saturation

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

An Adaptive Critic Approach to Event‐triggered Robust Control of Nonlinear Systems with Unmatched Uncertainties

Robust Optimal Control Scheme for Unknown Constrained-Input Nonlinear Systems Via a Plug-n-Play Event-Sampled Critic-Only Algorithm

Model-free Nonlinear Robust Control Design Via Online Critic Learning.

Event-triggered Receding Horizon Control Via Actor-Critic Design

Adaptive Critic Design Based Robust Neural Network Control for a Class of Continuous-Time Nonaffine Nonlinear System

Adaptive critic design-based robust neural network control for nonlinear distributed parameter systems with unknown dynamics.

Online Event-Triggered Adaptive Critic Design for Non-Zero-sum Games of Partially Unknown Networked Systems

Dynamic Event-Triggered Finite-Horizon Robust Suboptimal Control of Multi-Player Systems with Input Disturbances

Event-Based Robust Control for Uncertain Nonlinear Systems Using Adaptive Dynamic Programming