Abstract:A novel adaptive critic design (ACD) based robust neural network (NN) controller is proposed for a class of continuous-time nonaffine nonlinear system in this paper. Although studies about ACD-based NN controller have been made on nonlinear systems, little is known about the more complicate nonaffine nonlinear systems. Because the nonlinear functions of nonaffine nonlinear systems are implicit functions with respect to the control, existing ACD methods can not been applied directly. Instead of approximating the nonaffine nonlinear function, we proposed that an action NN is employed to approximate the derived unknown uncertain term. Additionally, a robust term is developed to attenuate the NN reconstruction errors. Moreover, novel tuning laws for the weights of action NN and critic NN and the adaptive parameter are derived to guarantee the uniformly ultimate boundedness of all signals of the closed-loop system by Lyapunov method. By developing a novel Lyapunov function candidate and using adaptive bounding technique, no a prior knowledge of bounds of the time derivative of the control effectiveness term, the NN ideal weights of action NN and critic NN and the reconstruction errors is required. Simulation results demonstrate the effectiveness of the approach.

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Reinforcement-Learning-Based Controller Design for Nonaffine Nonlinear Systems.

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Adaptive Critic Design Based Robust Neural Network Control for a Class of Continuous-Time Nonaffine Nonlinear System

Neural-network-based Reinforcement Learning Controller for Nonlinear Systems with Non-Symmetric Dead-Zone Inputs

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Discrete-time Online Learning Control for a Class of Unknown Nonaffine Nonlinear Systems Using Reinforcement Learning.

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Online Adaptive Controller Design Of Partially Unknown Nonlinear Systems With State Time-Delay Via Actor-Critic Architecture

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Online Optimal Control of Robotic Systems with Single Critic NN-Based Reinforcement Learning.

Adaptive Neural Network Control of Robot Manipulator Using Reinforcement Learning

Observer-Based Adaptive Output Feedback Control for Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement Learning.

Reinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique

Neural-Network-Based Online Optimal Control for Uncertain Non-Linear Continuous-Time Systems with Control Constraints

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Output Feedback Adaptive Optimal Control of Affine Nonlinear systems with a Linear Measurement Model