Abstract:Implementing human-like learning and control for nonlinear dynamical systems operating in different control situations is an important and challenging issue. This paper presents a pattern-based neural network (NN) control strategy for nonlinear pure-feedback systems via deterministic learning (DL). Firstly, an appropriately designed adaptive neural dynamic surface controller is proposed to achieve the finite time tracking control. By analyzing the recurrent property of NN input signals, a partial persistent excitation (PE) condition for radial basis function (RBF) network is established, the implicit desired control dynamics under different control situations are accurately identified via DL in the case that the dimension of NN input is reduced. And a set of pattern-based experienced actual and virtual controllers is constructed using the learned knowledge. Secondly, to classify different control situations, when the system is operating in different control situations but controlled by current normal experienced controller, the dynamics of each subsystem are accurately identified via DL, n sets of dynamical estimators are constructed using the learned knowledge. Thirdly, in the recognition phase, n sets of residuals are achieved by comparing each set of estimators with the monitored system, sudden change in the control situation is rapidly recognized based on the principle of the earliest occurrence of the minimum residual. Finally, in the control phase, according to the recognition result, the correct experienced actual and virtual controllers will be selected to control the plant, guaranteed stability and superior control performance are achieved without any further re-adaptation online. Simulation studies are given to verify the proposed scheme can not only acquire and memorize knowledge like humans, but also reuse the learned knowledge to achieve rapid recognition and control of current control situation.

Reinforcement Learning Control for Nonlinear Systems Based on Elman Neural Network

Reinforcement Learning Method For Continuous State Space Based On Dynamic Neural Network

Nonlinear Predictive Control With Error Compensation Based On Neural Network

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Reinforcement-Learning-Based Controller Design for Nonaffine Nonlinear Systems.

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Q-Learning-Based Model Predictive Control for Nonlinear Continuous-Time Systems

Discrete-time Online Learning Control for a Class of Unknown Nonaffine Nonlinear Systems Using Reinforcement Learning.

An Adaptive Neuron Predictive Control Based on Elman Networks for Nonlinear System

Nonlinear Stable Adaptive Control Based Upon Elman Networks

Adaptive output feedback reinforcement learning control for continuous time switched stochastic nonlinear systems with unknown control coefficients and full-state constraints

Event-Triggered Data-Driven Control of Nonlinear Systems Via $Q$ -Learning

Q-Learning for Continuous State Space Based on a Support Vector Machine

Optimal Control for Continuous-Time Unknown Nonlinear Affine Systems: A $\Mathcal{q}$-Learning Approach

Reinforcement Learning-Based Nonlinear Tracking Control System Design Via LDI Approach with Application to Trolley System

Adaptive Q-Learning Based Model-Free $h_{\infty }$ Control of Continuous-Time Nonlinear Systems: Theory and Application

Pattern-based NN Control for Uncertain Pure-Feedback Nonlinear Systems.

Dynamic Learning from Adaptive Neural Network Control of a Class of Nonaffine Nonlinear Systems