Abstract:Learning plays an essential role in autonomous control systems. However, how to achieve learning in the nonstationary environment for nonlinear systems is a challenging problem. In this paper, we present learning method for a class of n th-order strict-feedback systems by adaptive dynamic surface control (DSC) technology, which achieves the human-like ability of learning by doing and doing with learned knowledge. To achieve the learning, this paper first proposes stable adaptive DSC with auxiliary first-order filters, which ensures the boundedness of all the signals in the closed-loop system and the convergence of tracking errors in a finite time. With the help of DSC, the derivative of the filter output variable is used as the neural network (NN) input instead of traditional intermediate variables. As a result, the proposed adaptive DSC method reduces greatly the dimension of NN inputs, especially for high-order systems. After the stable DSC design, we decompose the stable closed-loop system into a series of linear time-varying perturbed subsystems. Using a recursive design, the recurrent property of NN input variables is easily verified since the complexity is overcome using DSC. Subsequently, the partial persistent excitation condition of the radial basis function NN is satisfied. By combining a state transformation, accurate approximations of the closed-loop system dynamics are recursively achieved in a local region along recurrent orbits. Then, the learning control method using the learned knowledge is proposed to achieve the closed-loop stability and the improved control performance. Simulation studies are performed to demonstrate the proposed scheme can not only reuse the learned knowledge to achieve the better control performance with the faster tracking convergence rate and the smaller tracking error but also greatly alleviate the computational burden because of reducing the number and complexity of NN input variables.

Deterministic learning-based neural control for output-constrained strict-feedback nonlinear systems

Dynamic Learning from Adaptive Neural Control for Full-State Constrained Strict-Feedback Nonlinear Systems

Deterministic Learning from Neural Control for Uncertain Nonlinear Pure‐feedback Systems by Output Feedback

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Deterministic learning and neural control of a class of nonlinear systems toward improved performance

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Neuro-learning-based adaptive control for state-constrained strict-feedback systems with unknown control direction

NN-based asymptotic tracking control for a class of strict-feedback uncertain nonlinear systems with output constraints

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Learning from adaptive neural control with predefined performance for a class of nonlinear systems

Adaptive Neural Control and Learning of Affine Nonlinear Systems

Identification and Learning Control of Strict-Feedback Systems Using Adaptive Neural Dynamic Surface Control

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Dynamic learning from adaptive neural control with predefined performance for a class of nonlinear systems

Dynamic Learning from Adaptive Neural Network Control of a Class of Nonaffine Nonlinear Systems

Learning from Neural Control of Strict-feedback Systems

Adaptive NN Controller of Nonlinear State-Dependent Constrained Systems With Unknown Control Direction

Learning from Adaptive Neural Dynamic Surface Control of Strict-Feedback Systems

Learning from neural control for a class of discrete-time nonlinear systems

Deterministic Learning from NN Output Feedback Control of Brunovsky Systems

Adaptive Neural Control of Nonlinear Nonstrict Feedback Systems With Full-State Constraints: A Novel Nonlinear Mapping Method