Abstract:This study focuses on state-feedback and output-feedback neural learning control problems for discrete-time nonlinear systems in the pure-feedback form. First, an extended result for the exponential stability for a class of discrete-time linear time-varying (LTV) systems with n-step delays is proposed to verify the exponential convergence of estimated weights. Subsequently, both state-feedback and output-feedback adaptive neural network (NN) controllers are constructed by combining the classical n-step and n-step input-output predictors. After ensuring convergence of the system output to a recurrent reference signal, the radial basis function subvector of NN is verified to satisfy the persistent exciting condition using the system state equation and the implicit function theorem. By combining the extended stability corollary of an LTV system, the estimated weights are verified to exponentially converge to their optimal values. By constructing "learning rules" and using a "mod" function, the estimated weights with a convergent sequence are synthetically represented and stored as the experience knowledge, which is reused to construct neural learning controllers. The proposed neural learning controllers not only accomplish similar control tasks but also reduce the burden of online computation compared with the conventional adaptive NN controllers. Finally, simulation results are presented to demonstrate the effectiveness of the presented schemes.

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Reinforcement-Learning-Based Controller Design for Nonaffine Nonlinear Systems.

Dynamic Learning from Adaptive Neural Network Control of a Class of Nonaffine Nonlinear Systems

Discrete-time Online Learning Control for a Class of Unknown Nonaffine Nonlinear Systems Using Reinforcement Learning.

Neural Learning Control for Discrete-Time Nonlinear Systems in Pure-Feedback Form

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Adaptive Neural Network Control for A Class of Nonaffine Discrete-Time Systems

Observer-Based Adaptive Output Feedback Control for Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement Learning.

Feedback-Linearization-Based Neural Adaptive Control for Unknown Nonaffine Nonlinear Discrete-Time Systems

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Recurrent-Neural-Network-Based Multivariable Adaptive Control for a Class of Nonlinear Dynamic Systems With Time-Varying Delay

Neural Adaptive Output-Feedback Control of Non-affine Nonlinear Systems with Unknown Control Direction

Adaptive fuzzy-neural tracking control for uncertain nonlinear discrete-time systems in the NARMAX form