Abstract:In this paper, the receding horizon near-optimal tracking control problem about a class of continuous-time nonlinear systems with fully unknown dynamics is considered. The main challenges of this problem lie in two aspects: 1) most existing systems only restrict their considerations to the state feedback part while the input channel parameters are assumed to be known. This paper considers fully unknown system dynamics in both the state feedback channel and the input channel and 2) the optimal control of nonlinear systems requires the solution of nonlinear Hamilton-Jacobi-Bellman equations. Up to date, there are no systematic approaches in the existing literature to solve it accurately. A novel model-free adaptive near-optimal control method is proposed to solve this problem via utilizing the Taylor expansion-based problem relaxation, the universal approximation property of sigmoid neural networks, and the concept of sliding mode control. By making approximation for the performance index, it is first relaxed to a quadratic program, and then, a linear algebraic equation with unknown terms. An auxiliary system is designed to reconstruct the input-to-output property of the control systems with unknown dynamics, so as to tackle the difficulty caused by the unknown terms. Then, by considering the property of the sliding-mode surface, an explicit adaptive near-optimal control law is derived from the linear algebraic equation. Theoretical analysis shows that the auxiliary system is convergent, the resultant closed-loop system is asymptotically stable, and the performance index asymptomatically converges to optimal. An illustrative example and experimental results are presented, which substantiate the efficacy of the proposed method and verify the theoretical results.

Near-Optimal Tracking Control of Partially Unknown Discrete-Time Nonlinear Systems Based on Radial Basis Function Neural Network

Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems.

Adaptive Identifier-Critic-Based Optimal Tracking Control for Nonlinear Systems with Experimental Validation

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Single‐network ADP for solving optimal event‐triggered tracking control problem of completely unknown nonlinear systems

Approximate optimal tracking control for continuous-time unknown nonlinear systems

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Adaptive Neural Dynamic Surface Control With Prespecified Tracking Accuracy of Uncertain Stochastic Nonstrict-Feedback Systems

Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems

Adaptive H∞ Tracking Control for a Class of Uncertain Nonlinear Systems Using Radial-Basis-function Neural Networks

Data-Based Optimal Tracking Control of Nonaffine Nonlinear Discrete-Time Systems.

Backstepping Based Neural H∞ Optimal Tracking Control for Nonlinear State Constrained Systems with Input Delay and Disturbances

Optimal prescribed performance tracking control of nonlinear motor driven systems via adaptive dynamic programming

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

Adaptive Direct RBFNN Consensus Control for a Class of Unknown Nonlinear Underactuated Systems

Observer-based Adaptive Neural Tracking Control for a Class of Stochastic Nonlinear Systems

Adaptive Tracking Control for a Class of Continuous-Time Uncertain Nonlinear Systems Using the Approximate Solution of HJB Equation.

Optimal Finite-Time Tracking Control for a Class of Unknown Nonlinear System Based on Input-Output Data