Abstract:In this paper, the receding horizon near-optimal tracking control problem about a class of continuous-time nonlinear systems with fully unknown dynamics is considered. The main challenges of this problem lie in two aspects: 1) most existing systems only restrict their considerations to the state feedback part while the input channel parameters are assumed to be known. This paper considers fully unknown system dynamics in both the state feedback channel and the input channel and 2) the optimal control of nonlinear systems requires the solution of nonlinear Hamilton-Jacobi-Bellman equations. Up to date, there are no systematic approaches in the existing literature to solve it accurately. A novel model-free adaptive near-optimal control method is proposed to solve this problem via utilizing the Taylor expansion-based problem relaxation, the universal approximation property of sigmoid neural networks, and the concept of sliding mode control. By making approximation for the performance index, it is first relaxed to a quadratic program, and then, a linear algebraic equation with unknown terms. An auxiliary system is designed to reconstruct the input-to-output property of the control systems with unknown dynamics, so as to tackle the difficulty caused by the unknown terms. Then, by considering the property of the sliding-mode surface, an explicit adaptive near-optimal control law is derived from the linear algebraic equation. Theoretical analysis shows that the auxiliary system is convergent, the resultant closed-loop system is asymptotically stable, and the performance index asymptomatically converges to optimal. An illustrative example and experimental results are presented, which substantiate the efficacy of the proposed method and verify the theoretical results.

Machine learning model‐based optimal tracking control of nonlinear affine systems with safety constraints

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Lifelong Learning-Based Optimal Trajectory Tracking Control of Constrained Nonlinear Affine Systems Using Deep Neural Networks

Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems

Optimization-based Adaptive Neural Sliding Mode Control for Nonlinear Systems with Fast and Accurate Response under State and Input Constraints

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Safe Learning-Based Feedback Linearization Tracking Control for Nonlinear System with Event-Triggered Model Update

Safety Critical Control Design for Nonlinear System with Tracking and Safety Objectives

Reinforcement Learning-Based Robust Optimal Tracking Control for Disturbed Nonlinear Systems

A Model-Free Resilient Tracking Control Scheme for Non-Affine Nonlinear Continuous Systems with Uncertainties

Adaptive Neural Tracking Control of a Class of Nonlinear Systems

Adaptive Neural Safe Tracking Control Design for a Class of Uncertain Nonlinear Systems with Output Constraints and Disturbances.

Model-free tracking control of complex dynamical trajectories with machine learning

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Dynamic Learning from Adaptive Neural Network Control of a Class of Nonaffine Nonlinear Systems

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics