Abstract:In this paper, the receding horizon near-optimal tracking control problem about a class of continuous-time nonlinear systems with fully unknown dynamics is considered. The main challenges of this problem lie in two aspects: 1) most existing systems only restrict their considerations to the state feedback part while the input channel parameters are assumed to be known. This paper considers fully unknown system dynamics in both the state feedback channel and the input channel and 2) the optimal control of nonlinear systems requires the solution of nonlinear Hamilton-Jacobi-Bellman equations. Up to date, there are no systematic approaches in the existing literature to solve it accurately. A novel model-free adaptive near-optimal control method is proposed to solve this problem via utilizing the Taylor expansion-based problem relaxation, the universal approximation property of sigmoid neural networks, and the concept of sliding mode control. By making approximation for the performance index, it is first relaxed to a quadratic program, and then, a linear algebraic equation with unknown terms. An auxiliary system is designed to reconstruct the input-to-output property of the control systems with unknown dynamics, so as to tackle the difficulty caused by the unknown terms. Then, by considering the property of the sliding-mode surface, an explicit adaptive near-optimal control law is derived from the linear algebraic equation. Theoretical analysis shows that the auxiliary system is convergent, the resultant closed-loop system is asymptotically stable, and the performance index asymptomatically converges to optimal. An illustrative example and experimental results are presented, which substantiate the efficacy of the proposed method and verify the theoretical results.

Optimal trajectory tracking controller design: Model based to model free methods

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Adaptive optimal trajectory tracking control of non-affine nonlinear system

Non-Affine Nonlinear Systems Adaptive Optimal Trajectory Tracking Controller Design and Application

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Adaptive Trajectory Tracking for Linear Delay Systems with Application to Rotary Motors

State Feedback Trajectory Tracking Control of Nonlinear Affine in Control System with Unknown Internal Dynamics and Disturbances

Trajectory Tracking of Robot Based on Adaptive Theory

Intelligent Proportional Trajectory Tracking Controllers: Using Ultra-Local Model And Time Delay Estimation Techniques

Optimal Trajectory Tracking Control for Input Constrained Hysteresis Nonlinear Systems Based on ADP*

Adaptive Output Trajectory Tracking Control for a Class of Affine Nonlinear Discrete-Time Systems

Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems

Model-Free H∞ Optimal Tracking Control of Constrained Nonlinear Systems Via an Iterative Adaptive Learning Algorithm

Approximate Design of Optimal Tracking Controller for Systems with Delayed State and Control

Intelligent Hybrid Control Strategy for Trajectory Tracking of Robot Manipulators

Optimal Tracking Control For A Class Of Continuous Time Complex-Valued Systems Based On Adaptive Dynamic Programming Algorithm

A Robust Optimal Trajectory Tracking Control for Systems with an Input Delay

Online Optimal Tracking Control of Continuous-Time Linear Systems with Unknown Dynamics by Using Adaptive Dynamic Programming

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

Design of a trajectory tracking controller for uncertain nonlinear systems via the model-deviation compensation strategy

New Approach of Tracking Control for a Class of Non-Minimum Phase Linear Systems