Abstract:In this paper, the receding horizon near-optimal tracking control problem about a class of continuous-time nonlinear systems with fully unknown dynamics is considered. The main challenges of this problem lie in two aspects: 1) most existing systems only restrict their considerations to the state feedback part while the input channel parameters are assumed to be known. This paper considers fully unknown system dynamics in both the state feedback channel and the input channel and 2) the optimal control of nonlinear systems requires the solution of nonlinear Hamilton-Jacobi-Bellman equations. Up to date, there are no systematic approaches in the existing literature to solve it accurately. A novel model-free adaptive near-optimal control method is proposed to solve this problem via utilizing the Taylor expansion-based problem relaxation, the universal approximation property of sigmoid neural networks, and the concept of sliding mode control. By making approximation for the performance index, it is first relaxed to a quadratic program, and then, a linear algebraic equation with unknown terms. An auxiliary system is designed to reconstruct the input-to-output property of the control systems with unknown dynamics, so as to tackle the difficulty caused by the unknown terms. Then, by considering the property of the sliding-mode surface, an explicit adaptive near-optimal control law is derived from the linear algebraic equation. Theoretical analysis shows that the auxiliary system is convergent, the resultant closed-loop system is asymptotically stable, and the performance index asymptomatically converges to optimal. An illustrative example and experimental results are presented, which substantiate the efficacy of the proposed method and verify the theoretical results.

Receding Hamiltonian-Informed Optimal Neural Control and State Estimation for Closed-Loop Dynamical Systems

Physics-informed neural networks via stochastic Hamiltonian dynamics learning

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

Decentralized Adaptive Neural Inverse Optimal Control of Nonlinear Interconnected Systems

Neural optimal controller for stochastic systems via pathwise HJB operator

Adaptive Dynamic Programming for Nonlinear-Constrained H∞ Control

Neural Port-Hamiltonian Models for Nonlinear Distributed Control: An Unconstrained Parametrization Approach

Data-Driven Finite-Horizon $H_{}$ Tracking Control With Event-Triggered Mechanism for the Continuous-Time Nonlinear Systems

Neural Distributed Controllers with Port-Hamiltonian Structures

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Adaptive optimal control for nonlinear discrete-time systems

Hamiltonian neural networks for solving equations of motion

General Hamiltonian Neural Networks for Dynamic Modeling: Handling Sophisticated Constraints Automatically and Achieving Coordinates Free

Neural Network-Based Model-Free Adaptive Near-Optimal Tracking Control for a Class of Nonlinear Systems

H∞ Control with Constrained Input for Completely Unknown Nonlinear Systems Using Data-Driven Reinforcement Learning Method

Infinite Horizon Optimal Control Using Continuous Hopfield Neural Networks

Constrained Online Optimal Control for Continuous-Time Nonlinear Systems Using Neuro-Dynamic Programming

Hamiltonian-based neural networks for systems under nonholonomic constraints

Adaptive Neural Inverse Optimal Control for a Class of Strict Feedback Stochastic Nonlinear Systems

The Receding Horizon Optimal Control Based on Neural Network

Neural Network Solution for Suboptimal Control of Non-Holonomic Chained Form System