Abstract:The paper presents an analytical method to solve the optimal control problem for affine nonlinear systems with unknown drift dynamics. It introduces a new non‐quadratic cost function that considers input constraints and includes the cost of the feed‐forward component of the control law. This method converts the cost function into another form, which enables extracting the optimal control solution without solving the HJB equation in the presence of input constraints. The paper also proposes an adaptive neural network approach to estimate the unknown drift dynamics. The necessary and sufficient conditions are provided to ensure the optimality of the proposed approach. This paper presents an analytical method to solve the optimal control problem for affine nonlinear systems with unknown drift dynamics. A new non‐quadratic cost function over an infinite horizon is presented that considers input constraints and includes the cost of the feed‐forward component of the control law. The mean value theorem for vector‐valued functions has been used to derive an integral form of this theorem. Based on this theorem, a rigorous proof is provided demonstrating that the cost function can be converted into another form. In the presence of input constraints, this converted form enables extracting the optimal control solution without solving the HJB equation. Additionally, unknown nonlinearity effects in drift dynamics are compensated in the control input. This is accomplished by estimating the unknown drift dynamics via an adaptive neural network (NN) approach. It is proven that the states and weights of NN are uniformly ultimately bounded based on a Lyapunov technique. The necessary and sufficient conditions are provided that ensure the optimality of the infinite horizon optimal control problem with a discount factor. As a result, it is demonstrated that the proposed approach satisfies the optimality criteria. To evaluate the effectiveness of the proposed approach, simulation examples are provided.

A nonlinear adaptive $H_{\infty }$ optimal control method without solving HJIE: an analytical approach

An analytical adaptive optimal control approach without solving HJB equation for nonlinear systems with input constraints

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation

Model‐free optimal tracking over finite horizon using adaptive dynamic programming

${\Rm H}_{\infty}$ Output Tracking Control of Discrete-Time Nonlinear Systems Via Standard Neural Network Models

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

NN/RISE-based asymptotic tracking control of uncertain nonlinear systems

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Event-Driven H ∞ -Constrained Control Using Adaptive Critic Learning

Reinforcement Learning-Based Adaptive Optimal Control for Nonlinear Systems With Asymmetric Hysteresis

Off-Policy Reinforcement Learning for $ H_\infty $ Control Design

Event-driven H ∞ control with critic learning for nonlinear systems

Learning-Based Nonlinear $H^\infty$ Control via Game-Theoretic Differential Dynamic Programming

Decentralized Adaptive Neural Inverse Optimal Control of Nonlinear Interconnected Systems

Adaptive Optimal Tracking Control of Unknown Nonlinear Systems Using System Augmentation.

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

Optimal Infinite-Horizon Mixed $\mathit{H}_2/\mathit{H}_\infty$ Control