Abstract:In this paper, a novel adaptive dynamic programming (ADP) algorithm is developed for the infinite-horizon (H ∞ ) optimal control problems with unknown continuous-time (CT) nonlinear systems subject to external disturbances. To facilitate the implementation of the algorithm, generalized fuzzy hyperbolic models (GFHMs) are utilized to establish an identifier-critic architecture, where the identifier is designed to reconstruct the unknown system dynamics, and the GFHM-based critic network is employed to approximate the value functions. The CT H ∞ optimal control issue is converted into a two-player zero-sum game and the corresponding Hamilton-Jacobi-Isaacs equation is derived. The learning procedure of the critic design is adaptively implemented with the help of the reconstructed model, thus the requirement of the complete system dynamics is relaxed. Furthermore, by the means of Lyapunov direct method, the uniform ultimate boundedness stability analysis of the closed-loop control system is explicitly provided. Finally, to compare the control performances and disturbance attenuation properties of the proposed method and the existing ADP algorithms, two numerical examples are given.

H<inf>&#x221E;</inf> Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming

Adaptive Dynamic Programming for Nonlinear-Constrained H∞ Control

Heuristic dynamic programming-based H∞ control of discrete-time affine nonlinear systems

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Adaptive Dynamics Programming for H∞ Control of Continuous-Time Unknown Nonlinear Systems Via Generalized Fuzzy Hyperbolic Models

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

H ∞ optimal control of unknown linear systems by adaptive dynamic programming with applications to time‐delay systems

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs Using GDHP Technique

Constrained Event-Triggered H∞ Control Based on Adaptive Dynamic Programming with Concurrent Learning

Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Neural-Network-Based Constrained Optimal Control Scheme for Discrete-Time Switched Nonlinear System Using Dual Heuristic Programming

Approximately Optimal Control of Discrete-Time Nonlinear Switched Systems Using Globalized Dual Heuristic Programming

Intelligent Optimal Control of Constrained Nonlinear Systems Via Receding-Horizon Heuristic Dynamic Programming

Constrained Optimal Control of Affine Nonlinear Discrete-Time Systems Using GHJB Method

Model‐Free H∞ Control Design for Unknown Continuous‐Time Linear System Using Adaptive Dynamic Programming

Online Adaptive Policy Learning Algorithm for H-Infinity State Feedback Control of Unknown Affine Nonlinear Discrete-Time Systems

H∞ Robust Predictive Control of Nonlinear Systems with Constraints

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

Finite Horizon Optimal Control of Non-Linear Discrete-Time Switched Systems Using Adaptive Dynamic Programming with Ε-Error Bound.

H&lt;inf&gt;&amp;#x221E;&lt;/inf&gt; Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming