Abstract:We present a novel indirect adaptive fuzzy-regulated optimal control scheme for continuous-time nonlinear systems with unknown dynamics, mismatches, and disturbances. Initially, the Hamilton-Jacobi-Bellman (HJB) equation associated with its performance function is derived for the original nonlinear systems. Unlike existing adaptive dynamic programming (ADP) approaches, this scheme uses a special non-quadratic variable performance function as the reinforcement medium in the actor-critic architecture. An adaptive fuzzy-regulated critic structure is correspondingly constructed to configure the weighting matrix of the performance function for the purpose of approximating and balancing the HJB equation. A concurrent self-organizing learning technique is designed to adaptively update the critic weights. Based on this particular critic, an adaptive optimal feedback controller is developed as the actor with a new form of augmented Riccati equation to optimize the fuzzy-regulated variable performance function in real time. The result is an online indirect adaptive optimal control mechanism implemented as an actor-critic structure, which involves continuous-time adaptation of both the optimal cost and the optimal control policy. The convergence and closed-loop stability of the proposed system are proved and guaranteed. Simulation examples and comparisons show the effectiveness and advantages of the proposed method.

Adaptive Dynamics Programming for H∞ Control of Continuous-Time Unknown Nonlinear Systems Via Generalized Fuzzy Hyperbolic Models

Adaptive Inverse Control of Non-Linear Systems with Unknown Complex Hysteretic Non-Linearities

Event-Triggered Adaptive Dynamic Programming Algorithm for Non-Zero-Sum Games of Unknown Nonlinear Systems via Generalized Fuzzy Hyperbolic Models

H<inf>&#x221E;</inf> Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming

Adaptive Dynamic Programming for Nonlinear-Constrained H∞ Control

Model‐Free H∞ Control Design for Unknown Continuous‐Time Linear System Using Adaptive Dynamic Programming

Nearly Optimal Control Scheme Using Adaptive Dynamic Programming Based on Generalized Fuzzy Hyperbolic Model

Event-Triggered Adaptive Dynamic Programming for Non-Zero-Sum Games of Unknown Nonlinear Systems Via Generalized Fuzzy Hyperbolic Models

Indirect Adaptive Fuzzy-Regulated Optimal Control for Unknown Continuous-Time Nonlinear Systems.

Online H∞ Control for Completely Unknown Nonlinear Systems Via an Identifier–critic-Based ADP Structure

Online Adaptive Policy Learning Algorithm for H-Infinity State Feedback Control of Unknown Affine Nonlinear Discrete-Time Systems

Optimal H∞ Tracking Control of Nonlinear Systems with Zero-Equilibrium-free Via Novel Adaptive Critic Designs.

Online Approximate Optimal Control for Affine Non-Linear Systems with Unknown Internal Dynamics Using Adaptive Dynamic Programming

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems

Event-triggered Adaptive Dynamic Programming of Nonlinear System with Asymmetric Input Constraints and Uncertain Disturbances

Finite-time Differential Game for Nonlinear Systems Using Adaptive Dynamic Programming

Multi-objective optimal control for a class of unknown nonlinear systems based on finite-approximation-error ADP algorithm

A Digital Receding-Horizon Learning Controller for Nonlinear Continuous-time Systems

Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs Using GDHP Technique

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems