Abstract:In this paper, a dynamic compensator-based near-optimal control approach for unknown nonaffine nonlinear systems is developed by using integral reinforcement learning. Since system dynamics is unknown, it is difficult to obtain the optimal control policy via neuro-dynamic programming. To address this problem, a general dynamic compensator is introduced as the virtual control input to augment the unknown nonaffine nonlinear system as a partially unknown affine system. For the augmented system, a novel quadratic value function is designed with the system states, the actual control input and the virtual control input. The optimal control of the augmented system can be regarded as the near-optimal control for the original system since the novel optimal value function is an upper bound of the original optimal value function. In order to avoid the identification of system dynamics, the integral reinforcement learning framework is utilized to derive the optimal control based on the solution of Hamilton–Jacobi–Bellman equation via the critic-only structure. Meanwhile, the weight learning rule of the critic neural network is presented with the experience replay technique to relax the persistence of excitation condition. Moreover, the uniform ultimate boundedness of weight estimation errors and the stability of the closed-loop system are guaranteed by using the Lyapunov’s direct method. Finally, simulation results of two examples demonstrate the effectiveness of the developed dynamic compensator-based near-optimal control method.

Off-policy Neuro-Optimal Control for Unknown Complex-Valued Nonlinear Systems Based on Policy Iteration

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems with Disturbances

Adaptive Optimal Control for Unknown Constrained Nonlinear Systems with a Novel Quasi-Model Network

Nonlinear Neuro-Optimal Tracking Control via Stable Iterative Q-Learning Algorithm

Robust Optimal Control for a Class of Nonlinear Systems with Unknown Disturbances Based on Disturbance Observer and Policy Iteration.

Adaptive Optimal Control for a Class of Continuous-Time Affine Nonlinear Systems with Unknown Internal Dynamics

Neuro-Optimal Control of Unknown Nonaffine Nonlinear Systems with Saturating Actuators.

Neuro-Control for Continuous-Time Stochastic Nonlinear Systems Via Online Policy Iteration Algorithm

Synchronous Optimal Control Method for Nonlinear Systems with Saturating Actuators and Unknown Dynamics Using Off-Policy Integral Reinforcement Learning

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Off‐policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems

Optimal Iterative Control Of Unknown Nonlinear Systems Using Neural Networks

Neural-Network-Based Online Optimal Control for Uncertain Non-Linear Continuous-Time Systems with Control Constraints

Adaptive optimal control for a class of nonlinear partially uncertain dynamic systems via policy iteration

Adaptive Optimal Robust Control for Uncertain Nonlinear Systems Using Neural Network Approximation in Policy Iteration

Dynamic Compensator-Based Near-Optimal Control for Unknown Nonaffine Systems Via Integral Reinforcement Learning

A Novel Self-Learning Optimal Control Approach for Decentralized Guaranteed Cost Control of A Class of Complex Nonlinear Systems

Optimal Control Laws For Nonlinear Oscillator Systems With Saturating Actuators Using Neural Networks Based On Policy Iteration

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Generalized Policy Iteration-based Reinforcement Learning Algorithm for Optimal Control of Unknown Discrete-time Systems