Abstract:This paper proposes a novel robust adaptive control strategy for partially unknown continuous-time nonlinear systems subject to unmatched uncertainties. Initially, the robust nonlinear control problem is converted into a nonlinear optimal control problem by constructing an appropriate value function for the auxiliary system. After that, within the framework of reinforcement learning, an identifier-critic architecture is developed. The presented architecture uses two neural networks: the identifier neural network (INN) which aims at estimating the unknown internal dynamics and the critic neural network (CNN) which tends to derive the approximate solution of the Hamilton-Jacobi-Bellman equation arising in the obtained optimal control problem. The INN is updated by using both the back-propagation algorithm and the e-modification technique. Meanwhile, the CNN is updated via the modified gradient descent method, which uses historical and current state data simultaneously. Based on the classic Lyapunov technique, all the signals in the closed-loop auxiliary system are proved to be uniformly ultimately bounded. Moreover, the original system is kept asymptotically stable under the obtained approximate optimal control. Finally, two illustrative examples, including the F-16 aircraft plant, are provided to demonstrate the effectiveness of the developed method.

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Adaptive Robust Control Of Nonlinear Systems With Dynamic Uncertainties

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Robust optimal control for a class of nonlinear dynamic systems using single network adaptive dynamic programming

Robust adaptive dynamic programming for optimal nonlinear control design

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

An Adaptive Cross Approximation-based Method for Robust Nonlinear Feedback Control Problems

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Event-Based Robust Control for Uncertain Nonlinear Systems Using Adaptive Dynamic Programming

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems

Reinforcement Learning for Robust Adaptive Control of Partially Unknown Nonlinear Systems Subject to Unmatched Uncertainties

Event-Triggered Adaptive Dynamic Programming for Unmatched Uncertain Nonlinear Continuous-Time Systems

ADP-Based Robust Tracking Control for a Class of Nonlinear Systems With Unmatched Uncertainties

Robust Optimal Control For Time-Delay Systems With Dynamic Uncertainties Via Adp

Robust Optimal Parallel Tracking Control Based on Adaptive Dynamic Programming

Robust Adaptive Neural Network Control for a Class of Nonlinear Systems