Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Data-driven Robust Optimal Control for Nonlinear System with Uncertain Disturbances

Double-Closed-Loop Robust Optimal Control for Uncertain Nonlinear Systems

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Data-Driven Distributionally Robust Optimal Control with State-Dependent Noise

A Disturbance-Estimation-Based Robust Optimization Control for Nonlinear Systems with Application to Wastewater Treatment Process

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Coevolution-Based Robust Optimal Control for Nonlinear System with Time-Delay Optimal Objectives

Hybrid Evolutionary Robust Optimization-Based Optimal Control for Time-Delay Nonlinear Systems

Data-based robust control for unknown nonlinear systems

Robustness Of Non-Linear Stochastic Optimal Control For Quasi-Hamiltonian Systems With Parametric Uncertainty

Observer‐based Robust Optimal Control for Helicopter with Uncertainties and Disturbances

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

Data-Driven Robust Stabilization with RobustDomain of Attraction Estimate for Nonlinear Discrete-Time Systems

Data-Driven Optimal Fault-Tolerant Control for Unknown Linear Systems

A Robust Data-Driven Iterative Control Method for Linear Systems with Bounded Disturbances

Data-driven Robust Regulation of Nonlinear Systems with Mismatched Disturbances.

Robust Control of Uncertain Nonlinear Systems: A Nonlinear DOBC Approach

Data-Knowledge-Driven Multiobjective Integrated Optimal Control for Nonlinear Systems

Robust Optimal Control for a Class of Nonlinear Systems with Unknown Disturbances Based on Disturbance Observer and Policy Iteration.

Robust Optimal Control for Wastewater Treatment Process with Uncertain Time Delays.

Robust stabilization of discrete-time uncertain nonlinear systems using neuro-optimal control strategy