Abstract:In this paper, we discuss a novel algorithm for learning the solution to the optimal control problem (OCP) for affine nonlinear continuous-time constrained-input systems with completely unknown dynamics on a data-driven integral reinforcement learning (IRL) basis. It is well known that we have to obtain the solution of the nonlinear OCP by means of resolving the Hamilton-Jacobi-Bellman equation (HJBE). However, the HJBE is usually a nonlinear partial differential equation that cannot be solved analytically. To make matters worse, most practical systems are too complex to be accurately mathematically modelled and have real-time errors in the system’s controller. To address the above issues, we propose an online data-driven IRL algorithm that is anchored in policy iteration (PI), using real-time data from practical systems, rather than system models or partially sampled data from systems. To begin with, the PI algorithm is shown. Then, we approximate the performance function and the control policy using a critic neural network (CNN) and an actor neural network (ANN), respectively. The approach presented is an online-policy IRL, where the data are continuously sampled in the input and state domains. The weights of the CNN and ANN are renewed by least squares using the collected data, which minimizes residual errors. Finally, the validity of the approach in solving the OCP is demonstrated from the simulation results.

Output‐feedback Robust Control of Systems with Uncertain Dynamics Via Data‐driven Policy Learning

Robust Output Feedback Control for a Class of Linear Time-Varying Uncertain Time-Delay Systems

Output feedback stabilization for a class of linear time-varying uncertain time-delay systems

Output Feedback Adaptive Robust Learning Control of a Class of Nonlinear Systems with Periodic Disturbances

Output feedback stabilizing controller for linear time-varying uncertain systems with delayed state

Robust Stabilizing Control for Uncertain Time-Delay Systems with Output Feedback

Output-Feedback Robust Control of Uncertain Systems Via Online Data-Driven Learning

Robust Stabilization of Uncertain State-Delayed Systems Via Output Feedback

Online Policy Learning-Based Output-Feedback Optimal Control of Continuous-Time Systems

A Dual Adaptive Robust Control for Nonlinear Systems with Parameter and State Estimation

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Adaptive Robust Control for Uncertain Systems Via Data-Driven Learning.

Data-Driven Robust Control of Discrete-Time Uncertain Linear Systems Via Off-Policy Reinforcement Learning.

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Online Output-Feedback Optimal Control of Linear Systems Based on Data-Driven Adaptive Learning

Robust Control of Uncertain Linear Systems Based on Reinforcement Learning Principles.

Online adaptive data-driven control for unknown nonlinear systems with constrained-input

Data-Driven H∞ Optimal Output Feedback Control for Linear Discrete-Time Systems Based on Off-Policy Q-Learning

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming