Abstract:Model predictive control (MPC) has been widely employed as an effective method for model-based constrained control. For systems with unknown dynamics, reinforcement learning (RL) and adaptive dynamic programming (ADP) have received notable attention to solve the adaptive optimal control problems. Recently, works on the use of RL in the framework of MPC have emerged, which can enhance the ability of MPC for data-driven control. However, the safety under state constraints and the closed-loop robustness are difficult to be verified due to approximation errors of RL with function approximation structures. Aiming at the above problem, we propose a data-driven robust MPC solution based on incremental RL, called data-driven robust learning-based predictive control (dr-LPC), for perturbed unknown nonlinear systems subject to safety constraints. A data-driven robust MPC (dr-MPC) is firstly formulated with a learned predictor. The incremental Dual Heuristic Programming (DHP) algorithm using an actor-critic architecture is then utilized to solve the online optimization problem of dr-MPC. In each prediction horizon, the actor and critic learn time-varying laws for approximating the optimal control policy and costate respectively, which is different from classical MPCs. The state and control constraints are enforced in the learning process via building a Hamilton-Jacobi-Bellman (HJB) equation and a regularized actor-critic learning structure using logarithmic barrier functions. The closed-loop robustness and safety of the dr-LPC are proven under function approximation errors. Simulation results on two control examples have been reported, which show that the dr-LPC can outperform the DHP and dr-MPC in terms of state regulation, and its average computational time is much smaller than that with the dr-MPC in both examples.

A Model Reference Adaptive Control with ADP-to-SMC Strategy for Unknown Nonlinear Systems

ADP-Based Model Reference Adaptive Control Design for Unknown Discrete-Time Nonlinear Systems

MRAC for Unknown Discrete-Time Nonlinear Systems Based on Supervised Neural Dynamic Programming

Multiple Model Adaptive Control for a Class of Nonlinear Systems with Unknown Control Directions.

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

An Adaptive Nonlinear Model Predictive Control Based On Online Svm Regression Algorithm

A Robust Adaptive CMAC Neural Network-Based Multisliding Mode Control Method for Unmatched Uncertain Nonlinear Systems

Optimal Consensus Control Of Unknown Nonlinear Multi-Agent Systems Using Adaptive Dynamic Programming Via Mrac

Adaptive Dynamic Programming-based Decentralized Sliding Mode Optimal Control for Modular and Reconfigurable Robots

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Learning-based Predictive Control for Nonlinear Systems with Unknown Dynamics Subject to Safety Constraints

Online Adaptive Critic Robust Control of Discrete-Time Nonlinear Systems with Unknown Dynamics

Supervised Learning in Model Reference Adaptive Sliding Mode Control

Multiple Model Adaptive Tracking Control Based on Adaptive Dynamic Programming

Variable Structure Robust Adaptive Control with Unmodelled Dynamics

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems

Functional Nonlinear Model Predictive Control Based on Adaptive Dynamic Programming

Optimization-based Model Reference Adaptive Control for Dynamic Positioning of a Fully Actuated Underwater Vehicle

Model Reference Adaptive Control of A Nonsmooth Dynamical System

An Adaptive Model Predictive Control Strategy for Discrete-Time Nonlinear System