Abstract:Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically solving an online nominal MPC problem, which requires prior model information and frequent access to onboard computational resources. In this article, we propose an efficient robust MPC solution based on receding horizon reinforcement learning, called r-LPC, for unknown nonlinear systems with state constraints and disturbances. The proposed r-LPC utilizes a Koopman operator-based prediction model obtained offline from precollected input–output datasets. Unlike classic tube-based MPC, in each prediction time interval of r-LPC, we use an actor–critic structure to learn a near-optimal feedback control policy rather than a control sequence. The resulting closed-loop control policy can be learned offline and deployed online or learned online in an asynchronous way. In the latter case, online learning can be activated whenever necessary; for instance, the safety constraint is violated with the deployed policy. The closed-loop recursive feasibility, robustness, and asymptotic stability are proven under function approximation errors of the actor–critic networks. Simulation and experimental results on two nonlinear systems with unknown dynamics and disturbances have demonstrated that our approach has better or comparable performance when compared with tube-based MPC and linear quadratic regulator, and outperforms a recently developed actor–critic learning approach.

Tube-Based Robust Model Predictive Control of Nonlinear Systems via Collective Neurodynamic Optimization.

Tube-Based Active Robust MPC for Uncertain Constrained Linear Systems with Time Delays

Nonlinear Model Predictive Control Based on Variable Gain

Tube-Based Model Predictive Control Using Multidimensional Taylor Network for Nonlinear Time-Delay Systems

Robust Model Predictive Control for Constrained Continuous-Time Nonlinear Systems.

Dynamic Tube MPC for Nonlinear Systems

Robust Model Predictive Control of Uncertain Nonlinear Time‐delay Systems Via Control Contraction Metric Technique

Tube-Based Model Predictive Control for Aero-Engine Transient-State Tracking Problems

Robust Learning-Based Predictive Control for Discrete-Time Nonlinear Systems with Unknown Dynamics and State Constraints

Constrained DNN-Based Robust Model Predictive Control Scheme with Adjustable Error Tube

Learning-based Rigid Tube Model Predictive Control

Nonlinear learning‐based model predictive control supporting state and input dependent model uncertainty estimates

A Robust Model Predictive Control Scheme for Constrained Linear Systems

Robust Learning-based Model Predictive Control for Intelligent Vehicles with Unknown Dynamics and Unbounded Disturbances

A Robust Tube-Based Smooth-MPC for Robot Manipulator Planning

Robust Tube MPC with Multi-step Tracking for Uncertain Constrained Linear Systems

Self-Tuning Tube-based Model Predictive Control

Tube MPC scheme based on robust control invariant set with application to Lipschitz nonlinear systems.

Configuration-Constrained Tube MPC

Robust Model Predictive Control for nonlinear discrete-time systems using iterative time-varying constraint tightening

Robust offset-free nonlinear model predictive control for systems learned by neural nonlinear autoregressive exogenous models