Abstract:The integration of machine learning methods and Model Predictive Control (MPC) has received increasing attention in recent years. In general, learning-based predictive control (LPC) is promising to build data-driven models and solve the online optimization problem with lower computational costs. However, the robustness of LPC is difficult to be guaranteed since there will be uncertainties due to function approximation used in machine learning algorithms. In this paper, a novel robust learning-based predictive control (r-LPC) scheme is proposed for constrained nonlinear systems with unknown dynamics. In r-LPC, the Koopman operator is used to form a global linear representation of the unknown dynamics, and an incremental actor-critic algorithm is presented for receding horizon optimization. To realize the satisfaction of system constraints, soft logarithmic barrier functions are designed within the learning predictive framework. The recursive feasibility and stability of the closed-loop system are discussed under the convergence arguments of the approximation algorithms adopted. Also, the robustness property of r-LPC is analyzed theoretically by taking into consideration the existence of perturbations on the controller due to possible approximation errors. Simulation results with the proposed learning control approach for the data-driven regulation of a Van der Pol oscillator system have been reported, including the comparisons with a classic MPC and an infinite-horizon Dual Heuristic Programming (DHP) algorithm. The results show that the r-LPC significantly outperforms the DHP algorithm in terms of control performance and can be comparative to the MPC in terms of regulating control as well as energy consumption. Moreover, its average computational cost is much smaller than that with the MPC in the adopted environment.

Data-Driven MPC for Linear Systems Using Reinforcement Learning

Data-Driven MPC for Nonlinear Systems with Reinforcement Learning

Get the design right, the rest is automatic: Towards an adaptive MPC controller

A Low-Cost Pole-Placement MPC Algorithm for Controlling Complex Dynamic Systems

Synthesis of model predictive control based on data-driven learning

Learning-based Predictive Control for Nonlinear Systems with Unknown Dynamics Subject to Safety Constraints

Data-Driven Min-Max MPC for Linear Systems: Robustness and Adaptation

Reinforcement Learning-Based Model Predictive Control for Discrete-Time Systems.

Data-Driven Min-Max MPC for LPV Systems with Unknown Scheduling Signal

Data-Driven Model Predictive Control With Stability and Robustness Guarantees

Model Predictive Control of Linear Systems with Unknown Parameters

Robust MPC for Constrained Uncertain Systems with Data-Driven Improvement

Learning‐based Model Predictive Control under Value Iteration with Finite Approximation Errors

Learning-based MPC from Big Data Using Reinforcement Learning

Input-mapping Based Data-Driven Model Predictive Control for Unknown Linear Systems with Bounded Disturbances

Q-Learning-Based Model Predictive Control for Nonlinear Continuous-Time Systems

Robust Learning-based Predictive Control for Constrained Nonlinear Systems.

Knowledge-Data-Driven Model Predictive Control for a Class of Nonlinear Systems

A Learning- and Scenario-based MPC Design for Nonlinear Systems in LPV Framework with Safety and Stability Guarantees.

Neural Lyapunov Model Predictive Control: Learning Safe Global Controllers from Sub-optimal Examples

Data-Driven Optimization Framework for Nonlinear Model Predictive Control