Abstract:We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. We apply contemporary statistical estimation techniques to certify the system's safety through persistent constraint satisfaction with high probability. Moreover, we propose using Bayesian meta-learning algorithms that learn calibrated model priors to help satisfy the assumptions of the control design in challenging settings. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods and that the use of Bayesian meta-learning allows us to adapt to the test environments more rapidly.

Approximate Robust NMPC using Reinforcement Learning

R$^2$NMPC: A Real-Time Reduced Robustified Nonlinear Model Predictive Control with Ellipsoidal Uncertainty Sets for Autonomous Vehicle Motion Control

Robust Nonlinear Model Predictive Control Algorithm Based on Reduced Precision Solution Criteria

Robust Predictive Control of Uncertain Intergrating Linear Systems with Input Constraints

Neural Approximation-based Model Predictive Tracking Control of Non-holonomic Wheel-legged Robots

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Reinforcement Learning Based on Real-Time Iteration NMPC

Motion Planning and Obstacle Avoidance for Robot Manipulators Using Model Predictive Control-based Reinforcement Learning

Adaptive Robust Model Predictive Control via Uncertainty Cancellation

Robust Model Predictive Controller Using Recurrent Neural Networks for Input–Output Linear Parameter Varying Systems

Robustifying Model-Based Locomotion by Zero-order Stochastic Nonlinear Model Predictive Control with Guard Saltation Matrix

Safe Imitation Learning of Nonlinear Model Predictive Control for Flexible Robots

Robust Mpc for Perturbed Nonholonomic Vehicle

Robust Output-Lifted Learning Model Predictive Control

Robust tracking control of flexible manipulators using hybrid backstepping/nonlinear reduced-order active disturbance rejection control

Learning-based nonlinear model predictive control with accurate uncertainty compensation

Differentiable Robust Model Predictive Control

Neural network-based model predictive tracking control of an uncertain robotic manipulator with input constraints

Q-learning based Robust Model Predictive Control for Uncertain Linear Systems

Robust interval predictive tracking control for constrained and perturbed unicycle mobile robots

Robust Stabilization of a Wheeled Mobile Robot Using Model Predictive Control Based on Neurodynamics Optimization