Abstract:We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. We apply contemporary statistical estimation techniques to certify the system's safety through persistent constraint satisfaction with high probability. Moreover, we propose using Bayesian meta-learning algorithms that learn calibrated model priors to help satisfy the assumptions of the control design in challenging settings. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods and that the use of Bayesian meta-learning allows us to adapt to the test environments more rapidly.

RAT iLQR: A Risk Auto-Tuning Controller to Optimally Account for Stochastic Model Mismatch

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Risk-Aware Model Predictive Path Integral Control Using Conditional Value-at-Risk

Matrix Inequalities Based Robust Model Predictive Control for Vehicle Considering Model Uncertainties, External Disturbances, and Time-Varying Delay

Probabilistic Iterative LQR for Short Time Horizon MPC

Integrating Predictive Motion Uncertainties with Distributionally Robust Risk-Aware Control for Safe Robot Navigation in Crowds

Linear Quadratic Control with Risk Constraints

Iterative risk-constrained model predictive control: A data-driven distributionally robust approach

Towards Integrated Perception and Motion Planning with Distributionally Robust Risk Constraints

Learning-based distributionally robust motion control with Gaussian processes

Generative Modeling of Residuals for Real-Time Risk-Sensitive Safety with Discrete-Time Control Barrier Functions

Adaptive Robust Model Predictive Control via Uncertainty Cancellation

Data-driven distributionally robust iterative risk-constrained model predictive control

Adaptive Robust Controller for handling Unknown Uncertainty of Robotic Manipulators

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Risk-Averse Model Predictive Control for Racing in Adverse Conditions

Differentiable Robust Model Predictive Control

Risk in Stochastic and Robust Model Predictive Path-Following Control for Vehicular Motion Planning

An Efficient Risk-aware Branch MPC for Automated Driving that is Robust to Uncertain Vehicle Behaviors

Distributionally Robust Policy and Lyapunov-Certificate Learning