Abstract:We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. We apply contemporary statistical estimation techniques to certify the system's safety through persistent constraint satisfaction with high probability. Moreover, we propose using Bayesian meta-learning algorithms that learn calibrated model priors to help satisfy the assumptions of the control design in challenging settings. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods and that the use of Bayesian meta-learning allows us to adapt to the test environments more rapidly.

Robust Control for Affine Nonlinear Systems under the Reinforcement Learning Framework

Adaptive Robust Control Of Nonlinear Systems With Dynamic Uncertainties

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Adaptive Interleaved Reinforcement Learning: Robust Stability of Affine Nonlinear Systems with Unknown Uncertainty

Robust Adaptive Control for Robotic System with External Disturbance and Guaranteed Parameter Estimation

Robust Adaptive Control for a class of uncertain nonlinear systems with an optimized smooth input

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics

Robust adaptive control for uncertain systems with multiple discrete and distributed delays

Robust Adaptive Control of Nonlinear Systems with Uncertainties

Reinforcement Learning for Robust Adaptive Control of Partially Unknown Nonlinear Systems Subject to Unmatched Uncertainties

Robust Control of Uncertain Linear Systems Based on Reinforcement Learning Principles.

Robust control under worst‐case uncertainty for unknown nonlinear systems using modified reinforcement learning

Adaptive Robust Controller for handling Unknown Uncertainty of Robotic Manipulators

Adaptive Robust Model Predictive Control via Uncertainty Cancellation

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Output feedback adaptive robust control of uncertain linear systems with large disturbances

Robust adaptive safety control of uncertain nonlinear systems and its application to differential robots

Design of Robust Adaptive Neural Switching Controller for Robotic Manipulators with Uncertainty and Disturbances