Abstract:We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems commonly model the nonlinear effects of an unknown environment on a nominal system. We optimize over a class of nonlinear feedback policies inspired by certainty equivalent "estimate-and-cancel" control laws pioneered in classical adaptive control to achieve significant performance improvements in the presence of uncertainties of large magnitude, a setting in which existing learning-based predictive control algorithms often struggle to guarantee safety. In contrast to previous work in robust adaptive MPC, our approach allows us to take advantage of structure (i.e., the numerical predictions) in the a priori unknown dynamics learned online through function approximation. Our approach also extends typical nonlinear adaptive control methods to systems with state and input constraints even when we cannot directly cancel the additive uncertain function from the dynamics. We apply contemporary statistical estimation techniques to certify the system's safety through persistent constraint satisfaction with high probability. Moreover, we propose using Bayesian meta-learning algorithms that learn calibrated model priors to help satisfy the assumptions of the control design in challenging settings. Finally, we show in simulation that our method can accommodate more significant unknown dynamics terms than existing methods and that the use of Bayesian meta-learning allows us to adapt to the test environments more rapidly.

Off‐policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties

Reinforcement learning-based optimal control of uncertain nonlinear systems

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Adaptive Learning Based Fault Tolerant Control for Uncertain Nonlinear Systems

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Adaptive Robust Model Predictive Control via Uncertainty Cancellation

Robust stabilisation of uncertain nonlinear systems with matched and unmatched uncertainties

Robust stabilization of discrete-time uncertain nonlinear systems using neuro-optimal control strategy

Robust Control for Affine Nonlinear Systems under the Reinforcement Learning Framework

A reinforcement learning‐based approach for near‐optimal sliding‐mode control of output‐constrained uncertain nonlinear systems

Robust adaptive neural networks with an online learning technique for robot control

Event-Based Robust Control for Uncertain Nonlinear Systems Using Adaptive Dynamic Programming

Robust control under worst‐case uncertainty for unknown nonlinear systems using modified reinforcement learning

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization