Abstract:Sampling-based methods have become a cornerstone of contemporary approaches to Model Predictive Control (MPC), as they make no restrictions on the differentiability of the dynamics or cost function and are straightforward to parallelize. However, their efficacy is highly dependent on the quality of the sampling distribution itself, which is often assumed to be simple, like a Gaussian. This restriction can result in samples which are far from optimal, leading to poor performance. Recent work has explored improving the performance of MPC by sampling in a learned latent space of controls. However, these methods ultimately perform all MPC parameter updates and warm-starting between time steps in the control space. This requires us to rely on a number of heuristics for generating samples and updating the distribution and may lead to sub-optimal performance. Instead, we propose to carry out all operations in the latent space, allowing us to take full advantage of the learned distribution. Specifically, we frame the learning problem as bi-level optimization and show how to train the controller with backpropagation-through-time. By using a normalizing flow parameterization of the distribution, we can leverage its tractable density to avoid requiring differentiability of the dynamics and cost function. Finally, we evaluate the proposed approach on simulated robotics tasks and demonstrate its ability to surpass the performance of prior methods and scale better with a reduced number of samples.

Improved Sample Complexity of Imitation Learning for Barrier Model Predictive Control

On the Sample Complexity of Imitation Learning for Smoothed Model Predictive Control

Model Predictive Control via On-Policy Imitation Learning

Iterative Convex Optimization for Model Predictive Control with Discrete-Time High-Order Control Barrier Functions

Safety-Critical Model Predictive Control with Discrete-Time Control Barrier Function

Learning a Better Control Barrier Function Under Uncertain Dynamics

Path Integral Methods with Stochastic Control Barrier Functions

Relaxed Logarithmic Barrier Function Based Model Predictive Control of Linear Systems

Learning Performance-Oriented Control Barrier Functions Under Complex Safety Constraints and Limited Actuation

Control Lyapunov-Barrier Function Based Model Predictive Control for Stochastic Nonlinear Affine Systems

Security Control for LPV System With Deception Attacks via Model Predictive Control: A Dynamic Output Feedback Approach

On the improvement of model-predictive controllers

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions

Iterative Convex Optimization for Safety-Critical Model Predictive Control

Provably Safe and Robust Learning-Based Model Predictive Control

Probabilistically safe controllers based on control barrier functions and scenario model predictive control

Predictive Control Barrier Functions: Enhanced Safety Mechanisms for Learning-Based Control

ABC-LMPC: Safe Sample-Based Learning MPC for Stochastic Nonlinear Dynamical Systems with Adjustable Boundary Conditions

Blending MPC & Value Function Approximation for Efficient Reinforcement Learning

Learning Sampling Distributions for Model Predictive Control

Safe Importance Sampling in Model Predictive Path Integral Control