Abstract:Sampling-based methods have become a cornerstone of contemporary approaches to Model Predictive Control (MPC), as they make no restrictions on the differentiability of the dynamics or cost function and are straightforward to parallelize. However, their efficacy is highly dependent on the quality of the sampling distribution itself, which is often assumed to be simple, like a Gaussian. This restriction can result in samples which are far from optimal, leading to poor performance. Recent work has explored improving the performance of MPC by sampling in a learned latent space of controls. However, these methods ultimately perform all MPC parameter updates and warm-starting between time steps in the control space. This requires us to rely on a number of heuristics for generating samples and updating the distribution and may lead to sub-optimal performance. Instead, we propose to carry out all operations in the latent space, allowing us to take full advantage of the learned distribution. Specifically, we frame the learning problem as bi-level optimization and show how to train the controller with backpropagation-through-time. By using a normalizing flow parameterization of the distribution, we can leverage its tractable density to avoid requiring differentiability of the dynamics and cost function. Finally, we evaluate the proposed approach on simulated robotics tasks and demonstrate its ability to surpass the performance of prior methods and scale better with a reduced number of samples.

On the Sample Complexity of Imitation Learning for Smoothed Model Predictive Control

Improved Sample Complexity of Imitation Learning for Barrier Model Predictive Control

An Improved Model Predictive Control for Uncertain Systems with Input Saturation.

Model Predictive Control via On-Policy Imitation Learning

Lebesgue-Approximation Model Predictive Control of Nonlinear Sampled-Data Systems

Learning Sampling Distributions for Model Predictive Control

Model Predictive Control for Sampled-Data Systems

CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design

Smooth Computation without Input Delay: Robust Tube-Based Model Predictive Control for Robot Manipulator Planning

Sampled-Data Primal-Dual Gradient Dynamics in Model Predictive Control

ABC-LMPC: Safe Sample-Based Learning MPC for Stochastic Nonlinear Dynamical Systems with Adjustable Boundary Conditions

Iterative Convex Optimization for Model Predictive Control with Discrete-Time High-Order Control Barrier Functions

Security Control for LPV System With Deception Attacks via Model Predictive Control: A Dynamic Output Feedback Approach

Learning an Approximate Model Predictive Controller With Guarantees

Iterative Convex Optimization for Safety-Critical Model Predictive Control

Control of Unknown Nonlinear Systems with Linear Time-Varying MPC

Robust Model Predictive Control for nonlinear discrete-time systems using iterative time-varying constraint tightening

Learning Soft Constrained MPC Value Functions: Efficient MPC Design and Implementation providing Stability and Safety Guarantees

A Robust Tube-Based Smooth-MPC for Robot Manipulator Planning

A Survey on Explicit Model Predictive Control

MPC-based Imitation Learning for Safe and Human-like Autonomous Driving