Abstract:Sampling-based methods have become a cornerstone of contemporary approaches to Model Predictive Control (MPC), as they make no restrictions on the differentiability of the dynamics or cost function and are straightforward to parallelize. However, their efficacy is highly dependent on the quality of the sampling distribution itself, which is often assumed to be simple, like a Gaussian. This restriction can result in samples which are far from optimal, leading to poor performance. Recent work has explored improving the performance of MPC by sampling in a learned latent space of controls. However, these methods ultimately perform all MPC parameter updates and warm-starting between time steps in the control space. This requires us to rely on a number of heuristics for generating samples and updating the distribution and may lead to sub-optimal performance. Instead, we propose to carry out all operations in the latent space, allowing us to take full advantage of the learned distribution. Specifically, we frame the learning problem as bi-level optimization and show how to train the controller with backpropagation-through-time. By using a normalizing flow parameterization of the distribution, we can leverage its tractable density to avoid requiring differentiability of the dynamics and cost function. Finally, we evaluate the proposed approach on simulated robotics tasks and demonstrate its ability to surpass the performance of prior methods and scale better with a reduced number of samples.

Distributed Sampling-Based Model Predictive Control via Belief Propagation for Multi-Robot Formation Navigation

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Multi-Robot Learning Dynamic Obstacle Avoidance in Formation with Information-Directed Exploration.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Distributed Model Predictive Control for Linear-Quadratic Performance and Consensus State Optimization of Multiagent Systems

Hierarchical Model Predictive Control for Multi-Robot Navigation

Stein Variational Belief Propagation for Multi-Robot Coordination

Learning a Generalizable Trajectory Sampling Distribution for Model Predictive Control

Human-in-the-loop Distributed Cooperative Tracking Control with Applications to Autonomous Ground Vehicles: A Data-Driven Mixed Iteration Approach

Switched Linear Multi-Robot Navigation Using Hierarchical Model Predictive Control.

Optimal tracking cooperative control for multi-agent systems with periodic sampling via robust model predictive control approach

Learning Sampling Distributions for Model Predictive Control

Robust Distributed Model Predictive Control for Formation Tracking of Nonholonomic Vehicles

Biased-MPPI: Informing Sampling-Based Model Predictive Control by Fusing Ancillary Controllers

Stochastic Model Predictive Control with Optimal Linear Feedback for Mobile Robots in Dynamic Environments

A Distributed Model Predictive Control for Multiple Mobile Robots with the Model Uncertainty

Distributed Robust Learning based Formation Control of Mobile Robots based on Bioinspired Neural Dynamics

Consensus of Sampled-Data Multi-Agent Networking Systems Via Model Predictive Control

Enhancing Sample Efficiency and Uncertainty Compensation in Learning-based Model Predictive Control for Aerial Robots

Model Predictive Control-Based Probabilistic Search Method for Autonomous Ground Robot in A Dynamic Environment

Interaction-Aware Sampling-Based MPC with Learned Local Goal Predictions