Abstract:In this paper, we consider the problem of reference tracking in uncertain nonlinear systems. A neural State-Space Model (NSSM) is used to approximate the nonlinear system, where a deep encoder network learns the nonlinearity from data, and a state-space component captures the temporal relationship. This transforms the nonlinear system into a linear system in a latent space, enabling the application of model predictive control (MPC) to determine effective control actions. Our objective is to design the optimal controller using limited data from the \textit{target system} (the system of interest). To this end, we employ an implicit model-agnostic meta-learning (iMAML) framework that leverages information from \textit{source systems} (systems that share similarities with the target system) to expedite training in the target system and enhance its control performance. The framework consists of two phases: the (offine) meta-training phase learns a aggregated NSSM using data from source systems, and the (online) meta-inference phase quickly adapts this aggregated model to the target system using only a few data points and few online training iterations, based on local loss function gradients. The iMAML algorithm exploits the implicit function theorem to exactly compute the gradient during training, without relying on the entire optimization path. By focusing solely on the optimal solution, rather than the path, we can meta-train with less storage complexity and fewer approximations than other contemporary meta-learning algorithms. We demonstrate through numerical examples that our proposed method can yield accurate predictive models by adaptation, resulting in a downstream MPC that outperforms several baselines.

Learning and steering game dynamics towards desirable outcomes

Get the design right, the rest is automatic: Towards an adaptive MPC controller

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Data-Scarce Identification of Game Dynamics via Sum-of-Squares Optimization

Long-Term Interactive Driving Simulation: MPC to the Rescue.

Learning Two-agent Motion Planning Strategies from Generalized Nash Equilibrium for Model Predictive Control

Model Predictive Control via On-Policy Imitation Learning

Teaching MPC: Which Way to the Promised Land?

Limited Information Model Predictive Control for Pursuit-evasion Games

Inverse Model Predictive Control: Learning Optimal Control Cost Functions for MPC

First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling

SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimization

Neural Lyapunov Model Predictive Control: Learning Safe Global Controllers from Sub-optimal Examples

Addressing Behavior Model Inaccuracies for Safe Motion Control in Uncertain Dynamic Environments

MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Models

Towards an Adaptable and Generalizable Optimization Engine in Decision and Control: A Meta Reinforcement Learning Approach

Practical Reinforcement Learning of Stabilizing Economic MPC

Information Theoretic Model Predictive Q-Learning

Learning Sampling Distributions for Model Predictive Control

Inducing Social Optimality in Games via Adaptive Incentive Design

Performance-Oriented Model Learning for Data-Driven MPC Design