Abstract:In this paper, we consider the problem of reference tracking in uncertain nonlinear systems. A neural State-Space Model (NSSM) is used to approximate the nonlinear system, where a deep encoder network learns the nonlinearity from data, and a state-space component captures the temporal relationship. This transforms the nonlinear system into a linear system in a latent space, enabling the application of model predictive control (MPC) to determine effective control actions. Our objective is to design the optimal controller using limited data from the \textit{target system} (the system of interest). To this end, we employ an implicit model-agnostic meta-learning (iMAML) framework that leverages information from \textit{source systems} (systems that share similarities with the target system) to expedite training in the target system and enhance its control performance. The framework consists of two phases: the (offine) meta-training phase learns a aggregated NSSM using data from source systems, and the (online) meta-inference phase quickly adapts this aggregated model to the target system using only a few data points and few online training iterations, based on local loss function gradients. The iMAML algorithm exploits the implicit function theorem to exactly compute the gradient during training, without relying on the entire optimization path. By focusing solely on the optimal solution, rather than the path, we can meta-train with less storage complexity and fewer approximations than other contemporary meta-learning algorithms. We demonstrate through numerical examples that our proposed method can yield accurate predictive models by adaptation, resulting in a downstream MPC that outperforms several baselines.

Learning Based NMPC Adaptation for Autonomous Driving using Parallelized Digital Twin

Sim2real for Autonomous Vehicle Control using Executable Digital Twin

Real-time Nonlinear MPC Strategy with Full Vehicle Validation for Autonomous Driving

A Learning-Based Nonlinear Model Predictive Control Approach for Autonomous Driving

Real-time MPC with Control Barrier Functions for Autonomous Driving using Safety Enhanced Collocation

Online Adaptation of Learned Vehicle Dynamics Model with Meta-Learning Approach

Reinforcement Learning from Simulation to Real World Autonomous Driving using Digital Twin

Agile Mobility with Rapid Online Adaptation via Meta-learning and Uncertainty-aware MPPI

PlanNetX: Learning an Efficient Neural Network Planner from MPC for Longitudinal Control

Parallel Nonlinear Model Predictive Controller for Real-Time Path Tracking of Autonomous Vehicle

Real-Time Drift-Driving Control for an Autonomous Vehicle: Learning from Nonlinear Model Predictive Control via a Deep Neural Network

First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling

Fast Solution of Adaptive Dynamic Programming for Intelligent Vehicle Predictive Controller

NeuroSMPC: A Neural Network guided Sampling Based MPC for On-Road Autonomous Driving

Discrete-time Finite Horizon Adaptive Dynamic Programming for Autonomous Vehicle Control

Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control

MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Models

Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Driving

Safe and Near-Optimal Policy Learning for Model Predictive Control using Primal-Dual Neural Networks

Multi-scenario Learning MPC for Automated Driving in Unknown and Changing Environments.

Iterative Semi-parametric Dynamics Model Learning For Autonomous Racing