Abstract:Inverse optimal control (IOC) seeks to infer a control cost function that captures the underlying goals and preferences of expert demonstrations. While significant progress has been made in finite-horizon IOC, which focuses on learning control cost functions based on rollout trajectories rather than actual trajectories, the application of IOC to receding horizon control, also known as model predictive control (MPC), has been overlooked. MPC is more prevalent in practical settings and poses additional challenges for IOC learning since it is complicated to calculate the gradient of actual trajectories with respect to cost parameters. In light of this, we propose the inverse MPC (IMPC) method to identify the optimal cost function that effectively minimizes the discrepancy between the actual trajectory and its associated demonstration. To compute the gradient of actual trajectories with respect to cost parameters, we first establish two differential Pontryagin's maximum principle (PMP) conditions by differentiating the traditional PMP conditions with respect to cost parameters and initial states, respectively. We then formulate two auxiliary optimal control problems based on the derived differentiated PMP conditions, whose solutions can be directly used to determine the gradient for updating cost parameters. We validate the efficacy of the proposed method through experiments involving five simulation tasks and two real-world mobile robot control tasks. The results consistently demonstrate that IMPC outperforms existing finite-horizon IOC methods across all experiments.

Learning Convex Terminal Costs for Complexity Reduction in MPC

A Pragmatic Approach for Assessing the Economic Performance of Model Predictive Control Systems and Its Industrial Application

Learning Lyapunov terminal costs from data for complexity reduction in nonlinear model predictive control

A Low-Cost Pole-Placement MPC Algorithm for Controlling Complex Dynamic Systems

Predictive Control with Learning-Based Terminal Costs Using Approximate Value Iteration

Learning a convex cost-to-go for single step model predictive control

Stable MPC with maximal terminal sets and quadratic terminal costs

On the Finite-Time Behavior of Suboptimal Linear Model Predictive Control

Regret Analysis of Learning-Based MPC With Partially-Unknown Cost Function

On performance bound estimation in NMPC with time-varying terminal cost

Linearly discounted economic MPC without terminal conditions for periodic optimal operation

On the Stability of Constrained MPC Without Terminal Constraint

Inverse Model Predictive Control: Learning Optimal Control Cost Functions for MPC

Learning the cost-to-go for mixed-integer nonlinear model predictive control

Stabilizing Terminal Constraint-Free Nonlinear MPC Via Sliding Mode-Based Terminal Cost

Getting a Suitable Terminal Cost and Maximizing the Terminal Region for MPC

Fast Linear Parameter Varying Model Predictive Control of Buck DC-DC Converters Based on FPGA.

Performance Bounds of Model Predictive Control for Unconstrained and Constrained Linear Quadratic Problems and Beyond

Stability-informed Bayesian Optimization for MPC Cost Function Learning

DiffTune-MPC: Closed-Loop Learning for Model Predictive Control

Approximate solution of stochastic infinite horizon optimal control problems for constrained linear uncertain systems