Abstract:This paper proposes an iterative distributionally robust model predictive control (MPC) scheme to solve a risk-constrained infinite-horizon optimal control problem. In each iteration, the algorithm generates a trajectory from the starting point to the target equilibrium state with the aim of respecting risk constraints with high probability (that encodes safe operation of the system) and improving the cost of the trajectory as compared to previous iterations. At the end of each iteration, the visited states and observed samples of the uncertainty are stored and accumulated with the previous observations. For each iteration, the states stored previously are considered as terminal constraints of the MPC scheme, and samples obtained thus far are used to construct distributionally robust risk constraints. As iterations progress, more data is obtained and the environment is explored progressively to ensure better safety and cost optimality. We prove that the MPC scheme in each iteration is recursively feasible and the resulting trajectories converge asymptotically to the target while ensuring safety with high probability. We identify conditions under which the cost-to-go reduces as iterations progress. For systems with locally one-step reachable target, we specify scenarios that ensure finite-time convergence of iterations. We provide computationally tractable reformulations of the risk constraints for total variation and Wasserstein distance-based ambiguity sets. A simulation example illustrates the application of our results in finding a risk-constrained path for two mobile robots facing an uncertain obstacle.

Approximate solution of stochastic infinite horizon optimal control problems for constrained linear uncertain systems

Chance Constrained Nonlinear Model Predictive Control

An Adaptive Model Predictive Control Strategy for a Class of Discrete‐time Linear Systems with Parametric Uncertainty

Predictive Control with Learning-Based Terminal Costs Using Approximate Value Iteration

Model Predictive Control for Uncertain Systems

Stability and Performance Analysis of Model Predictive Control of Uncertain Linear Systems

Parallel Model Predictive Control for Deterministic Systems

Iterative risk-constrained model predictive control: A data-driven distributionally robust approach

On the Finite-Time Behavior of Suboptimal Linear Model Predictive Control

Finite-Time Stabilization for Constrained Discrete-time Systems by Using Model Predictive Control

Stochastic Data-Driven Predictive Control with Equivalence to Stochastic MPC

Approximate infinite-horizon predictive control

Model predictive control: past, present and future

Performance Bounds of Model Predictive Control for Unconstrained and Constrained Linear Quadratic Problems and Beyond

Approximate Dynamic Programming based Model Predictive Control of Nonlinear systems

Adaptive Economic Model Predictive Control: Performance Guarantees for Nonlinear Systems

Local Stability and Convergence of Unconstrained Model Predictive Control

Risk-averse model predictive control

Model predictive control with robust feasibility

Adaptive MPC for Iterative Tasks

A Multilevel Approach for Stochastic Nonlinear Optimal Control