Abstract:This article proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of distributional system uncertainty via a parameterized, control-dependent ambiguity set using a finite historical dataset, and its use to make online decisions with probabilistic regret function bounds. Leveraging the merits of machine learning, the main technical approach relies on the theory of distributional robust optimization (DRO), to hedge against uncertainty and provide less conservative results than standard robust optimization approaches. Starting from recent results that describe ambiguity sets via parameterized, and control-dependent empirical distributions as well as ambiguity radii, we first present a tractable reformulation of the corresponding optimization problem while maintaining the probabilistic guarantees. We then specialize these problems to the cases of 1) optimal one-stage control of distributionally uncertain nonlinear systems, and 2) resource allocation under distributional uncertainty. A novelty of this work is that it extends DRO to online optimization problems subject to a distributionally uncertain dynamical system constraint, handled via a control-dependent ambiguity set that leads to online-tractable optimization with probabilistic guarantees on regret bounds. Further, we introduce an online version of the Nesterov's accelerated-gradient algorithm, and analyze its performance to solve this class of problems via the dissipativity theory.

Optimal Agnostic Control of Unknown Linear Dynamics in a Bounded Parameter Range

Almost Optimal Agnostic Control of Unknown Linear Dynamics

Controlling Unknown Linear Dynamics with Almost Optimal Regret

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Stochastic Optimal Control as Approximate Input Inference

Optimal control under unknown intensity with Bayesian learning

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

Episodic Bayesian Optimal Control with Unknown Randomness Distributions

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States

Learning-based Optimal Control for Linear Systems with Model Uncertainties

Worst-Case Control and Learning Using Partial Observations Over an Infinite Time-Horizon

Regret Optimal Control for Uncertain Stochastic Systems

Tracking optimal feedback control under uncertain parameters

Online Optimization and Ambiguity-Based Learning of Distributionally Uncertain Dynamic Systems

Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs

Regret-optimal control in dynamic environments

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Distributionally robust uncertainty quantification via data-driven stochastic optimal control

Optimal control of a linear system with multiplicative noise at control parameter