Abstract:We consider the problem of data-driven stochastic optimal control of an unknown LTI dynamical system. Assuming the process noise is normally distributed, we pose the problem of steering the state's mean and covariance to a target normal distribution, under noisy data collected from the underlying system, a problem commonly referred to as covariance steering (CS). A novel framework for Data-driven Uncertainty quantification and density STeering (DUST) is presented that simultaneously characterizes the noise affecting the measured data and designs an optimal affine-feedback controller to steer the density of the state to a prescribed terminal value. We use both indirect and direct data-driven design approaches based on the notions of persistency of excitation and subspace predictors to exactly represent the mean and covariance dynamics of the state in terms of the data and noise realizations. Since both the mean and the covariance steering sub-problems are plagued with distributional uncertainty arising from noisy data collection, we first estimate the noise realization from this dataset and subsequently compute tractable upper bounds on the estimation errors. The moment steering problems are then solved to optimality using techniques from robust control and robust optimization. Lastly, we present an alternative control design approach based on the certainty equivalence principle and interpret the problem as one of CS under multiplicative uncertainties. We analyze the performance and efficacy of each of these data-driven approaches using a case study and compare them with their model-based counterparts.

Data-Driven Covariance Steering Control Design

Data-Driven Robust Covariance Control for Uncertain Linear Systems

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Optimal Covariance Steering for Continuous-Time Linear Stochastic Systems With Additive Noise

DUST: A Framework for Data-Driven Density Steering

Optimal Covariance Steering for Discrete-Time Linear Stochastic Systems

Covariance Steering for Systems Subject to Unknown Parameters

Covariance Steering of Discrete-Time Linear Systems with Mixed Multiplicative and Additive Noise

Adaptive Dual Covariance Steering with Active Parameter Estimation

Optimal Covariance Steering of Linear Stochastic Systems with Hybrid Transitions

Discrete-time Optimal Covariance Steering via Semidefinite Programming

Bias correction and instrumental variables for direct data-driven model-reference control

Distributionally Robust Covariance Steering with Optimal Risk Allocation

Nonlinear Covariance Steering using Variational Gaussian Process Predictive Models

Computationally Efficient Chance Constrained Covariance Control with Output Feedback

Covariance Control of Discrete-Time Gaussian Linear Systems Using Affine Disturbance Feedback Control Policies

Stochastic Model Predictive Control for Constrained Linear Systems Using Optimal Covariance Steering

Causality-Informed Data-Driven Predictive Control

Input Hard Constrained Optimal Covariance Steering

Covariance Steering for Uncertain Contact-rich Systems

Constrained minimum variance and covariance steering based on affine disturbance feedback control parameterization