Abstract:We consider the problem of data-driven stochastic optimal control of an unknown LTI dynamical system. Assuming the process noise is normally distributed, we pose the problem of steering the state's mean and covariance to a target normal distribution, under noisy data collected from the underlying system, a problem commonly referred to as covariance steering (CS). A novel framework for Data-driven Uncertainty quantification and density STeering (DUST) is presented that simultaneously characterizes the noise affecting the measured data and designs an optimal affine-feedback controller to steer the density of the state to a prescribed terminal value. We use both indirect and direct data-driven design approaches based on the notions of persistency of excitation and subspace predictors to exactly represent the mean and covariance dynamics of the state in terms of the data and noise realizations. Since both the mean and the covariance steering sub-problems are plagued with distributional uncertainty arising from noisy data collection, we first estimate the noise realization from this dataset and subsequently compute tractable upper bounds on the estimation errors. The moment steering problems are then solved to optimality using techniques from robust control and robust optimization. Lastly, we present an alternative control design approach based on the certainty equivalence principle and interpret the problem as one of CS under multiplicative uncertainties. We analyze the performance and efficacy of each of these data-driven approaches using a case study and compare them with their model-based counterparts.

DUST: A Framework for Data-Driven Density Steering

Data-Driven Covariance Steering Control Design

Probabilistic Tracking Control of Dissipated Hamiltonian Systems Excited by Gaussian White Noises.

Data-Driven Robust Covariance Control for Uncertain Linear Systems

Data-Driven Method for Response Control of Nonlinear Random Dynamical Systems

Distributionally Robust Density Control with Wasserstein Ambiguity Sets

Density Steering by Power Moments

Optimal Covariance Steering for Continuous-Time Linear Stochastic Systems With Additive Noise

Density Steering of Gaussian Mixture Models for Discrete-Time Linear Systems

Distributionally Robust Stochastic Data-Driven Predictive Control with Optimized Feedback Gain

Reliability Control of Nonlinear Stochastic Dynamical System Based on Discrete Data

Causality-Informed Data-Driven Predictive Control

Adaptive Fuzzy Predefined-Time Dynamic Surface Control for Attitude Tracking of Spacecraft with State Constraints.

Robust Data-Driven Safe Control using Density Functions

Data-Driven Distributionally Robust Optimal Control with State-Dependent Noise

Distributionally robust uncertainty quantification via data-driven stochastic optimal control

Probabilistic Control for Uncertain Systems

Bias correction and instrumental variables for direct data-driven model-reference control

Optimal Covariance Steering of Linear Stochastic Systems with Hybrid Transitions

Robust Direct Data-Driven Control for Probabilistic Systems

Backstepping Mean-Field Density Control for Large-Scale Heterogeneous Nonlinear Stochastic Systems