Abstract:This paper deals with finite‐horizon minimum‐variance and covariance steering problems subject to constraints. The goal of the minimum variance problem is to steer the state mean of an uncertain system to a prescribed vector while minimizing the trace of its terminal state covariance whereas the goal in the covariance steering problem is to steer the covariance matrix of the terminal state to a prescribed positive definite matrix. The paper proposes a solution approach that relies on a stochastic version of the affine disturbance feedback control parametrization. In this control policy parametrization, the control input at each stage is expressed as an affine function of the history of disturbances that have acted upon the system. It is shown that this particular parametrization reduces the stochastic optimal control problems considered in this paper into tractable convex programs or difference of convex functions programs with essentially the same decision variables. In addition, the paper proposes a variation of this control parametrization that relies on truncated histories of past disturbances, which allows for sub‐optimal controllers to be designed that strike a balance between performance and computational cost. The suboptimality of the truncated policies is formally analyzed and closed form expressions are provided for the performance loss due to the use of the truncation scheme. Finally, the paper concludes with a comparative analysis of the truncated versions of the proposed policy parametrization and other standard policy parametrizations through numerical simulations.

Covariance Steering for Systems Subject to Unknown Parameters

Adaptive Dual Covariance Steering with Active Parameter Estimation

Optimal Covariance Steering for Continuous-Time Linear Stochastic Systems With Additive Noise

Optimal Covariance Steering for Discrete-Time Linear Stochastic Systems

Data-Driven Robust Covariance Control for Uncertain Linear Systems

Data-Driven Covariance Steering Control Design

Nonlinear Covariance Steering using Variational Gaussian Process Predictive Models

Covariance Steering for Uncertain Contact-rich Systems

Covariance Steering of Discrete-Time Linear Systems with Mixed Multiplicative and Additive Noise

Optimal Covariance Steering of Linear Stochastic Systems with Hybrid Transitions

Discrete-time Optimal Covariance Steering via Semidefinite Programming

Input Hard Constrained Optimal Covariance Steering

Stochastic Model Predictive Control for Constrained Linear Systems Using Optimal Covariance Steering

Constrained minimum variance and covariance steering based on affine disturbance feedback control parameterization

Distributionally Robust Covariance Steering with Optimal Risk Allocation

Adaptive Neural Control for Stochastic Nonholonomic Systems with Full-State Constraints and Unknown Covariance Noise

Stochastic Optimal Control For Gaussian Disturbances with Unknown Mean and Variance Based on Sample Statistics

Steering Angle Control of Steer-by-Wire Systems Considering Nonlinear Characteristic and Uncertainty Parameters

Multi-Objective Optimal Control with Arbitrary Additive and Multiplicative Noise

Adaptive Tracking Control for Stochastic Nonlinear Systems with Full-State Constraints and Unknown Covariance Noise

Decentralized adaptive control of large‐scale time‐varying stochastic nonlinear systems with unknown covariance