Abstract:In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and potentially Markovian switching over a finite horizon. We investigate the situation when performance specifications are expressed via averaged quadratic inequalities on the random state-control trajectory. Our methodology also applies to steering the density of the state-control trajectory under set bounded uncertainty. Our developments are based on expanding the notion of affine policies that are functions of the so-called "purified outputs", to the class of Markov jump linear systems. This re-parametrization of the set of policies, induces a bi-affine structure in the state and control variables that can further be exploited via robust optimization techniques, with the approximate inhomogeneous $S$-lemma being the cornerstone. Tractability is understood in the sense that for each type of performance specification considered, an explicit convex program for selecting the parameters specifying the control policy is provided. Our contributions to the existing literature on the subject of robust constrained control lies in the fact that we are addressing a wider class of systems than the ones already studied, by including Markovian switching, and the consideration of quadratic inequalities rather than just linear ones. Our work expands on the previous investigations on finite horizon covariance control by addressing the robustness issue and the possibility that the full state may not be available, therefore enabling the steering of the state-control trajectory density in the presence of disturbances under partial observation.

Stochastic Linear-quadratic Control Problems with Affine Constraints

Stochastic linear–quadratic control problems with affine constraints

Lagrangian dual method for solving stochastic linear quadratic optimal control problems with terminal state constraints

Optimal Control of Constrained Stochastic Linear-Quadratic Model with Applications

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients: Closed-Loop Representation of Open-Loop Optimal Controls

On Continuous-Time Constrained Stochastic Linear–quadratic Control

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints

Stochastic Optimal Control and Linear Programming Approach

Time-Inconsistent Discrete-Time Stochastic Linear-Quadratic Optimal Control : Time-consistent Solutions

Linear Quadratic Problem with Unbounded Control in Hilbert Spaces

Linear quadratic problems for fully coupled forward-backward stochastic control systems.

Linear-quadratic Stochastic Stackelberg Differential Games with Affine Constraints

A Symplectic Pseudospectral Method for Nonlinear Optimal Control Problems with Inequality Constraints

Stochastic Optimal Control Problems with Control and Initial-Final States Constraints

Mean-field stochastic linear quadratic control problem with random coefficients

Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients and Markovian Regime Switching System

Robust affine control of linear stochastic systems

Stochastic Control with Affine Dynamics and Extended Quadratic Costs

Parametric Variational Solution of Linear-Quadratic Optimal Control Problems with Control Inequality Constraints