Abstract:In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and potentially Markovian switching over a finite horizon. We investigate the situation when performance specifications are expressed via averaged quadratic inequalities on the random state-control trajectory. Our methodology also applies to steering the density of the state-control trajectory under set bounded uncertainty. Our developments are based on expanding the notion of affine policies that are functions of the so-called "purified outputs", to the class of Markov jump linear systems. This re-parametrization of the set of policies, induces a bi-affine structure in the state and control variables that can further be exploited via robust optimization techniques, with the approximate inhomogeneous $S$-lemma being the cornerstone. Tractability is understood in the sense that for each type of performance specification considered, an explicit convex program for selecting the parameters specifying the control policy is provided. Our contributions to the existing literature on the subject of robust constrained control lies in the fact that we are addressing a wider class of systems than the ones already studied, by including Markovian switching, and the consideration of quadratic inequalities rather than just linear ones. Our work expands on the previous investigations on finite horizon covariance control by addressing the robustness issue and the possibility that the full state may not be available, therefore enabling the steering of the state-control trajectory density in the presence of disturbances under partial observation.

Robust Time-inconsistent Linear-Quadratic Stochastic Controls: A Stochastic Differential Game Approach

Robust control for a class of uncertain time-varying time-delay systems with actuator limit

A Nash-Type Fictitious Game Framework to Time-Inconsistent Stochastic Control Problems

Equilibrium Controls in Time Inconsistent Stochastic Linear Quadratic Problems

A theory of Markovian time-inconsistent stochastic control in discrete time

Subgame-perfect equilibrium strategies for time-inconsistent recursive stochastic control problems

A robust stochastic control problem with applications to monotone mean-variance problems

Stochastic Linear-Quadratic Stackelberg Differential Game with Asymmetric Informational Uncertainties: Robust Optimization Approach

Optimal Control of Robust Team Stochastic Games

Time-inconsistent linear quadratic optimal control problem for forward–backward stochastic differential equations

Adaptive Stabilization of Noncooperative Stochastic Differential Games

Time-inconsistent Linear Quadratic Optimal Control Problem for Forward-Backward Stochastic Differential Equations

Robust Stackelberg Differential Game with Model Uncertainty

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

Robust affine control of linear stochastic systems

Stochastic Intermittent Control with Uncertainty

Strong and Weak Equilibria for Time-Inconsistent Stochastic Control in Continuous Time

A Linear Quadratic Partially Observed Stackelberg Stochastic Differential Game with Applications

Distributionally robust stochastic optimal control

Nonlocality, Nonlinearity, and Time Inconsistency in Stochastic Differential Games

Stochastic Adaptive Linear Quadratic Differential Games