Abstract:In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and potentially Markovian switching over a finite horizon. We investigate the situation when performance specifications are expressed via averaged quadratic inequalities on the random state-control trajectory. Our methodology also applies to steering the density of the state-control trajectory under set bounded uncertainty. Our developments are based on expanding the notion of affine policies that are functions of the so-called "purified outputs", to the class of Markov jump linear systems. This re-parametrization of the set of policies, induces a bi-affine structure in the state and control variables that can further be exploited via robust optimization techniques, with the approximate inhomogeneous $S$-lemma being the cornerstone. Tractability is understood in the sense that for each type of performance specification considered, an explicit convex program for selecting the parameters specifying the control policy is provided. Our contributions to the existing literature on the subject of robust constrained control lies in the fact that we are addressing a wider class of systems than the ones already studied, by including Markovian switching, and the consideration of quadratic inequalities rather than just linear ones. Our work expands on the previous investigations on finite horizon covariance control by addressing the robustness issue and the possibility that the full state may not be available, therefore enabling the steering of the state-control trajectory density in the presence of disturbances under partial observation.

Signalling and Control in Nonlinear Stochastic Systems: An Information State Approach with Applications

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Optimal Control and Signaling Strategies of Control-Coding Capacity of General Decision Models: Applications to Gaussian Models and Decentralized Strategies

A stochastic optimal control strategy for partially observable nonlinear systems

Optimal control of linear stochastic systems with applications to time lag systems

Approximate Optimal Control over Unreliable Communication Channels

Stochastic Control with Signatures

Weak Closed-loop Solvability of Linear Quadratic Stochastic Optimal Control Problems with Partial Information

Optimal Local and Remote Controls of Multiple Systems with Multiplicative Noises and Unreliable Uplink Channels

A Control Approach for Nonlinear Stochastic State Uncertain Systems with Probabilistic Safety Guarantees

Stochastic Control with Stale Information--Part I: Fully Observable Systems

Distributionally Robust Linear Quadratic Control

On Feedback Control of Linear Stochastic Systems

An Information-state based Approach to the Optimal Output Feedback Control of Nonlinear Systems

A Polynomial Chaos Approach to Stochastic LQ Optimal Control: Error Bounds and Infinite-Horizon Results

Robust affine control of linear stochastic systems

Optimal Control of Constrained Stochastic Linear-Quadratic Model with Applications

Optimal Bilinear Control of Nonlinear Stochastic Schrödinger Equations Driven by Linear Multiplicative Noise

Linear Quadratic Control with Risk Constraints

Continuous time Stochastic optimal control under discrete time partial observations

Optimal Mean Decentralized Controller Design of Interconnected Systems with Randomized Information Pattern