Abstract:In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and potentially Markovian switching over a finite horizon. We investigate the situation when performance specifications are expressed via averaged quadratic inequalities on the random state-control trajectory. Our methodology also applies to steering the density of the state-control trajectory under set bounded uncertainty. Our developments are based on expanding the notion of affine policies that are functions of the so-called "purified outputs", to the class of Markov jump linear systems. This re-parametrization of the set of policies, induces a bi-affine structure in the state and control variables that can further be exploited via robust optimization techniques, with the approximate inhomogeneous $S$-lemma being the cornerstone. Tractability is understood in the sense that for each type of performance specification considered, an explicit convex program for selecting the parameters specifying the control policy is provided. Our contributions to the existing literature on the subject of robust constrained control lies in the fact that we are addressing a wider class of systems than the ones already studied, by including Markovian switching, and the consideration of quadratic inequalities rather than just linear ones. Our work expands on the previous investigations on finite horizon covariance control by addressing the robustness issue and the possibility that the full state may not be available, therefore enabling the steering of the state-control trajectory density in the presence of disturbances under partial observation.

Stability and genericity of bang-bang controls in affine problems

Stability and Genericity of Bang-Bang Controls in Affine Problems

Robust Absolute Stability For General Neutral Type Lurie Indirect Control Systems

Decompositions and bang-bang properties

Stability in affine optimal control problems constrained by semilinear elliptic partial differential equations

Stability analysis of the Navier-Stokes velocity tracking problem with bang-bang controls

Stability analysis of the Navier–Stokes velocity tracking problem with bang-bang controls

A posteriori error estimates for a bang-bang optimal control problem

A New Smoothing Technique for Bang-Bang Optimal Control Problems

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Multistage Uncertain Random Bang-Bang Optimal Control

Infeasible and Critically Feasible Optimal Control

ON THE BANG-BANG PRINCIPLE FOR PARABOLIC OPTIMAL CONTROL PROBLEMS

Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

Solving Bang-Bang Problems Using The Immersed Interface Method and Integer Programming

Time-varying Bang–bang Property of Time Optimal Controls for Heat Equation and Its Application

Generic Solutions to Controlled Balance Laws

Generic properties of conjugate points in optimal control problems

Attainable Subspaces and the Bang-Bang Property of Time Optimal Controls for Heat Equations.

Robust affine control of linear stochastic systems