Abstract:In this work we provide a computationally tractable procedure for designing affine control policies, applied to constrained, discrete-time, partially observable, linear systems subject to set bounded disturbances, stochastic noise and potentially Markovian switching over a finite horizon. We investigate the situation when performance specifications are expressed via averaged quadratic inequalities on the random state-control trajectory. Our methodology also applies to steering the density of the state-control trajectory under set bounded uncertainty. Our developments are based on expanding the notion of affine policies that are functions of the so-called "purified outputs", to the class of Markov jump linear systems. This re-parametrization of the set of policies, induces a bi-affine structure in the state and control variables that can further be exploited via robust optimization techniques, with the approximate inhomogeneous $S$-lemma being the cornerstone. Tractability is understood in the sense that for each type of performance specification considered, an explicit convex program for selecting the parameters specifying the control policy is provided. Our contributions to the existing literature on the subject of robust constrained control lies in the fact that we are addressing a wider class of systems than the ones already studied, by including Markovian switching, and the consideration of quadratic inequalities rather than just linear ones. Our work expands on the previous investigations on finite horizon covariance control by addressing the robustness issue and the possibility that the full state may not be available, therefore enabling the steering of the state-control trajectory density in the presence of disturbances under partial observation.

Well-posedness of the shooting algorithm for control-affine problems with a scalar state constraint

A shooting algorithm for problems with singular arcs

Stochastic Linear-quadratic Control Problems with Affine Constraints

Stochastic linear–quadratic control problems with affine constraints

Direct Shooting Method for Numerical Optimal Control: A Modified Transcription Approach

Local Convergence Behaviour of Generalized Gauss-Newton Multiple Shooting, Single Shooting and Differential Dynamic Programming

Optimal Control of Constrained Stochastic Linear-Quadratic Model with Applications

Fixed boundary dynamic optimization algorithm based on multiple shooting method and control parameterization method

On Continuous-Time Constrained Stochastic Linear–quadratic Control

Inequality Constrained Trajectory Optimization with A Hybrid Multiple-shooting iLQR

A posteriori error estimates for a bang-bang optimal control problem

Robust affine control of linear stochastic systems

Finite-horizon Covariance Control of State-Affine Nonlinear Systems with Application to Proton Beamline Calibration

Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

Stability and genericity of bang-bang controls in affine problems

ON THE BANG-BANG PRINCIPLE FOR PARABOLIC OPTIMAL CONTROL PROBLEMS

Singularity-Free Finite-Time Adaptive Optimal Control for Constrained Coordinated Uncertain Robots

Saturated Adaptive Output-Constrained Control of Cooperative Spacecraft Rendezvous and Docking

Adjoint System in the Shooting Method to Solve Boundary Value Problems