Abstract:We consider the problem of finite-horizon optimal control design under uncertainty for imperfectly observed discrete-time systems with convex costs and constraints. It is known that this problem can be cast as an infinite-dimensional convex program when the dynamics and measurements are linear, uncertainty is additive, and the risks associated with constraint violations and excessive costs are measured in expectation or in the worst case. In this paper, we extend this result to systems with convex or concave dynamics, nonlinear measurements, more general uncertainty structures and other coherent risk measures. In this setting, the optimal control problem can be cast as an infinite-dimensional convex program if (1) the costs, constraints and dynamics satisfy certain monotonicity properties, and (2) the measured outputs can be reversibly `purified' of the influence of the control inputs through Q- or Youla-parameterization. The practical value of this result is that the finite-dimensional subproblems arising in a variety of suboptimal control methods, notably including model predictive control and the Q-design procedure, are also convex for this class of nonlinear systems. Subproblems can therefore be solved to global optimality using convenient modeling software and efficient, reliable solvers. We illustrate these ideas in a numerical example.

Infinite-Horizon Linear-Quadratic-Gaussian Control with Costly Measurements

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Optimal Rgcc Control With H-Infinity Norm And Control Input Constraints

Suboptimal Reliable Guaranteed Cost Control for Continuous-Time Systems with Multi-Criterion Constraints

Decentralized Control of Linear Systems with Private Input and Measurement Information

Subset Measurement Selection for Globally Self-Optimizing Control of Tennessee Eastman Process

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Finite-Horizon Optimal Control of Discrete-Time Switched Linear Systems

Continuous-Time Dynamic Decision Making with Costly Information

Near-Optimal Control for Time-Varying Linear Discrete Systems with Additive Nonlinearities and Random Gains

Convexity and monotonicity in nonlinear optimal control under uncertainty

Optimal quantized feedback control for linear quandratic Gaussian systems with input delay

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

Prescribed Time Dual-Mode Extremum Seeking Control

Optimal control of continuous-time symmetric systems with unknown dynamics and noisy measurements

A Finite-Horizon Inverse Linear Quadratic Optimal Control Method for Human-in-the-Loop Behavior Learning

On the Optimal Solutions of the Infinite-Horizon Linear Sensor Scheduling Problem

Stochastic LQ Control with Extra Measurability Restriction

Optimal Controller and Quantizer Selection for Partially Observable Linear-Quadratic-Gaussian Systems