Abstract:This paper is concerned with a stochastic linear-quadratic (LQ) control problem in the infinite time horizon where the control is constrained in a given, arbitrary closed cone, the cost weighting matrices are allowed to be indefinite, and the state is scalar-valued. First, the (mean-square, conic) stabilizability of the system is defined, which is then characterized by a set of simple conditions involving linear matrix inequalities (LMIs). Next, the issue of well-posedness of the underlying optimal LQ control, which is necessitated by the indefiniteness of the problem, is addressed in great detail, and necessary and sufficient conditions of the well-posedness are presented. On the other hand, to address the LQ optimality two new algebraic equations a la Riccati, called extended algebraic Riccati equations (EAREs), along with the notion of their stabilizing solutions, are introduced for the first time. Optimal feedback control as well as the optimal value are explicitly derived in terms of the stabilizing solutions to the EAREs. Moreover, several cases when the stabilizing solutions do exist are discussed and algorithms of computing the solutions are presented. Finally, numerical examples are provided to illustrate the theoretical results established.

Open-Loop Time-Consistent Solution for Equality Constrained Time-Inconsistent LQ Problem

An LMI Approach to Robust H-infinity Control for Uncertain Singular Time-Delay Systems

Mixed L 1/H-Infinity Control for Uncertain Linear Singular Systems

Mixed <i>L</i><sub>1</sub>/H-infinity control for uncertain linear singular systems

Optimal Guaranteed Cost Control of Dynamic Interval Systems: an LMI Approach

Singular LQ Sub-Optimal Control Problem for a Class of Discrete-Time Singular Systems with Time-Delay

An Off-line Algorithm of Constrained Predictive Control Model Using Linear Matrix Inequalities

Equilibrium Controls in Time Inconsistent Stochastic Linear Quadratic Problems

Finite Horizon LQR Control with Limited Controller-System Communication

Stochastic Linear-quadratic Control Problems with Affine Constraints

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

Stochastic LQ Optimal Control With Initial and Terminal Constraints

Stochastic linear–quadratic control problems with affine constraints

Time-inconsistent linear quadratic optimal control problem for forward–backward stochastic differential equations

Weak Closed-Loop Solvability of Stochastic Linear-Quadratic Optimal Control Problems

Time-inconsistent Linear Quadratic Optimal Control Problem for Forward-Backward Stochastic Differential Equations

Weak Closed-loop Solvability of Linear Quadratic Stochastic Optimal Control Problems with Partial Information

Constrained Stochastic LQ Optimal Control Problem with Random Coefficients on Infinite Time Horizon

LQ Optimal Control of First-Order Hyperbolic PDE Systems with Final State Constraints

Discrete Time Mean-Field Stochastic Linear-Quadratic Optimal Control Problems

Equilibria for Time-inconsistent Singular Control Problems