Abstract:This paper is concerned with a stochastic linear-quadratic (LQ) control problem in the infinite time horizon where the control is constrained in a given, arbitrary closed cone, the cost weighting matrices are allowed to be indefinite, and the state is scalar-valued. First, the (mean-square, conic) stabilizability of the system is defined, which is then characterized by a set of simple conditions involving linear matrix inequalities (LMIs). Next, the issue of well-posedness of the underlying optimal LQ control, which is necessitated by the indefiniteness of the problem, is addressed in great detail, and necessary and sufficient conditions of the well-posedness are presented. On the other hand, to address the LQ optimality two new algebraic equations a la Riccati, called extended algebraic Riccati equations (EAREs), along with the notion of their stabilizing solutions, are introduced for the first time. Optimal feedback control as well as the optimal value are explicitly derived in terms of the stabilizing solutions to the EAREs. Moreover, several cases when the stabilizing solutions do exist are discussed and algorithms of computing the solutions are presented. Finally, numerical examples are provided to illustrate the theoretical results established.

On the Algebraic Approach to H∞ Control

H-Infinity Control for Linear Systems with State Saturation Nonlinearities

An LMI Approach to Robust H-infinity Control for Uncertain Singular Time-Delay Systems

Mixed L 1/H-Infinity Control for Uncertain Linear Singular Systems

H-Infinity Output Feedback Control with Alpha-Stability Constraint for Uncertain Linear Time-Delay Systems-An Lmi Approach

Mixed <i>L</i><sub>1</sub>/H-infinity control for uncertain linear singular systems

Necessary and Sufficient Condition for Robust H∞ Control of Dynamic Interval Systems

Alpha-Robust H Infinity State Feedback Control for a Class of Linear Parameter-Varying Systems.

Robust memoryless H∞ control for uncertain linear time-delay systems

An Algebra Approach in H_∞ System Identification

An algebraic Riccati equation approach to

H2 control for sampled-data systems

On mixed H2/H∞ control

Solvability and Asymptotic Behavior of Generalized Riccati Equations Arising in Indefinite Stochastic LQ Controls.

L2 Approach and Constrained Robust Control for Nonlinear Systems

H-Infinity Control Of Networked Control Systems Via Lmi Approach

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

An approximation approach to decentralized H∞ control

An LMI approach to design H(infinity) controllers for discrete-time nonlinear systems based on unified models

On Mixed H2 and H-infinite Control

LMI approach to linear positive system analysis and synthesis