Abstract:As it is popular known, Riccati equation is the key basic tool for optimal control in the modern control theory. The solvability conditions of optimal control, stabilization conditions and controller design are all based on the Riccati equation. However, these results highly depends on a strictly assumption that the Riccati equation is regular. If the Riccati equation is irregular, the controller could not be derived from the equilibrium condition. This paper is concerned with the general stochastic linear quadratic (LQ) with irregular Riccati equation. Different from the classical control theory for regular LQ problems, a new approach of `multi-layer optimization' is proposed. With the approach, we show that different controller entries of irregular-LQ controller need to be derived from different equilibrium conditions and a specified terminal constraint condition in different layers, which is much different from the classical regular LQ control where all the controller entries can be obtained from equilibrium condition in one layer based on regular Riccati equation. The presented results clarify the differences of open-loop control from closed-loop control in the aspects of solvability and controller design and also explores in essentially the differences of regular control from irregular control. Several examples are presented to show the effectiveness of the proposed approach.

Analytic Solution to Indefinite Linear Quadratic Regulator for Stochastic Systems

Robust memoryless H/sup /spl infin// control for uncertain linear time-delay systems

Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II

Linear Quadratic Regulation for Discrete-Time Antilinear Systems: an Anti-Riccati Matrix Equation Approach

Solvability and Asymptotic Behavior of Generalized Riccati Equations Arising in Indefinite Stochastic LQ Controls.

Iterative Linear Quadratic Regulator With Variational Equation-Based Discretization

Adaptive Output Feedback Regulation for a Class of Nonlinear Systems Subject to Input and Output Quantization

Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise

Characterizing All Optimal Controls for an Indefinite Stochastic Linear Quadratic Control Problem

General Lyapunov-Based Iterative Algorithm for Linear Quadratic Regulator Problem of Stochastic Systems with Markovian Jump

Design of Suboptimal Constrained Nonlinear Quadratic Regulator Via Invariant Sets Switching

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

On Irregular Linear Quadratic Control: Stochastic Case

Indefinite Robust Linear Quadratic Optimal Regulator for Discrete-Time Uncertain Singular Markov Jump Systems

The Quadratic-Quadratic Regulator Problem: Approximating feedback controls for quadratic-in-state nonlinear systems

Design and analysis of constrained nonlinear quadratic regulator.

Infinite-horizon Risk-constrained Linear Quadratic Regulator with Average Cost

Extending iLQR method with control delay

Linear Quadratic Problem with Unbounded Control in Hilbert Spaces

Stochastic linear quadratic optimal control problems with regime-switching jumps in infinite horizon

Stochastic linear-quadratic optimal control problems with non-Markovian regime switching