Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

LMI optimization for nonstandard Riccati equations arising in stochastic control

An LMI Approach to Robust H-infinity Control for Uncertain Singular Time-Delay Systems

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Robust memoryless H∞ control for uncertain linear time-delay systems

H-Infinity Output Feedback Control with Alpha-Stability Constraint for Uncertain Linear Time-Delay Systems-An Lmi Approach

Decentralized output feedback control of large-scale interconnected nonlinear systems: the lmi approach

Reliable H∞ Control for Uncertain Time-Delay Systems Using LMI

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Solvability and Asymptotic Behavior of Generalized Riccati Equations Arising in Indefinite Stochastic LQ Controls.

Designing of the robust stabilizing controller for uncertain delay systems - LMI approach

Linear Quadratic Optimal Control of Discrete-Time Stochastic Systems Driven by Homogeneous Markov Processes

Robust Structured Control Design via LMI Optimization

ROBUST H∞ CONTROL OF UNCERTAIN MARKOVIAN JUMP LINEAR SYSTEMS WITH MODE-DEPENDENT TIME-DELAYS

An LMI-Based Algorithm to Compute Robust Stabilizing Feedback Gains Directly as Optimization Variables

Non-homogeneous stochastic linear-quadratic optimal control problems with multi-dimensional state and regime switching

Riccati equations and optimal control of well-posed linear systems

LMI optimization approach to robust decentralized controller design

On Irregular Linear Quadratic Control: Stochastic Case

Minimization of Risk and Linear Quadratic Optimal Control Theory.

Linear-Quadratic Problems in Systems and Controls via Covariance Representations and Linear-Conic Duality: Finite-Horizon Case

A collection of robust control problems leading to LMIs