Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Generalized Hamilton-Jacobi-Bellman Equations with Dirichlet Boundary Condition and Stochastic Exit Time Optimal Control Problem

Optimal Bounded Control of First-Passage Failure of Quasi-Integrable Hamiltonian Systems with Wide-Band Random Excitation

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

Stochastic Recursive Optimal Control of McKean-Vlasov Type: A Viscosity Solution Approach

Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Optimal Controls of Stochastic Differential Equations with Jumps and Random Coefficients: Stochastic Hamilton–Jacobi–Bellman Equations with Jumps

Dynamic Programming Principle and Hamilton-Jacobi-Bellman Equation under Nonlinear Expectation

A Stochastic Recursive Optimal Control Problem under the G-expectation Framework

Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients

Pathwise Stochastic Control Problems and Stochastic HJB Equations

Stochastic Optimization Theory of Backward Stochastic Differential Equations with Jumps and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations

Backward Stochastic Differential Equations Coupled with Value Function and Related Optimal Control Problems

A stochastic hybrid optimal control with regime switching and recursive cost functional

General Linear Quadratic Optimal Stochastic Control Problem Driven by a Brownian Motion and a Poisson Random Martingale Measure with Random Coefficients

Dynamic Programming Principle for Backward Doubly Stochastic Recursive Optimal Control Problem and Sobolev Weak Solution of the Stochastic Hamilton-Jacobi-Bellman Equation

Generalized Risk-Sensitive Optimal Control and Hamilton–Jacobi–Bellman Equation

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Regularity Properties For General Hjb Equations: A Backward Stochastic Differential Equation Method

A Problem of Singular Stochastic Control with Optimal Stopping in Finite Horizon

Note on stochastic control problems related with general fully coupled forward-backward stochastic differential equations