Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Exact Finite-Difference Schemes for D-Dimensional Linear Stochastic Systems with Constant Coefficients

Exact Stationary Solutions Independent of Energy for Strongly Nonlinear Stochastic Systems of Multiple Degrees of Freedom

High-Order Schemes of Exponential Time Differencing for Stiff Systems with Nondiagonal Linear Part

Stochastic C-stability and B-consistency of explicit and implicit Euler-type schemes

Strong convergence and asymptotic stability of explicit numerical schemes for nonlinear stochastic differential equations

Construction Of Difference Schemes For Nonlinear Singular Perturbed Equations By Approximation Of Coefficients

Almost Sure Exponential Stability of Semi-Euler Numerical Scheme for Nonlinear Stochastic Functional Differential Equation.

Finite Difference Models of Dynamical Systems with Quadratic Right-Hand Side

High accuracy least-squares solutions of nonlinear differential equations

An improved Störmer-Verlet method based on exact discretization for nonlinear oscillators

A class of asymptotic-preserving schemes for kinetic equations and related problems with stiff sources

Simulating Stochastic Differential Equations with Conserved Quantities by Improved Explicit Stochastic Runge–Kutta Methods

Convergent finite difference schemes for stochastic transport equations

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Structure-preserving Stochastic Conformal Exponential Integrator for Linearly Damped Stochastic Differential Equations

Compact finite-difference scheme for some Sobolev type equations with Dirichlet boundary conditions

Stable numerical methods for a stochastic nonlinear Schrödinger equation with linear multiplicative noise

The Parallel Waveform Relaxation Stochastic Runge–Kutta Method for Stochastic Differential Equations

A Fast Implicit Difference Scheme for a New Class of Time Distributed-Order and Space Fractional Diffusion Equations with Variable Coefficients

A new weak approximation scheme of stochastic differential equations and the Runge-Kutta method

Almost Sure Exponential Stability of Implicit Numerical Solution for Stochastic Functional Differential Equation with Extended Polynomial Growth Condition.