Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Stochastic Optimization Using Ricci Flow

Global Optimization with Orthogonality Constraints Via Stochastic Diffusion on Manifold

Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold

Randomized Submanifold Subgradient Method for Optimization over Stiefel Manifolds

Continuous-time Riemannian SGD and SVRG Flows on Wasserstein Probabilistic Space

Stochastic [math]th Root Approximation of a Stochastic Matrix: A Riemannian Optimization Approach

A Riemannian optimization method on the indefinite Stiefel manifold

A stochastic regularized second-order iterative scheme for optimal control and inverse problems in stochastic partial differential equations

Ricci curvature integrals, local functionals, and the Ricci flow

Optimization without Retraction on the Random Generalized Stiefel Manifold

Stochastic Quantization of General Relativity \`a la Ricci-Flow

The Stochastic Steepest Descent Method for Robust Optimization in Banach Spaces

Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds

Riemannian stochastic fixed point optimization algorithm

Optimization on manifolds: A symplectic approach

Stochastic $p$th root approximation of a stochastic matrix: A Riemannian optimization approach

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Distributed Riemannian Stochastic Gradient Tracking Algorithm on the Stiefel Manifold

Symplectic Stiefel manifold: tractable metrics, second-order geometry and Newton's methods

Decentralized Weakly Convex Optimization Over the Stiefel Manifold

Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants