Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

The Minkowski-Bellman Equation

Optimal Guaranteed Cost Control of Dynamic Interval Systems: an LMI Approach

Numerical Method for the Time Optimal Control Problem Governed by the Benjamin-Bona-Mahony Equation

Minimax Linear Optimal Control of Positive Systems

Riccati equations and optimal control of well-posed linear systems

Time-Inconsistent Stochastic Optimal Control Problems and Backward Stochastic Volterra Integral Equations

Optimal control problems with generalized mean-field dynamics and viscosity solution to Master Bellman equation

Hamilton-Jacobi-Bellman equation of nonlinear optimal control problems with fractional discount rate

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Optimal Neumann control for the 1D wave equation: Finite horizon, infinite horizon, boundary tracking terms and the turnpike property

Solving Finite-Horizon HJB for Optimal Control of Continuous-Time Systems

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

The Modified MSA, a Gradient Flow and Convergence

Minimization of Risk and Linear Quadratic Optimal Control Theory.

Optimal Control for a Class of Infinite Dimensional Systems Involving an $L^\infty$-term in the Cost Functional

Time-inconsistent linear quadratic optimal control problem for forward–backward stochastic differential equations

Generalized Risk-Sensitive Optimal Control and Hamilton–Jacobi–Bellman Equation

Linear Quadratic Problem with Unbounded Control in Hilbert Spaces

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Characterizing All Optimal Controls for an Indefinite Stochastic Linear Quadratic Control Problem

Infeasible and Critically Feasible Optimal Control