Abstract:We are concerned with the linear-quadratic optimal stochastic control problem with random coefficients. Under suitable conditions, we prove that the value field $V(t,x,\omega), (t,x,\omega)\in [0,T]\times R^n\times \Omega$, is quadratic in $x$, and has the following form: $V(t,x)=\langle K_tx, x\rangle$ where $K$ is an essentially bounded nonnegative symmetric matrix-valued adapted processes. Using the dynamic programming principle (DPP), we prove that $K$ is a continuous semi-martingale of the form $$K_t=K_0+\int_0^t \, dk_s+\sum_{i=1}^d\int_0^tL_s^i\, dW_s^i, \quad t\in [0,T]$$ with $k$ being a continuous process of bounded variation and $$E\left[\left(\int_0^T|L_s|^2\, ds\right)^p\right] <\infty, \quad \forall p\ge 2; $$ and that $(K, L)$ with $L:=(L^1, \cdots, L^d)$ is a solution to the associated backward stochastic Riccati equation (BSRE), whose generator is highly nonlinear in the unknown pair of processes. The uniqueness is also proved via a localized completion of squares in a self-contained manner for a general BSRE. The existence and uniqueness of adapted solution to a general BSRE was initially proposed by the French mathematician J. M. Bismut (1976, 1978). It had been solved by the author (2003) via the stochastic maximum principle with a viewpoint of stochastic flow for the associated stochastic Hamiltonian system. The present paper is its companion, and gives the {\it second but more comprehensive} adapted solution to a general BSRE via the DDP. Further extensions to the jump-diffusion control system and to the general nonlinear control system are possible.

Dynamic Programming of the Stochastic Burgers Equation Driven by Lévy Noise

Dynamic Programming of Stochastic 2-D Navier-Stokes Equations Forced by Levy Noise

Dynamic programming of the stochastic 2D-Navier-Stokes equations forced by Lévy noise

Probabilistic Tracking Control of Dissipated Hamiltonian Systems Excited by Gaussian White Noises.

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Variational Dynamic Programming for Stochastic Optimal Control

Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients

Observer‐based H ∞ control of a stochastic Korteweg–de Vries–Burgers equation

Burgers Equation with Multiplicative Noise : Dynamics and Stability

Central limit theorem and moderate deviation principle for the stochastic generalized Burgers-Huxley equation with multiplicative noise

Optimal Controls of Stochastic Differential Equations with Jumps and Random Coefficients: Stochastic Hamilton–Jacobi–Bellman Equations with Jumps

Discrete Control of Nonlinear Stochastic Systems Driven by Lévy Process

A stochastic HJB equation for optimal control of forward-backward SDEs

Optimal Bilinear Control of Nonlinear Stochastic Schrödinger Equations Driven by Linear Multiplicative Noise

Nonlinear Optimal Control for Stochastic Dynamical Systems

Nonlinear SPDE driven by Levy noise: Well-posedness, optimal control and invariant measure

Sampled-data finite-dimensional observer-based control of 1-D Burgers' equation

Relaxed optimal control for the stochastic Landau-Lifshitz-Bloch equation with jump noise

Dynamic Programming Principle and Associated Hamilton-Jacobi-Bellman Equation for Stochastic Recursive Control Problem with Non-Lipschitz Aggregator

Stochastic lq control and associated riccati equation of pdes driven by state- and control-dependent white noise

The Burgers Equation with Affine Linear Noise: Dynamics and Stability