Abstract:We are concerned with the linear-quadratic optimal stochastic control problem with random coefficients. Under suitable conditions, we prove that the value field $V(t,x,\omega), (t,x,\omega)\in [0,T]\times R^n\times \Omega$, is quadratic in $x$, and has the following form: $V(t,x)=\langle K_tx, x\rangle$ where $K$ is an essentially bounded nonnegative symmetric matrix-valued adapted processes. Using the dynamic programming principle (DPP), we prove that $K$ is a continuous semi-martingale of the form $$K_t=K_0+\int_0^t \, dk_s+\sum_{i=1}^d\int_0^tL_s^i\, dW_s^i, \quad t\in [0,T]$$ with $k$ being a continuous process of bounded variation and $$E\left[\left(\int_0^T|L_s|^2\, ds\right)^p\right] <\infty, \quad \forall p\ge 2; $$ and that $(K, L)$ with $L:=(L^1, \cdots, L^d)$ is a solution to the associated backward stochastic Riccati equation (BSRE), whose generator is highly nonlinear in the unknown pair of processes. The uniqueness is also proved via a localized completion of squares in a self-contained manner for a general BSRE. The existence and uniqueness of adapted solution to a general BSRE was initially proposed by the French mathematician J. M. Bismut (1976, 1978). It had been solved by the author (2003) via the stochastic maximum principle with a viewpoint of stochastic flow for the associated stochastic Hamiltonian system. The present paper is its companion, and gives the {\it second but more comprehensive} adapted solution to a general BSRE via the DDP. Further extensions to the jump-diffusion control system and to the general nonlinear control system are possible.

Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems

Lmi Approach To Optimal Guaranteed Cost Control For A Class Of Linear Uncertain Discrete Systems

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Asynchronous Control for Discrete-Time Markovian Jump Systems with Multiplicative Noise

Optimal Vibration Control of a Class of Nonlinear Stochastic Systems with Markovian Jump

Robust quadratic control of discrete-time singular Markov jump systems with bounded transition probabilities

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Optimal Control and Stabilization Problem for Discrete-time Markov Jump Systems with Indefinite Weight Costs

Mixed Deterministic and Random Optimal Control of Linear Stochastic Systems with Quadratic Costs

Multi-Objective Optimal Control with Arbitrary Additive and Multiplicative Noise

Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II

Finite-time L2−l∞ Tracking Control for Markov Jump Repeated Scalar Nonlinear Systems with Partly Usable Model Information

Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients

Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

Indefinite Linear Quadratic Mean Field Social Control Problems With Multiplicative Noise

Stabilization and Optimal Control for Discrete-time Markov Jump Linear System with Multiplicative Noises and Input Delays: A Complete Solution

Cooperative Output Regulation Quadratic Control for Discrete-Time Heterogeneous Multiagent Markov Jump Systems

Time-inconsistent linear quadratic optimal control problem for forward–backward stochastic differential equations

Explicit Solution for Constrained Stochastic Linear-Quadratic Control with Multiplicative Noise