Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Linear Estimation and Stochastic Control (M. H. A. Davis)

Guaranteed Cost D-Stabilization And H-Infinity D-Stabilization For Linear Discrete Time-Delay Systems

Optimal control of linear stochastic systems with applications to time lag systems

A Theorem on Duality Between Estimation and Control for Linear Stochastic Systems with Time Delay

Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients

Near-Optimal Control for Time-Varying Linear Discrete Systems with Additive Nonlinearities and Random Gains

On the Accessibility and Controllability of Statistical Linearization for Stochastic Control: Algebraic Rank Conditions and their Genericity

On Feedback Control of Linear Stochastic Systems

Ensemble Control of Stochastic Linear Systems

Linear Least-Squares Estimation of Discrete-Time Stationary Processes by Means of Backward Innovations

A Multilevel Approach for Stochastic Nonlinear Optimal Control

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

An Innovations Approach to Optimal Control of Linear Stochastic Systems with Time Delay

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

H-Infinity Control Of Linear Stochastic Reaction-Diffusion System With Markovian Switching

Nonlinear Optimal Control for Stochastic Dynamical Systems

State estimation for control: an approach for output-feedback stochastic MPC

On optimal stochastic control with smoothed information

Almost Optimal Agnostic Control of Unknown Linear Dynamics

Infinite Horizon Stabilization and Linear Quadratic Optimal Control of Descriptor Stochastic Markov Jump Systems

$H_{\infty}$ Control of Linear Stochastic Reaction-Diffusion System with Markovian Switching