Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Some Reduced-Order Non-Riccati Equations for Linear Least-Squares Estimation : the Stationary, Single-Output Case†

Some New Non-Riccati Algorithms for Continuous-Time Kalman-Bucy Filtering

Input and state estimation for linear systems: A least squares estimation approach

On integrals in multi-output discrete-time Kalman-Bucy filtering

A New Algorithm for Optimal Filtering of Discrete-Time Stationary Processes

Direct Method Without the Riccati Equation for a Linear Filtering System with Arbitrary Initial Conditions

Optimal Filtering of Continuous-Time Stationary Processes by Means of the Backward Innovation Process

On Fredholm integral equations, Toeplitz equations and Kalman-Bucy filtering

Extended Kalman Filter with Reduced Computational Demands for Systems with Non-Linear Measurement Models

Solution to Brockett's Problem on Finite-Dimensional Estimation Algebras of Maximal Rank in Nonlinear Filtering

Lie Algebraic Method in Nonlinear Filtering with State Space Dimension Up to 6

Linear Least-Squares Estimation of Discrete-Time Stationary Processes by Means of Backward Innovations

The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions

Low-rank approximated Kalman filter using Oja's principal component flow for discrete-time linear systems

Input and state estimation for linear systems with a rank-deficient direct feedthrough matrix.

Iterative and Algebraic Algorithms for the Computation of the Steady State Kalman Filter Gain

An output-only unbiased minimum variance state estimator for linear systems

Low-rank approximated Kalman-Bucy filters using Oja's principal component flow for linear time-invariant systems

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

An algebraic Riccati equation approach to

A New Kalman Filter Model for Nonlinear Systems Based on Ellipsoidal Bounding