Abstract:Consider the minimization of the following quadratic cost functional:J(u) := E + E integral(0)(t) (" + ") ds,where x is the solution of the following linear stochastic control system:[GRAPHICS]x(0) = h is an element ofR(n), u(t) is an element of R(m);u is a square integrable adapted process. The problem is conventionally called the stochastic LQ (the abbreviation of "linear quadratic") problem. We are concerned with the following general case: the coefficients A, B, C(i), D(i), Q, N, and M are allowed to be adapted processes or random matrices. We prove the existence and uniqueness result for the associated Riccati equation, which in our general case is a backward stochastic differential equation with the generator (the drift term) being highly nonlinear in the two unknown variables. This solves Bismut and Peng's long-standing open problem (for the case of a Brownian filtration), which was initially proposed by the French mathematician J. M. Bismut [in Seminaire de Probabilites XII, Lecture Notes in Math. 649, C. Dellacherie, P. A. Meyer, and M. Weil, eds., Springer-Verlag, Berlin, 1978, pp. 180-264]. We also provide a rigorous derivation of the Riccati equation from the stochastic Hamilton system. This completes the interrelationship between the Riccati equation and the stochastic Hamilton system as two different but equivalent tools for the stochastic LQ problem.There are two key points in our arguments. The first one is to connect the existence of the solution of the Riccati equation to the homomorphism of the stochastic flows derived from the optimally controlled system. Actually, we establish their equivalence. As a consequence, we can construct solutions to a sequence of suitably modified Riccati equations in terms of the associated stochastic Hamilton systems (and the optimal controls). The second key point is to establish a new type of a priori estimate for solutions of Riccati equations, with which we show that the sequence of constructed solutions has a limit which is a solution to the original Riccati equation.

Analysis of RHC for Stabilization of Nonautonomous Parabolic Equations Under Uncertainty

Robust memoryless H/sup /spl infin// control for uncertain linear time-delay systems

Finite-Dimensional RHC Control of Linear Time-Varying Parabolic PDEs: Stability Analysis and Model-Order Reduction

Memoryless stabilization of uncertain linear systems with time-varying state and control delays

Robust memoryless H∞ control for uncertain linear time-delay systems

On Stability and Stabilisation for Uncertain Stochastic Systems with Time-Delay and Actuator Saturation

Exponential Stabilization of an Unstable Parabolic PDE System Using Boundary Optimal Control

Robust H-Infinity Control For Systems With Sector Nonlinear Uncertainty In Actuators

Stabilizability of parabolic equations by switching controls based on point actuators

On the Stability of Nonlinear Receding Horizon Control: A Geometric Perspective

Stabilizability for nonautonomous linear parabolic equations with actuators as distributions

Robust Receding Horizon Control with Free Control Moves for Polytopic Parametric Uncertainty Systems Subject to Multiple Input Delays

Indirect Radau Pseudospectral Method for the Receding Horizon Control Problem

Output Feedback Stabilization of Uncertain Nonholonomic Systems with External Disturbances Via Active Disturbance Rejection Control

Output-based receding horizon stabilizing control

Operator Learning for Robust Stabilization of Linear Markov-Jumping Hyperbolic PDEs

Robust Stabilization and H∞ Control for Stochastic Systems with Parameter Uncertainty and Nonlinearity

General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations

Input-to-State Stability of Perturbed Nonlinear Systems with Event-Triggered Receding Horizon Control Scheme

Robust Stabilization of Linear Systems with Norm-Bounded Time-Varying Uncertainty