Abstract:This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for controlling such systems, focusing on the measure-valued process of the system's state and the control actions that depend on noisy and incomplete data. Our approach uses a stochastic optimal control framework with a probability measure-valued state, which accommodates noisy measurements and integrates them into control decisions through a Bayesian update mechanism. We characterize the control optimality in terms of a sequence of interlaced Hamilton Jacobi Bellman (HJB) equations coupled with controlled impulse steps at the measurement times. For the case of Gaussian-controlled processes, we derive an equivalent HJB equation whose state variable is finite-dimensional, namely the state's mean and covariance. We demonstrate the effectiveness of our methods through numerical examples. These include control under perfect observations, control under no observations, and control under noisy observations. Our numerical results highlight significant differences in the control strategies and their performance, emphasizing the challenges and computational demands of dealing with uncertainty in state observation.

A Revisit to Optimal Control of Forward-Backward Stochastic Differential System with Observation Noise

Partial Information Near-Optimal Control of Forward-Backward Stochastic Differential System with Observation Noise

The Global Maximum Principle for Progressive Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Random Jumps

Output Regulation Control for Stochastic Systems with Additive Noise.

General Necessary Conditions for Partially Observed Optimal Stochastic Controls

The Maximum Principle for Partially Observed Optimal Control of Stochastic Differential Equations

A stochastic optimal control strategy for partially observable nonlinear systems

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

The Maximum Principle for Discounted Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Jumps on Infinite Horizon

Continuous time Stochastic optimal control under discrete time partial observations

Time-inconsistent Linear Quadratic Optimal Control Problem for Forward-Backward Stochastic Differential Equations

Forward and Backward Mean-Field Stochastic Partial Differential Equation and Optimal Control

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Optimal Feedback Controls of Stochastic Linear Quadratic Control Problems in Infinite Dimensions with Random Coefficients

Stochastic maximum principle for hybrid optimal control problems under partial observation

The Equivalence Conditions of Optimal Feedback Control-Strategy Operators for Zero-Sum Linear Quadratic Stochastic Differential Game with Random Coefficients

On mean-field control problems for backward doubly stochastic systems

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Characterization of Optimal Feedback for Stochastic Linear Quadratic Control Problems

Discrete-Time Approximation of Stochastic Optimal Control with Partial Observation

Time-inconsistent linear quadratic optimal control problem for forward–backward stochastic differential equations