Abstract:This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for controlling such systems, focusing on the measure-valued process of the system's state and the control actions that depend on noisy and incomplete data. Our approach uses a stochastic optimal control framework with a probability measure-valued state, which accommodates noisy measurements and integrates them into control decisions through a Bayesian update mechanism. We characterize the control optimality in terms of a sequence of interlaced Hamilton Jacobi Bellman (HJB) equations coupled with controlled impulse steps at the measurement times. For the case of Gaussian-controlled processes, we derive an equivalent HJB equation whose state variable is finite-dimensional, namely the state's mean and covariance. We demonstrate the effectiveness of our methods through numerical examples. These include control under perfect observations, control under no observations, and control under noisy observations. Our numerical results highlight significant differences in the control strategies and their performance, emphasizing the challenges and computational demands of dealing with uncertainty in state observation.

Stochastic Minimum Principle for Partially Observed Systems Subject to Continuous and Jump Diffusion Processes and Driven by Relaxed Controls

On the Existence of Optimal Partially Observed Controls of Diffusions with Jumps

General Necessary Conditions for Partially Observed Optimal Stochastic Controls

Existence and optimality conditions for relaxed mean-field stochastic control problems

Necessary Conditions for Optimal Control of Stochastic Systems with Random Jumps

Stochastic Near-Optimal Controls for Path-Dependent Systems

Necessary Condition for Near Optimal Control of Linear Forward–backward Stochastic Differential Equations

Maximum principle for stochastic control of SDEs with measurable drifts

The Maximum Principle for Discounted Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Jumps on Infinite Horizon

Optimal controls for second‐order stochastic differential equations driven by mixed‐fractional Brownian motion with impulses

Near-Optimal Controls of Differential Systems with Switching and Random Jumps Subject to Fast Switching and Wideband Noise Perturbation

Continuous time Stochastic optimal control under discrete time partial observations

Stochastic Maximum Principle for Partial Information Optimal Control Problem of Forward-Backward Systems Involving Classical and Impulse Controls

The Global Maximum Principle for Progressive Optimal Control of Partially Observed Forward-Backward Stochastic Systems with Random Jumps

The Maximum Principle for Partially Observed Optimal Control of Stochastic Differential Equations

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Stochastic controls of fractional Brownian motion

Optimal Actuator Location of the Minimum Norm Controls for Stochastic Heat Equations

The Global Maximum Principle for Optimal Control of Partially Observed Stochastic Systems Driven by Fractional Brownian Motion

Stochastic Maximum Principle for Subdiffusions and Its Applications

Maximum Principles of Markov Regime-Switching Forward-Backward Stochastic Differential Equations with Jumps and Partial Information