Abstract:In control theory, typically a nominal model is assumed based on which an optimal control is designed and then applied to an actual (true) system. This gives rise to the problem of performance loss due to the mismatch between the true model and the assumed model. A robustness problem in this context is to show that the error due to the mismatch between a true model and an assumed model decreases to zero as the assumed model approaches the true model. We study this problem when the state dynamics of the system are governed by controlled diffusion processes. In particular, we will discuss continuity and robustness properties of finite horizon and infinite-horizon $\alpha$-discounted/ergodic optimal control problems for a general class of non-degenerate controlled diffusion processes, as well as for optimal control up to an exit time. Under a general set of assumptions and a convergence criterion on the models, we first establish that the optimal value of the approximate model converges to the optimal value of the true model. We then establish that the error due to mismatch that occurs by application of a control policy, designed for an incorrectly estimated model, to a true model decreases to zero as the incorrect model approaches the true model. We will see that, compared to related results in the discrete-time setup, the continuous-time theory will let us utilize the strong regularity properties of solutions to optimality (HJB) equations, via the theory of uniformly elliptic PDEs, to arrive at strong continuity and robustness properties.

Necessary and Sufficient Conditions of Near‐optimality in a Regime‐switching Diffusion Model

The Euler-Maruyama Approximation of State-Dependent Regime Switching Diffusions

Robustness of Stochastic Optimal Control to Approximate Diffusion Models under Several Cost Evaluation Criteria

A stochastic hybrid optimal control with regime switching and recursive cost functional

Robust optimal stopping with regime switching

Mean-Field Stochastic Linear Quadratic Optimal Control for Jump-Diffusion Systems with Hybrid Disturbances

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Robust pointwise second order necessary conditions for singular stochastic optimal control with model uncertainty

The necessary and sufficient conditions for stochastic differential systems with multi-time states cost functional

On sufficient conditions of transience for a stochastic differential equation with switching

Second Order Optimality Conditions for Optimal Control Problems of Stochastic Evolution Equations

Necessary Conditions for Optimal Control of Stochastic Systems with Random Jumps

A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model with Delay and an Application to Finance

Non-homogeneous stochastic LQ control with regime switching and random coefficients

Sufficient Stochastic Maximum Principle for the Optimal Control of Semi-Markov Modulated Jump-Diffusion with Application to Financial Optimization

Stochastic Near-Optimal Controls for Path-Dependent Systems

Risk‐sensitive maximum principle for stochastic optimal control of mean‐field type Markov regime‐switching jump‐diffusion systems

An approach for regime-switching stochastic control problems with memory and terminal conditions

Near-optimal control of a stochastic SICA model with imprecise parameters

Optimal State Equation for the Control of a Diffusion with Two Distinct Dynamics

Stochastic differential games with controlled regime-switching