Abstract:This thesis investigates stochastic optimal control problems with discrete delay and those with both discrete and exponential moving average delays, using the stochastic maximum principle, together with the methods of conjugate duality and dynamic programming. To obtain the stochastic maximum principle, we first extend the conjugate duality method presented in [2, 44] to study a stochastic convex (primal) problem with discrete delay. An expression for the corresponding dual problem, as well as the necessary and sufficient conditions for optimality of both problems, are derived. The novelty of our work is that, after reformulating a stochastic optimal control problem with delay as a particular convex problem, the conditions for optimality of convex problems lead to the stochastic maximum principle for the control problem. In particular, if the control problem involves both the types of delay and is jump-free, the stochastic maximum principle obtained in this thesis improves those obtained in [29, 30]. Adapting the technique used in [19, Chapter 3] to the stochastic context, we consider a class of stochastic optimal control problems with delay where the value functions are separable, i.e. can be expressed in terms of so-called auxiliary functions. The technique enables us to obtain second-order partial differential equations, satisfied by the auxiliary functions, which we shall call auxiliary HJB equations. Also, the corresponding verification theorem is obtained. If both the types of delay are involved, our auxiliary HJB equations generalize the HJB equations obtained in [22, 23] and our verification theorem improves the stochastic verification theorem there.

A survey on sufficient optimality conditions for delayed optimal control problems

A sufficient optimality condition for non-linear delayed optimal control problems

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

Delay-dependent robust H∞ control for with parameter uncertainties and time delay

Singular LQ Sub-Optimal Control Problem for a Class of Discrete-Time Singular Systems with Time-Delay

Delay-dependent robust H∞ control for switched systems with parameter uncertainties and time delay

New Design Approach of Delay-Dependent Robust Stabilizing Control for Uncertain Time-Delay Systems

Optimal Control Problems with Incomplete and Different Integral Time Domains in the Objective and Constraints

Delay-dependent Robusth∞ Control for a Class of Uncertain Switched Systems with Time Delay

Stochastic Optimal Controls with Delay

Optimal Control Problems with Vector-Valued Impulse Controls and Time Delays

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Impulsive optimal control problems with time delays in the drift term

Optimal state-delay control in nonlinear dynamic systems

Optimal control of a Tuberculosis model with state and control delays

Discrete-time optimal control problems with time delay argument: New discrete-time Euler-Lagrange equations with delay

Stochastic Optimal Control Problem in Advertising Model with Delay

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

Optimum control of distributed parameter systems with time delays

Optimal control of stochastic delay differential equations: Optimal feedback controls

Stochastic optimal control problems with delays in the state and in the control via viscosity solutions and applications to optimal advertising and optimal investment problems