Abstract:This thesis investigates stochastic optimal control problems with discrete delay and those with both discrete and exponential moving average delays, using the stochastic maximum principle, together with the methods of conjugate duality and dynamic programming. To obtain the stochastic maximum principle, we first extend the conjugate duality method presented in [2, 44] to study a stochastic convex (primal) problem with discrete delay. An expression for the corresponding dual problem, as well as the necessary and sufficient conditions for optimality of both problems, are derived. The novelty of our work is that, after reformulating a stochastic optimal control problem with delay as a particular convex problem, the conditions for optimality of convex problems lead to the stochastic maximum principle for the control problem. In particular, if the control problem involves both the types of delay and is jump-free, the stochastic maximum principle obtained in this thesis improves those obtained in [29, 30]. Adapting the technique used in [19, Chapter 3] to the stochastic context, we consider a class of stochastic optimal control problems with delay where the value functions are separable, i.e. can be expressed in terms of so-called auxiliary functions. The technique enables us to obtain second-order partial differential equations, satisfied by the auxiliary functions, which we shall call auxiliary HJB equations. Also, the corresponding verification theorem is obtained. If both the types of delay are involved, our auxiliary HJB equations generalize the HJB equations obtained in [22, 23] and our verification theorem improves the stochastic verification theorem there.

The connection between discrete and continuous state constraints optimal control systems: the deterministic case

Study on optimal control strategy for a class of piecewise linear hybrid systems

On Modeling and Optimal Control of a Class of Hybrid Systems

The necessary and sufficient conditions for stochastic differential systems with multi-time states cost functional

Optimal Control of Discrete-Time Nonlinear Systems

Two New Optimal Models for Controlling Discrete Event Systems

Continuous and Discrete-Time Optimal Controls for an Isolated Signalized Intersection

Study on optimal control of switching systems and characteristic disparity

On Stochastic Optimal Control of Partially Observable Nonlinear Quasi Hamiltonian Systems

Exact controllability of infinite dimensional linear systems via bounded control functions

DECENTRALIZED ROBUST H∞ CONTROL FOR UNCERTAIN INTERCONNECTED LINEAR LARGE-SCALE SYSTEM WITH DELAYS

Continuous time Stochastic optimal control under discrete time partial observations

Discrete Time Mean-Field Stochastic Linear-Quadratic Optimal Control Problems

Convergence and quasi-optimality of an adaptive finite element method for optimal control problems with integral control constraint

Optimal State Equation for the Control of a Diffusion with Two Distinct Dynamics

Controlled Diffusions under Full, Partial and Decentralized Information: Existence of Optimal Policies and Discrete-Time Approximations

Optimal Control of SDEs with Expected Path Constraints and Related Constrained FBSDEs

Discontinuous Galerkin Methods for an Elliptic Optimal Control Problem with a General State Equation and Pointwise State Constraints

Discrete‐Time Optimal Control of State‐Constrained Nonlinear Systems Using Approximate Dynamic Programming

Stochastic Optimal Controls with Delay

A Unified Theory of Maximum Principle for Continuous and Discrete Time Optimal Control Problems