Abstract:This thesis investigates stochastic optimal control problems with discrete delay and those with both discrete and exponential moving average delays, using the stochastic maximum principle, together with the methods of conjugate duality and dynamic programming. To obtain the stochastic maximum principle, we first extend the conjugate duality method presented in [2, 44] to study a stochastic convex (primal) problem with discrete delay. An expression for the corresponding dual problem, as well as the necessary and sufficient conditions for optimality of both problems, are derived. The novelty of our work is that, after reformulating a stochastic optimal control problem with delay as a particular convex problem, the conditions for optimality of convex problems lead to the stochastic maximum principle for the control problem. In particular, if the control problem involves both the types of delay and is jump-free, the stochastic maximum principle obtained in this thesis improves those obtained in [29, 30]. Adapting the technique used in [19, Chapter 3] to the stochastic context, we consider a class of stochastic optimal control problems with delay where the value functions are separable, i.e. can be expressed in terms of so-called auxiliary functions. The technique enables us to obtain second-order partial differential equations, satisfied by the auxiliary functions, which we shall call auxiliary HJB equations. Also, the corresponding verification theorem is obtained. If both the types of delay are involved, our auxiliary HJB equations generalize the HJB equations obtained in [22, 23] and our verification theorem improves the stochastic verification theorem there.

Modelling and optimal state-delay control in microbial batch process

Optimal Guaranteed Cost Control for a Class of Linear Uncertain Time-Delay Systems

An Integrated Design for Batch Process Using Optimal Average Profit Control with Unfixed Terminal Time

Production Optimization for Concentration and Volume-Limited Fed-Batch Reactors in Biochemical Processes

State-Delay Estimation for Nonlinear Systems Using Inexact Output Data

Optimal state-delay control in nonlinear dynamic systems

Practical algorithm for stochastic optimal control problem about microbial fermentation in batch culture

[State Regulation for Complex Biological Networks Based on Dynamic Optimization Algorithms].

Probability-Weighted Optimal Control for Nonlinear Stochastic Vibrating Systems with Random Time Delay

A New Sensitivity-Based Adaptive Control Vector Parameterization Approach for Dynamic Optimization of Bioprocesses

Time-delayed Feedback Control Optimization for Quasi Linear Systems under Random Excitations

Robust optimal control problem with multiple characteristic time points in the objective for a batch nonlinear time-varying process using parallel global optimization

A Stochastic Optimal Time-Delay Control for Nonlinear Structural Systems

Optimal tracking control of batch processes with time-invariant state delay: Adaptive Q-learning with two-dimensional state and control policy

Robust Optimal Control of a Microbial Batch Culture Process

OPTIMALITY CONDITION AND OPTIMAL CONTROL FOR A TWO-STAGE NONLINEAR DYNAMICAL SYSTEM OF MICROBIAL BATCH CULTURE

A real-time optimization approach for uncertain batch processes

Terminal Constrained Robust Hybrid Iterative Learning Model Predictive Control for Complex Time-Delayed Batch Processes

AN OPTIMAL TIME-DELAY CONTROL METHOD BASED ON THE STOCHASTIC AVERAGING

Batch-to-batch self-optimizing control for batch processes

Stochastic Optimal Controls with Delay