Optimal Drift Rate Control and Impulse Control for a Stochastic Inventory/Production System
Ping Cao,Dacheng Yao
DOI: https://doi.org/10.1137/16M110246X
2017-09-26
Abstract:In this paper, we consider joint drift rate control and impulse control for a stochastic inventory system under long-run average cost criterion. Assuming the inventory level must be nonnegative, we prove that a $\{(0,q^{\star},Q^{\star},S^{\star}),\{\mu^{\star}(x): x\in[0, S^{\star}]\}\}$ policy is an optimal joint control policy, where the impulse control follows the control band policy $(0,q^{\star},Q^{\star},S^{\star})$, that brings the inventory level up to $q^{\star}$ once it drops to $0$ and brings it down to $Q^{\star}$ once it rises to $S^{\star}$, and the drift rate only depends on the current inventory level and is given by function $\mu^{\star}(x)$ for the inventory level $x\in[0,S^{\star}]$. The optimality of the $\{(0,q^{\star},Q^{\star},S^{\star}),\{\mu^{\star}(x): x\in[0,S^{\star}]\}\}$ policy is proven by using a lower bound approach, in which a critical step is to prove the existence and uniqueness of optimal policy parameters. To prove the existence and uniqueness, we develop a novel analytical method to solve a free boundary problem consisting of an ordinary differential equation (ODE) and several free boundary conditions. Furthermore, we find that the optimal drift rate $\mu^{\star}(x)$ is firstly increasing and then decreasing as $x$ increases from $0$ to $S^{\star}$ with a turnover point between $Q^{\star}$ and $S^{\star}$.
Optimization and Control