On the Variance of Single-Run Unbiased Stochastic Derivative Estimators.
Zhenyu Cui,Michael C. Fu,Jian-Qiang Hu,Yanchu Liu,Yijie Peng,Lingjiong Zhu
DOI: https://doi.org/10.1287/ijoc.2019.0897
IF: 3.288
2019-01-01
INFORMS Journal on Computing
Abstract:We analyze the variance of single-run unbiased stochastic derivative estimators. The distribution of a specific conditional expectation characterizes an intrinsic distributional property of the derivative estimators in a given class, which, in turn, separates two of the most popular single-run unbiased derivative estimators, infinitesimal perturbation analysis and the likelihood ratio method, into disjoint classes. In addition, a necessary and sufficient condition for the estimators to achieve the lowest variance in a certain class is provided, as well as insights into finding an estimator with lower variance. We offer a sufficient condition to substantiate the rule of thumb that the infinitesimal perturbation analysis estimator has a smaller variance than does the likelihood ratio method estimator and to provide a counterexample when the sufficient condition is not satisfied.