Markov Decision Models for Optimal Decision Making in Bottlenecks Identification and Mitigation

Yang Li,Qing Chang,Xiaoning Jin,Jun Ni
DOI: https://doi.org/10.1115/msec2015-9256
2015-01-01
Abstract:Existing methods for bottleneck detection can be categorized into two: methods based on stochastic analysis and methods based on data-driven analysis. The stochastic methods are accurate in estimating bottlenecks in long term, ignoring the current improvement opportunities, while the data-driven methods tend to do the opposite. In this paper, we develop an optimal policy to integrate the two methods based on Markov decision theory. The characterization of the optimal policy is provided. In addition, to implement the policy, the optimal frequency for carrying out bottleneck analysis is investigated. Numerical experiment is performed to validate the effectiveness of the optimal policy and compare it to the existing methods.
What problem does this paper attempt to address?