Abstract:Monte Carlo simulation is a commonly used tool for evaluating the performance of complex stochastic systems. In practice, simulation can be expensive, especially when comparing a large number of alternatives, thus motivating the need to intelligently allocate simulation replications. Given a finite set of alternatives whose means are estimated via simulation, we consider the problem of determining the subset of alternatives that have means smaller than a fixed threshold. A dynamic sampling procedure that possesses not only asymptotic optimality, but also desirable finite-sample properties is proposed. Theoretical results show that there is a significant difference between finite-sample optimality and asymptotic optimality. Numerical experiments substantiate the effectiveness of the new method. Summary of Contribution: Simulation is an important tool to estimate the performance of complex stochastic systems. We consider a feasibility determination problem of identifying all those among a finite set of alternatives with mean smaller than a given threshold, in which the means are unknown but can be estimated by sampling replications via stochastic simulation. This problem appears widely in many applications, including call center design and hospital resource allocation. Our work considers how to intelligently allocate simulation replications to different alternatives for efficiently finding the feasible alternatives. Previous work focuses on the asymptotic properties of the sampling allocation procedures, whereas our contribution lies in developing a finite-budget allocation rule that possesses both asymptotic optimality and desirable finite-budget properties.

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Gradient-Based Myopic Allocation Policy: an Efficient Sampling Procedure in a Low-Confidence Scenario.

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Dynamic Sampling Allocation and Design Selection.

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives

Asymptotic Behavior of Mean-Cvar Portfolio Selection Model under Nonparametric Framework

Ranking and Selection as Stochastic Control

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Efficient Sampling Policy for Selecting a Subset with the Best

Sequential Sampling to Myopically Maximize the Expected Value of Information

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Efficient Sampling Policy for Selecting a Good Enough Subset

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Dynamic Sampling For Feasibility Determination

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Asymptotically best response-adaptive randomization procedures☆

Efficient Randomized-Adaptive Designs