Abstract:Monte Carlo simulation is a commonly used tool for evaluating the performance of complex stochastic systems. In practice, simulation can be expensive, especially when comparing a large number of alternatives, thus motivating the need to intelligently allocate simulation replications. Given a finite set of alternatives whose means are estimated via simulation, we consider the problem of determining the subset of alternatives that have means smaller than a fixed threshold. A dynamic sampling procedure that possesses not only asymptotic optimality, but also desirable finite-sample properties is proposed. Theoretical results show that there is a significant difference between finite-sample optimality and asymptotic optimality. Numerical experiments substantiate the effectiveness of the new method. Summary of Contribution: Simulation is an important tool to estimate the performance of complex stochastic systems. We consider a feasibility determination problem of identifying all those among a finite set of alternatives with mean smaller than a given threshold, in which the means are unknown but can be estimated by sampling replications via stochastic simulation. This problem appears widely in many applications, including call center design and hospital resource allocation. Our work considers how to intelligently allocate simulation replications to different alternatives for efficiently finding the feasible alternatives. Previous work focuses on the asymptotic properties of the sampling allocation procedures, whereas our contribution lies in developing a finite-budget allocation rule that possesses both asymptotic optimality and desirable finite-budget properties.

Efficient Sampling Policy for Selecting a Subset with the Best

Efficient Sampling Policy for Selecting a Good Enough Subset

Dynamic Sampling Policy for Subset Selection

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives

Dynamic Sampling Allocation and Design Selection.

Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation

Ranking and Selection as Stochastic Control

Dynamic Sampling For Feasibility Determination

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Sequential sampling for a ranking and selection problem with exponential sampling distributions

A Dynamic Framework for Statistical Selection Problems

Efficient Learning for Selecting Top-m Context-Dependent Designs

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Gradient-Based Myopic Allocation Policy: an Efficient Sampling Procedure in a Low-Confidence Scenario.

Determining the Optimal Sampling Set Size for Random Search

Selecting the Best Simulated Design with the Expected Opportunity Cost Bound.

A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION

Sequential Sampling to Myopically Maximize the Expected Value of Information