Abstract:Monte Carlo simulation is a commonly used tool for evaluating the performance of complex stochastic systems. In practice, simulation can be expensive, especially when comparing a large number of alternatives, thus motivating the need to intelligently allocate simulation replications. Given a finite set of alternatives whose means are estimated via simulation, we consider the problem of determining the subset of alternatives that have means smaller than a fixed threshold. A dynamic sampling procedure that possesses not only asymptotic optimality, but also desirable finite-sample properties is proposed. Theoretical results show that there is a significant difference between finite-sample optimality and asymptotic optimality. Numerical experiments substantiate the effectiveness of the new method. Summary of Contribution: Simulation is an important tool to estimate the performance of complex stochastic systems. We consider a feasibility determination problem of identifying all those among a finite set of alternatives with mean smaller than a given threshold, in which the means are unknown but can be estimated by sampling replications via stochastic simulation. This problem appears widely in many applications, including call center design and hospital resource allocation. Our work considers how to intelligently allocate simulation replications to different alternatives for efficiently finding the feasible alternatives. Previous work focuses on the asymptotic properties of the sampling allocation procedures, whereas our contribution lies in developing a finite-budget allocation rule that possesses both asymptotic optimality and desirable finite-budget properties.

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives

Dynamic Sampling Policy for Subset Selection

Efficient Sampling Policy for Selecting a Subset with the Best

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Efficient Sampling Policy for Selecting a Good Enough Subset

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Top-Two Thompson Sampling for Contextual Top-mc Selection Problems

Dynamic Sampling Allocation and Design Selection.

Efficient Learning for Selecting Top-m Context-Dependent Designs

Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Ranking and Selection as Stochastic Control

Gradient-Based Myopic Allocation Policy: an Efficient Sampling Procedure in a Low-Confidence Scenario.

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Sequential Sampling to Myopically Maximize the Expected Value of Information

Dynamic Sampling For Feasibility Determination

sampling with probability matching

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

An Asymptotic Allocation for Simultaneous Simulation Experiments