Abstract:Monte Carlo simulation is a commonly used tool for evaluating the performance of complex stochastic systems. In practice, simulation can be expensive, especially when comparing a large number of alternatives, thus motivating the need to intelligently allocate simulation replications. Given a finite set of alternatives whose means are estimated via simulation, we consider the problem of determining the subset of alternatives that have means smaller than a fixed threshold. A dynamic sampling procedure that possesses not only asymptotic optimality, but also desirable finite-sample properties is proposed. Theoretical results show that there is a significant difference between finite-sample optimality and asymptotic optimality. Numerical experiments substantiate the effectiveness of the new method. Summary of Contribution: Simulation is an important tool to estimate the performance of complex stochastic systems. We consider a feasibility determination problem of identifying all those among a finite set of alternatives with mean smaller than a given threshold, in which the means are unknown but can be estimated by sampling replications via stochastic simulation. This problem appears widely in many applications, including call center design and hospital resource allocation. Our work considers how to intelligently allocate simulation replications to different alternatives for efficiently finding the feasible alternatives. Previous work focuses on the asymptotic properties of the sampling allocation procedures, whereas our contribution lies in developing a finite-budget allocation rule that possesses both asymptotic optimality and desirable finite-budget properties.

An Asymptotic Allocation for Simultaneous Simulation Experiments

Efficient Simulation Resource Sharing and Allocation for Selecting the Best.

Simulation Allocation for Determining the Best Design in the Presence of Correlated Sampling

Simulation Budget Allocation for Further Enhancing Theefficiency of Ordinal Optimization

A Sequential Budget Allocation Framework for Simulation Optimization

Selecting the Best Simulated Design with the Expected Opportunity Cost Bound.

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Efficient Simulation Budget Allocation with Bound Information

A Study on Efficient Computing Budget Allocation for a Two-Stage Problem

Optimal computing budget allocation for Monte Carlo simulation with application to product design

A Budget-Adaptive Allocation Rule for Optimal Computing Budget Allocation

An Optimal Opportunity Cost Selection Procedure for A Fixed Number of Designs

Dynamic Sampling Allocation and Design Selection.

Efficient Simulation Budget Allocation for Subset Selection Using Regression Metamodels

A New Budget Allocation Framework for the Expected Opportunity Cost

Efficient Computing Budget Allocation for Finding Simplest Good Designs

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

Asymptotically best response-adaptive randomization procedures☆

Efficient Simulation Sampling Allocation Using Multifidelity Models

Efficient Randomized-Adaptive Designs

Efficient Computing Budget Allocation for Simulation-Based Optimization With Stochastic Simulation Time