Abstract:Many procedures have been proposed in the literature to select the simulated alternative with the best mean performance from a finite set of alternatives. Among these procedures, frequentist procedures are typically designed under either the subset-selection (SS) formulation or the indifference-zone (IZ) formulation. Both formulations may encounter problems when the goal is to select the unique best alternative for any configuration of the means. In particular, SS procedures may return a subset that contains more than one alternative, and IZ procedures hinge on the relationship between the chosen IZ parameter and the true mean differences that is unknown to decision makers a priori. In this paper, we propose a new formulation that guarantees to select the unique best alternative with a user-specified probability of correct selection (PCS), as long as the means of alternatives are unique, and we design a class of fully sequential procedures under this formulation. These procedures are parameterized by the PCS value only, and their continuation boundaries are determined based on the Law of the Iterated Logarithm. Furthermore, we show that users can add a stopping criterion to these procedures to convert them into IZ procedures, and we argue that these procedures have several advantages over existing IZ procedures. Lastly, we conduct an extensive numerical study to show the performance of our procedures and compare their performance to existing procedures.

A frequentist selection-of-the-best procedure without indifference zone

Indifference-Zone-Free Selection of the Best

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling

Fully Sequential Indifference‐zone Selection Procedures with Variance‐dependent Sampling

Selection of the Best in the Presence of Subjective Stochastic Constraints

Fully Sequential Ranking and Selection Procedures with PAC Guarantee.

Asymptotically best response-adaptive randomization procedures☆

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Input Uncertainty and Indifference-Zone Ranking & Selection

A sequential procedure for neighborhood selection-of-the-best in optimization via simulation

Distributionally Robust Selection of the Best

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Sample-Optimal Large-Scale Optimal Subset Selection

A Non-Parametric Sequential Procedure for the Generalized Partition Problem

Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

Gradient-Based Myopic Allocation Policy: an Efficient Sampling Procedure in a Low-Confidence Scenario.

An Optimal Opportunity Cost Selection Procedure for A Fixed Number of Designs

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

Efficient Randomized-Adaptive Designs

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives