Abstract:Many procedures have been proposed in the literature to select the simulated alternative with the best mean performance from a finite set of alternatives. Among these procedures, frequentist procedures are typically designed under either the subset-selection (SS) formulation or the indifference-zone (IZ) formulation. Both formulations may encounter problems when the goal is to select the unique best alternative for any configuration of the means. In particular, SS procedures may return a subset that contains more than one alternative, and IZ procedures hinge on the relationship between the chosen IZ parameter and the true mean differences that is unknown to decision makers a priori. In this paper, we propose a new formulation that guarantees to select the unique best alternative with a user-specified probability of correct selection (PCS), as long as the means of alternatives are unique, and we design a class of fully sequential procedures under this formulation. These procedures are parameterized by the PCS value only, and their continuation boundaries are determined based on the Law of the Iterated Logarithm. Furthermore, we show that users can add a stopping criterion to these procedures to convert them into IZ procedures, and we argue that these procedures have several advantages over existing IZ procedures. Lastly, we conduct an extensive numerical study to show the performance of our procedures and compare their performance to existing procedures.

Fully Sequential Indifference‐zone Selection Procedures with Variance‐dependent Sampling

Indifference-Zone-Free Selection of the Best

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling

A sequential procedure for neighborhood selection-of-the-best in optimization via simulation

Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Fully Sequential Ranking and Selection Procedures with PAC Guarantee.

A frequentist selection-of-the-best procedure without indifference zone

Selection of the Best in the Presence of Subjective Stochastic Constraints

Selecting the Best System when Systems Are Revealed Sequentially

A Non-Parametric Sequential Procedure for the Generalized Partition Problem

Sequential Sampling for Bayesian Robust Ranking and Selection

Dynamic Sampling Allocation and Design Selection.

Data-driven Ranking and Selection under Input Uncertainty

Distributionally Robust Selection of the Best

Efficient Sampling Allocation Procedures for Optimal Quantile Selection

Ranking and Selection as Stochastic Control

Sequential Sampling to Myopically Maximize the Expected Value of Information

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Asymptotically best response-adaptive randomization procedures☆

Input Uncertainty and Indifference-Zone Ranking & Selection