Selecting the Best System when Systems Are Revealed Sequentially

L. Jeff Hong,Barry L. Nelson
DOI: https://doi.org/10.1080/07408170600838415
2007-01-01
IIE Transactions
Abstract:Statistical Ranking and Selection (R&S) is a collection of experiment design and analysis techniques for selecting the system with the largest or smallest mean performance from among a finite set of alternatives. R&S procedures have received considerable research attention in the stochastic simulation community, and they have been incorporated in commercial simulation software. All existing procedures assume that the set of alternatives is available at the beginning of the experiment. In many situations, however, the alternatives are revealed (generated) sequentially during the experiment. We introduce procedures that are capable of selecting the best alternative in these situations and provide the desired statistical guarantees.
What problem does this paper attempt to address?