Abstract:In recent years, with the rapid development of computing technology, developing parallel procedures to solve large-scale ranking and selection (R&S) problems has attracted a lot of research attention. In this paper, we take fixed-budget R&S procedure as an example to investigate potential issues of developing parallel procedures. We argue that to measure the performance of a fixed-budget R&S procedure in solving large-scale problems, it is important to quantify the minimal growth rate of the total sampling budget such that as the number of alternatives increases, the probability of correct selection (PCS) would not decrease to zero. We call such a growth rate of the total sampling budget the rate for maintaining correct selection (RMCS). We show that a tight lower bound for the RMCS of a broad class of existing fixed-budget procedures is in the order of [Formula: see text], where k is the number of alternatives. Then, we propose a new type of fixed-budget procedure, namely the fixed-budget knockout-tournament ([Formula: see text]) procedure. We prove that, in terms of the RMCS, our procedure outperforms existing fixed-budget procedures and achieves the optimal order, that is, the order of k. Moreover, we demonstrate that our procedure can be easily implemented in parallel computing environments with almost no nonparallelizable calculations. Last, a comprehensive numerical study shows that our procedure is indeed suitable for solving large-scale problems in parallel computing environments. History: Accepted by Bruno Tuffin, Area Editor for Simulation. Funding: Y. Zhong was supported by the National Natural Science Foundation of China [Grant 72101047]. L. J. Hong was supported by the National Natural Science Foundation of China [Grants 72091211 and 72161160340]. G. Jiang was supported by the National Natural Science Foundation of China [Grants 72121001 and 72171060]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/ijoc.2022.1221 .

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Optimal Computing Budget Allocation for Complete Ranking with Input Uncertainty

A Budget-Adaptive Allocation Rule for Optimal Computing Budget Allocation

Data-driven Ranking and Selection under Input Uncertainty

Solving Large-Scale Fixed-Budget Ranking and Selection Problems

Ranking and Selection with Two-Stage Decision

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

Approximate Simulation Budget Allocation for Subset Ranking

Optimal Computing Budget Allocation for Ordinal Optimization in Solving Stochastic Job Shop Scheduling Problems

Efficient Simulation Budget Allocation with Bound Information

A New Strategy for Selecting Good Enough Designs Using Optimal Computing Budget Allocation

Myopic Allocation Policy with Asymptotically Optimal Sampling Rate.

Selecting the Best System when Systems Are Revealed Sequentially

Optimal Computing Budget Allocation with Exponential Underlying Distribution

A Study on Efficient Computing Budget Allocation for a Two-Stage Problem

AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Optimal Computing Budget Allocation for Regression with Gradient Information.

Ranking and Selection as Stochastic Control

Dynamic Sampling Allocation and Design Selection.