Abstract:A sequential design problem for rank aggregation is commonly encountered in psychology, politics, marketing, sports, etc. In this problem, a decision maker is responsible for ranking K items by sequentially collecting noisy pairwise comparisons from judges. The decision maker needs to choose a pair of items for comparison in each step, decide when to stop data collection, and make a final decision after stopping based on a sequential flow of information. Because of the complex ranking structure, existing sequential analysis methods are not suitable. In this paper, we formulate the problem under a Bayesian decision framework and propose sequential procedures that are asymptotically optimal. These procedures achieve asymptotic optimality by seeking a balance between exploration (i.e., finding the most indistinguishable pair of items) and exploitation (i.e., comparing the most indistinguishable pair based on the current information). New analytical tools are developed for proving the asymptotic results, combining advanced change of measure techniques for handling the level crossing of likelihood ratios and classic large deviation results for martingales, which are of separate theoretical interest in solving complex sequential design problems. A mirror-descent algorithm is developed for the computation of the proposed sequential procedures.

Sequential Sampling for Bayesian Robust Ranking and Selection

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Ranking and Selection as Stochastic Control

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

A Rank-Based Sampling Framework for Offline Reinforcement Learning

Data-driven Ranking and Selection under Input Uncertainty

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Bi-objective Ranking and Selection Using Stochastic Kriging

POMDP-Based Ranking and Selection.

Distributionally Robust Selection of the Best

Bayesian ranking and selection with applications to field studies, economic mobility, and forecasting

Technical Note-Knowledge Gradient for Selection with Covariates: Consistency and Computation

AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Uncertainty Quantification for Bayesian Optimization

Context-Dependent Ranking and Selection under a Bayesian Framework

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling

Ranking Continuous Probabilistic Datasets.

Asymptotically Optimal Sequential Design for Rank Aggregation

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Sequential Design for Ranking Response Surfaces