Abstract:Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet popular probabilistic models are often too rigid to capture such complexities. In this work we leverage recent progress on similar challenges in discrete choice modeling to form flexible and tractable choice-based models for ranking data. We study choice representations, maps from rankings (complete or top-$k$) to collections of choices, as a way of forming ranking models from choice models. We focus on the repeated selection (RS) choice representation, first used to form the Plackett-Luce ranking model from the conditional multinomial logit choice model. We fully characterize, for a prime number of alternatives, the choice representations that admit ranking distributions with unit normalization, a desirably property that greatly simplifies maximum likelihood estimation. We further show that only specific minor variations on repeated selection exhibit this property. Our choice-based ranking models provide higher out-of-sample likelihood when compared to Plackett-Luce and Mallows models on a broad collection of ranking tasks including food preferences, ranked-choice elections, car racing, and search engine relevance tasks.

POMDP-Based Ranking and Selection.

Ranking and Selection as Stochastic Control

AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Sequential Sampling for Bayesian Robust Ranking and Selection

Ranking and Selection with Two-Stage Decision

Non-Myopic Knowledge Gradient Policy for Ranking and Selection.

Robust Action Selection in Partially Observable Markov Decision Processes with Model Uncertainty

Sequential sampling for a ranking and selection problem with exponential sampling distributions

Data-driven Ranking and Selection under Input Uncertainty

Advancing Constrained Ranking and Selection with Regression in Partitioned Domains.

Choosing to Rank

Inverse Reinforcement Learning with Multiple Ranked Experts

A Rank-Based Sampling Framework for Offline Reinforcement Learning

Bi-objective Ranking and Selection Using Stochastic Kriging

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Stochastic Robustness Controller Design upon Different Ranking Criteria

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling

Selecting the Best System when Systems Are Revealed Sequentially

Context-Dependent Ranking and Selection under a Bayesian Framework

Estimation and Control Using Sampling-Based Bayesian Reinforcement Learning