Abstract:We study a ranking and selection problem of learning from choice-based feedback with dynamic assortments. In this problem, a company sequentially displays a set of items to a population of customers and collects their choices as feedback. The only information available about the underlying choice model is that the choice probabilities are consistent with some unknown true strict ranking over the items. The objective is to identify, with the fewest samples, the most preferred item or the full ranking over the items at a high confidence level. We present novel and simple algorithms for both learning goals. In the first subproblem regarding best-item identification, we introduce an elimination-based algorithm, Nested Elimination (NE). In the more complex subproblem regarding full-ranking identification, we generalize NE and propose a divide-and-conquer algorithm, Nested Partition (NP). We provide strong characterizations of both algorithms through instance-specific and non-asymptotic bounds on the sample complexity. This is accomplished using an analytical framework that characterizes the system dynamics through analyzing a sequence of multi-dimensional random walks. We also establish a connection between our nested approach and the information-theoretic lower bounds. We thus show that NE is worst-case asymptotically optimal, and NP is optimal up to a constant factor. Finally, numerical experiments from both synthetic and real data corroborate our theoretical findings.

Context-Dependent Ranking and Selection under a Bayesian Framework

Top-Two Thompson Sampling for Selecting Context-Dependent Best Designs.

Efficient Learning for Selecting Top-m Context-Dependent Designs

Efficient Learning for Clustering and Optimizing Context-Dependent Designs

Top-Two Thompson Sampling for Contextual Top-mc Selection Problems

Ranking and Selection as Stochastic Control

A Bayesian Approach for Subset Selection in Contextual Bandits.

Dynamic Sampling Allocation and Design Selection.

Learning Relevant Contextual Variables Within Bayesian Optimization

Sequential Sampling for Bayesian Robust Ranking and Selection

Sequential sampling for a ranking and selection problem with exponential sampling distributions

CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design

POMDP-Based Ranking and Selection.

A Dynamic Framework for Statistical Selection Problems

Bayesian ranking and selection with applications to field studies, economic mobility, and forecasting

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Contextual Ranking of Database Querying Results: A Statistical Approach

Adaptively Learning to Select-Rank in Online Platforms

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Learning to Select and Rank from Choice-Based Feedback: A Simple Nested Approach

Bayesian Decision Process for Cost-Efficient Dynamic Ranking via Crowdsourcing