Abstract:The Bradley-Terry-Luce (BTL) model is one of the most widely used models for ranking a collection of items or agents based on pairwise comparisons among them. Given $n$ agents, the BTL model endows each agent $i$ with a latent skill score $\alpha_i > 0$ and posits that the probability that agent $i$ is preferred over agent $j$ is $\alpha_i/(\alpha_i + \alpha_j)$. In this work, our objective is to formulate a hypothesis test that determines whether a given pairwise comparison dataset, with $k$ comparisons per pair of agents, originates from an underlying BTL model. We formalize this testing problem in the minimax sense and define the critical threshold of the problem. We then establish upper bounds on the critical threshold for general induced observation graphs (satisfying mild assumptions) and develop lower bounds for complete induced graphs. Our bounds demonstrate that for complete induced graphs, the critical threshold scales as $\Theta((nk)^{-1/2})$ in a minimax sense. In particular, our test statistic for the upper bounds is based on a new approximation we derive for the separation distance between general pairwise comparison models and the class of BTL models. To further assess the performance of our statistical test, we prove upper bounds on the type I and type II probabilities of error. Much of our analysis is conducted within the context of a fixed observation graph structure, where the graph possesses certain ``nice'' properties, such as expansion and bounded principal ratio. Additionally, we derive several auxiliary results, such as bounds on principal ratios of graphs, $\ell^2$-bounds on BTL parameter estimation under model mismatch, stability of rankings under the BTL model, etc. We validate our theoretical results through experiments on synthetic and real-world datasets and propose a data-driven permutation testing approach to determine test thresholds.

Wilks' theorems in the $\beta$-model

Likelihood ratio tests in random graph models with increasing dimensions

Likelihood ratio tests under model misspecification in high dimensions

Degree Heterogeneity in Higher-Order Networks: Inference in the Hypergraph $\boldsymbolβ$-Model

LINEAR HYPOTHESIS TESTING FOR HIGH DIMENSIONAL GENERALIZED LINEAR MODELS.

Minimax Hypothesis Testing for the Bradley-Terry-Luce Model

A Sparse Beta Regression Model for Network Analysis

A Non-Parametric Box-Cox Approach to Robustifying High-Dimensional Linear Hypothesis Testing

Differential privacy statistical inference for a directed graph network model with covariates

Evaluating Network Models: A Likelihood Analysis

Null models for network data

On the E ffi ciency of Generalized Likelihood Ratio Tests

L-2 Regularized maximum likelihood for $β$-model in large and sparse networks

Testing generalized linear models with high-dimensional nuisance parameter.

Hypothesis testing for homogenous of nodes in $β$-models

Non-asymptotic model selection for models of network data with parameter vectors of increasing dimension

Asymptotics in Undirected Random Graph Models Parameterized by the Strengths of Vertices

Linear hypothesis testing in ultra high dimensional generalized linear mixed models

On the Null Distribution of Bayes Factors in Linear Regression

Unification of Rare/Weak Detection Models using Moderate Deviations Analysis and Log-Chisquared P-values

Tests for High Dimensional Generalized Linear Models