Abstract:In various real-world scenarios, such as recommender systems and political surveys, pairwise rankings are commonly collected and utilized for rank aggregation to obtain an overall ranking of items. However, preference rankings can reveal individuals' personal preferences, underscoring the need to protect them from being released for downstream analysis. In this paper, we address the challenge of preserving privacy while ensuring the utility of rank aggregation based on pairwise rankings generated from a general comparison model. Using the randomized response mechanism to perturb raw pairwise rankings is a common privacy protection strategy used in practice. However, a critical challenge arises because the privatized rankings no longer adhere to the original model, resulting in significant bias in downstream rank aggregation tasks. Motivated by this, we propose to adaptively debiasing the rankings from the randomized response mechanism, ensuring consistent estimation of true preferences and enhancing the utility of downstream rank aggregation. Theoretically, we offer insights into the relationship between overall privacy guarantees and estimation errors from private ranking data, and establish minimax rates for estimation errors. This enables the determination of optimal privacy guarantees that balance consistency in rank aggregation with privacy protection. We also investigate convergence rates of expected ranking errors for partial and full ranking recovery, quantifying how privacy protection influences the specification of top-$K$ item sets and complete rankings. Our findings are validated through extensive simulations and a real application.

Partial Rankings of Optimizers

From Incomplete Preferences to Ranking via Optimization

Impartial Rank Aggregation

Depth Functions for Partial Orders with a Descriptive Analysis of Machine Learning Algorithms

Ranking with Ties based on Noisy Performance Data

Approximate Ranking from Pairwise Comparisons

Ranking by pairwise comparisons for Swiss-system tournaments

Direct Optimization of Ranking Measures

Unsupervised Submodular Rank Aggregation on Score-based Permutations.

Effective signal reconstruction from multiple ranked lists via convex optimization

Optimizing positional scoring rules for rank aggregation

Stochastic Iterative Methods for Online Rank Aggregation from Pairwise Comparisons

Comparing Machine Learning Algorithms by Union-Free Generic Depth

Sensitive and Scalable Online Evaluation with Theoretical Guarantees

A Novel Ranking Scheme for the Performance Analysis of Stochastic Optimization Algorithms using the Principles of Severity

Unbiased Comparative Evaluation of Ranking Functions

On Obtaining Stable Rankings

Competitive analysis via benchmark decomposition

Rate-Optimal Rank Aggregation with Private Pairwise Rankings

Aggregating Incomplete and Noisy Rankings