Abstract:Ranking algorithms are deployed widely to order a set of items in applications such as search engines, news feeds, and recommendation systems. Recent studies, however, have shown that, left unchecked, the output of ranking algorithms can result in decreased diversity in the type of content presented, promote stereotypes, and polarize opinions. In order to address such issues, we study the following variant of the traditional ranking problem when, in addition, there are fairness or diversity constraints. Given a collection of items along with 1) the value of placing an item in a particular position in the ranking, 2) the collection of sensitive attributes (such as gender, race, political opinion) of each item and 3) a collection of constraints that, for each k, bound the number of items with each attribute that are allowed to appear in the top k positions of the ranking, the goal is to output a ranking that maximizes the value with respect to the original rank quality metric while respecting the constraints. This problem encapsulates various well-studied problems related to bipartite and hypergraph matching as special cases and turns out to be hard to approximate even with simple constraints. Our main technical contributions are fast exact and approximation algorithms along with complementary hardness results that, together, come close to settling the approximability of this constrained ranking maximization problem. Unlike prior work on the constrained matching problems, our algorithm runs in linear time, even when the number of constraints is large, its approximation ratio does not depend on the number of constraints, and it produces solutions with small constraint violations. Our results rely on insights about the constrained matching problem when the objective satisfies properties that appear in common ranking metrics such as Discounted Cumulative Gain, Spearman's rho or Bradley-Terry.

IntervalRank: isotonic regression with listwise and pairwise constraints.

Listwise learning to rank with extreme order sensitive constraint via cross-correntropy

Online Learning to Rank in a Listwise Approach for Information Retrieval

Learning to Rank Relational Objects Based on the Listwise Approach

Learning to rank: from pairwise approach to listwise approach

QoRank: A Query-Dependent Ranking Model Using LSE-based Weighted Multiple Hyperplanes Aggregation for Information Retrieval

Learning to Rank with Ties

PL-ranking

Ranking with Diverse Intents and Correlated Contents.

Ranking with Slot Constraints

Regression Compatible Listwise Objectives for Calibrated Ranking with Binary Relevance

Listwise approach to learning to rank: theory and algorithm

Ranking Optimization with Constraints.

Ranking with Fairness Constraints

A Learning to Rank Approach Based on Ranking Positions

Learning to rank relational objects and its application to web search.

Few-shot Prompting for Pairwise Ranking: An Effective Non-Parametric Retrieval Model

Listwise approach based on the cross-correntropy for learning to rank

Selecting optimal training data for learning to rank

Inductive Pairwise Ranking: Going Beyond the n log(n) Barrier

Cost-Sensitive Listwise Ranking Approach