The Pairwise Approach

Tie-Yan Liu

DOI: https://doi.org/10.1007/978-3-642-14267-3_3

2011-01-01

Abstract:In this chapter we will introduce the pairwise approach to learning to rank. Specifically we first introduce several example algorithms, whose major differences are in the loss functions. Then we discuss the limitations of these algorithms and present some improvements that enable better ranking performance.

What problem does this paper attempt to address?

The Pointwise Approach

Tie-Yan Liu

DOI: https://doi.org/10.1007/978-3-642-14267-3_2

2011-01-01

Abstract:In this chapter, we introduce the pointwise approach to learning to rank. Specifically, we will cover the regression-based algorithms, classification-based algorithms, and ordinal regression-based algorithms, and then make discussions on their advantages and disadvantages.
Online Learning to Rank in a Listwise Approach for Information Retrieval

Fan Ma,Haoyun Yang,Haibing Yin,Xiaofeng Huang,Chenggang Yan,Xiang Meng

DOI: https://doi.org/10.1109/icme.2019.00181

2019-01-01

Abstract:A common approach to learning to rank is to minimize the pair-wise loss. However, established analysis shows that pair-wise loss does not necessarily lead to an optimal list-wise ranking measures, e.g., average precision (AP) or area under precision-recall curve (AUPRC). It becomes more difficult in the online learning setting, where the data arrives sequentially and is scanned only once. This paper proposes an online learning-to-rank algorithm by minimizing the list-wise ranking error, which achieves a vanishing gap between the list-wise loss and the ranking measures. Experiments also testify the effectiveness and robustness of the proposed online List-wise algorithm.
The Listwise Approach

Tie-Yan Liu

DOI: https://doi.org/10.1007/978-3-642-14267-3_4

2011-01-01

Abstract:In this chapter, we introduce the listwise approach to learning to rank. Specifically, we first introduce those listwise ranking algorithms that minimize measure-specific loss functions (also referred to as direct optimization methods), and then introduce some other algorithms whose loss functions are not directly related to evaluation measures for information retrieval.
Approximate Ranking from Pairwise Comparisons

Reinhard Heckel,Max Simchowitz,Kannan Ramchandran,Martin J. Wainwright

DOI: https://doi.org/10.48550/arXiv.1801.01253

2018-01-04

Abstract:A common problem in machine learning is to rank a set of n items based on pairwise comparisons. Here ranking refers to partitioning the items into sets of pre-specified sizes according to their scores, which includes identification of the top-k items as the most prominent special case. The score of a given item is defined as the probability that it beats a randomly chosen other item. Finding an exact ranking typically requires a prohibitively large number of comparisons, but in practice, approximate rankings are often adequate. Accordingly, we study the problem of finding approximate rankings from pairwise comparisons. We analyze an active ranking algorithm that counts the number of comparisons won, and decides whether to stop or which pair of items to compare next, based on confidence intervals computed from the data collected in previous steps. We show that this algorithm succeeds in recovering approximate rankings using a number of comparisons that is close to optimal up to logarithmic factors. We also present numerical results, showing that in practice, approximation can drastically reduce the number of comparisons required to estimate a ranking.

Machine Learning,Artificial Intelligence,Information Theory
Online Learning with Pairwise Loss Functions

Yuyang Wang,Roni Khardon,Dmitry Pechyony,Rosie Jones

DOI: https://doi.org/10.48550/arXiv.1301.5332

2013-01-23

Abstract:Efficient online learning with pairwise loss functions is a crucial component in building large-scale learning system that maximizes the area under the Receiver Operator Characteristic (ROC) curve. In this paper we investigate the generalization performance of online learning algorithms with pairwise loss functions. We show that the existing proof techniques for generalization bounds of online algorithms with a univariate loss can not be directly applied to pairwise losses. In this paper, we derive the first result providing data-dependent bounds for the average risk of the sequence of hypotheses generated by an arbitrary online learner in terms of an easily computable statistic, and show how to extract a low risk hypothesis from the sequence. We demonstrate the generality of our results by applying it to two important problems in machine learning. First, we analyze two online algorithms for bipartite ranking; one being a natural extension of the perceptron algorithm and the other using online convex optimization. Secondly, we provide an analysis for the risk bound for an online algorithm for supervised metric learning.

Machine Learning
Pareto Pairwise Ranking for Fairness Enhancement of Recommender Systems

Hao Wang

DOI: https://doi.org/10.48550/arXiv.2212.10459

2022-12-06

Information Retrieval

Abstract:Learning to rank is an effective recommendation approach since its introduction around 2010. Famous algorithms such as Bayesian Personalized Ranking and Collaborative Less is More Filtering have left deep impact in both academia and industry. However, most learning to rank approaches focus on improving technical accuracy metrics such as AUC, MRR and NDCG. Other evaluation metrics of recommender systems like fairness have been largely overlooked until in recent years. In this paper, we propose a new learning to rank algorithm named Pareto Pairwise Ranking. We are inspired by the idea of Bayesian Personalized Ranking and power law distribution. We show that our algorithm is competitive with other algorithms when evaluated on technical accuracy metrics. What is more important, in our experiment section we demonstrate that Pareto Pairwise Ranking is the most fair algorithm in comparison with 9 other contemporary algorithms.
Pairwise Learning via Stagewise Training in Proximal Setting

Hilal AlQuabeh,Aliakbar Abdurahimov

DOI: https://doi.org/10.48550/arXiv.2208.04075

2022-08-08

Abstract:The pairwise objective paradigms are an important and essential aspect of machine learning. Examples of machine learning approaches that use pairwise objective functions include differential network in face recognition, metric learning, bipartite learning, multiple kernel learning, and maximizing of area under the curve (AUC). Compared to pointwise learning, pairwise learning's sample size grows quadratically with the number of samples and thus its complexity. Researchers mostly address this challenge by utilizing an online learning system. Recent research has, however, offered adaptive sample size training for smooth loss functions as a better strategy in terms of convergence and complexity, but without a comprehensive theoretical study. In a distinct line of research, importance sampling has sparked a considerable amount of interest in finite pointwise-sum minimization. This is because of the stochastic gradient variance, which causes the convergence to be slowed considerably. In this paper, we combine adaptive sample size and importance sampling techniques for pairwise learning, with convergence guarantees for nonsmooth convex pairwise loss functions. In particular, the model is trained stochastically using an expanded training set for a predefined number of iterations derived from the stability bounds. In addition, we demonstrate that sampling opposite instances at each iteration reduces the variance of the gradient, hence accelerating convergence. Experiments on a broad variety of datasets in AUC maximization confirm the theoretical results.

Machine Learning
Fair Pairs: Fairness-Aware Ranking Recovery from Pairwise Comparisons

Georg Ahnert,Antonio Ferrara,Claudia Wagner

2024-08-23

Abstract:Pairwise comparisons based on human judgements are an effective method for determining rankings of items or individuals. However, as human biases perpetuate from pairwise comparisons to recovered rankings, they affect algorithmic decision making. In this paper, we introduce the problem of fairness-aware ranking recovery from pairwise comparisons. We propose a group-conditioned accuracy measure which quantifies fairness of rankings recovered from pairwise comparisons. We evaluate the impact of state-of-the-art ranking recovery algorithms and sampling approaches on accuracy and fairness of the recovered rankings, using synthetic and empirical data. Our results show that Fairness-Aware PageRank and GNNRank with FA*IR post-processing effectively mitigate existing biases in pairwise comparisons and improve the overall accuracy of recovered rankings. We highlight limitations and strengths of different approaches, and provide a Python package to facilitate replication and future work on fair ranking recovery from pairwise comparisons.

Computers and Society,Social and Information Networks
Listwise approach to learning to rank: theory and algorithm

Fen Xia,Tie-Yan Liu,Jue Wang,Wensheng Zhang,Hang Li

DOI: https://doi.org/10.1145/1390156.1390306

2008-01-01

Abstract:This paper aims to conduct a study on the listwise approach to learning to rank. The listwise approach learns a ranking function by taking individual lists as instances and minimizing a loss function defined on the predicted list and the ground-truth list. Existing work on the approach mainly focused on the development of new algorithms; methods such as RankCosine and ListNet have been proposed and good performances by them have been observed. Unfortunately, the underlying theory was not sufficiently studied so far. To amend the problem, this paper proposes conducting theoretical analysis of learning to rank algorithms through investigations on the properties of the loss functions, including consistency, soundness, continuity, differentiability, convexity, and efficiency. A sufficient condition on consistency for ranking is given, which seems to be the first such result obtained in related research. The paper then conducts analysis on three loss functions: likelihood loss, cosine loss, and cross entropy loss. The latter two were used in RankCosine and ListNet. The use of the likelihood loss leads to the development of a new listwise method called ListMLE, whose loss function offers better properties, and also leads to better experimental results.
Ranking with multiple types of pairwise comparisons

Mark E. J. Newman

DOI: https://doi.org/10.1098/rspa.2022.0517

2022-10-20

Abstract:The task of ranking individuals or teams, based on a set of comparisons between pairs, arises in various contexts, including sporting competitions and the analysis of dominance hierarchies among animals and humans. Given data on which competitors beat which others, the challenge is to rank the competitors from best to worst. Here we study the problem of computing rankings when there are multiple, potentially conflicting types of comparison, such as multiple types of dominance behaviours among animals. We assume that we do not know a priori what information each behaviour conveys about the ranking, or even whether they convey any information at all. Nonetheless, we show that it is possible to compute a ranking in this situation and present a fast method for doing so, based on a combination of an expectation–maximization algorithm and a modified Bradley–Terry model. We give a selection of example applications to both animal and human competition.
Learning Combinatorial Functions from Pairwise Comparisons

Maria-Florina Balcan,Ellen Vitercik,Colin White

DOI: https://doi.org/10.48550/arXiv.1605.09227

2016-05-30

Abstract:A large body of work in machine learning has focused on the problem of learning a close approximation to an underlying combinatorial function, given a small set of labeled examples. However, for real-valued functions, cardinal labels might not be accessible, or it may be difficult for an expert to consistently assign real-valued labels over the entire set of examples. For instance, it is notoriously hard for consumers to reliably assign values to bundles of merchandise. Instead, it might be much easier for a consumer to report which of two bundles she likes better. With this motivation in mind, we consider an alternative learning model, wherein the algorithm must learn the underlying function up to pairwise comparisons, from pairwise comparisons. In this model, we present a series of novel algorithms that learn over a wide variety of combinatorial function classes. These range from graph functions to broad classes of valuation functions that are fundamentally important in microeconomic theory, the analysis of social networks, and machine learning, such as coverage, submodular, XOS, and subadditive functions, as well as functions with sparse Fourier support.

Machine Learning,Data Structures and Algorithms
Unbiased Pairwise Learning to Rank in Recommender Systems

Yi Ren,Hongyan Tang,Siwen Zhu

DOI: https://doi.org/10.48550/arXiv.2111.12929

2021-11-25

Information Retrieval

Abstract:Nowadays, recommender systems already impact almost every facet of peoples lives. To provide personalized high quality recommendation results, conventional systems usually train pointwise rankers to predict the absolute value of objectives and leverage a distinct shallow tower to estimate and alleviate the impact of position bias. However, with such a training paradigm, the optimization target differs a lot from the ranking metrics valuing the relative order of top ranked items rather than the prediction precision of each item. Moreover, as the existing system tends to recommend more relevant items at higher positions, it is difficult for the shallow tower based methods to precisely attribute the user feedback to the impact of position or relevance. Therefore, there exists an exciting opportunity for us to get enhanced performance if we manage to solve the aforementioned issues. Unbiased learning to rank algorithms, which are verified to model the relative relevance accurately based on noisy feedback, are appealing candidates and have already been applied in many applications with single categorical labels, such as user click signals. Nevertheless, the existing unbiased LTR methods cannot properly handle multiple feedback incorporating both categorical and continuous labels. Accordingly, we design a novel unbiased LTR algorithm to tackle the challenges, which innovatively models position bias in the pairwise fashion and introduces the pairwise trust bias to separate the position bias, trust bias, and user relevance explicitly. Experiment results on public benchmark datasets and internal live traffic show the superior results of the proposed method for both categorical and continuous labels.
Pairwise Ranking with Gaussian Kernels

Guanhang Lei,Lei Shi

DOI: https://doi.org/10.48550/arXiv.2304.03185

2023-04-07

Abstract:Regularized pairwise ranking with Gaussian kernels is one of the cutting-edge learning algorithms. Despite a wide range of applications, a rigorous theoretical demonstration still lacks to support the performance of such ranking estimators. This work aims to fill this gap by developing novel oracle inequalities for regularized pairwise ranking. With the help of these oracle inequalities, we derive fast learning rates of Gaussian ranking estimators under a general box-counting dimension assumption on the input domain combined with the noise conditions or the standard smoothness condition. Our theoretical analysis improves the existing estimates and shows that a low intrinsic dimension of input space can help the rates circumvent the curse of dimensionality.

Machine Learning
Pairwise Ranking with Gaussian Kernel

Guanhang Lei,Lei Shi

DOI: https://doi.org/10.1007/s10444-024-10165-0

2024-01-01

Advances in Computational Mathematics

Abstract:Regularized pairwise ranking with Gaussian kernels is one of the cutting-edge learning algorithms. Despite a wide range of applications, a rigorous theoretical demonstration still lacks to support the performance of such ranking estimators. This work aims to fill this gap by developing novel oracle inequalities for regularized pairwise ranking. With the help of these oracle inequalities, we derive fast learning rates of Gaussian ranking estimators under a general box-counting dimension assumption on the input domain combined with the noise conditions or the standard smoothness condition. Our theoretical analysis improves the existing estimates and shows that a low intrinsic dimension of input space can help the rates circumvent the curse of dimensionality.
Towards Non-Parametric Learning to Rank

Ao Liu,Qiong Wu,Zhenming Liu,Lirong Xia

DOI: https://doi.org/10.48550/arXiv.1807.03395

2018-07-10

Abstract:This paper studies a stylized, yet natural, learning-to-rank problem and points out the critical incorrectness of a widely used nearest neighbor algorithm. We consider a model with $n$ agents (users) $\{x_i\}_{i \in [n]}$ and $m$ alternatives (items) $\{y_j\}_{j \in [m]}$, each of which is associated with a latent feature vector. Agents rank items nondeterministically according to the Plackett-Luce model, where the higher the utility of an item to the agent, the more likely this item will be ranked high by the agent. Our goal is to find neighbors of an arbitrary agent or alternative in the latent space. We first show that the Kendall-tau distance based kNN produces incorrect results in our model. Next, we fix the problem by introducing a new algorithm with features constructed from "global information" of the data matrix. Our approach is in sharp contrast to most existing feature engineering methods. Finally, we design another new algorithm identifying similar alternatives. The construction of alternative features can be done using "local information," highlighting the algorithmic difference between finding similar agents and similar alternatives.

Machine Learning,Artificial Intelligence,Computers and Society
Distributed Spectral Pairwise Ranking Algorithms

Zheng-Chu Guo,Ting Hu,Lei Shi

DOI: https://doi.org/10.1088/1361-6420/acad23

IF: 2.408

2022-01-01

Inverse Problems

Abstract:This paper considers spectral pairwise ranking algorithms in a reproducing kernel Hilbert space. The concerned algorithms include a large family of regularized pairwise learning algorithms. Motivated by regularization methods, spectral algorithms are proposed to solve ill-posed linear inverse problems, then developed in learning theory and inverse problems. Recently, pairwise learning tasks such as bipartite ranking, similarity metric learning, Minimum Error Entropy principle, and AUC maximization have received increasing attention due to their wide applications. However, the spectral algorithm acts on the spectrum of the empirical integral operator or kernel matrix, involving the singular value decomposition or the inverse of the matrix, which is time-consuming when the sample size is immense. Our contribution is twofold. First, under some general source conditions and capacity assumptions, we establish the first-ever mini-max optimal convergence rates for spectral pairwise ranking algorithms. Second, we consider the distributed version of the algorithms based on a divide-and-conquer approach and show that, as long as the partition of the data set is not too large, the distributed learning algorithm enjoys both computational efficiency and statistical optimality.
Fine-grained analysis of non-parametric estimation for pairwise learning

Junyu Zhou,Shuo Huang,Han Feng,Puyu Wang,Ding-Xuan Zhou

2024-06-21

Abstract:In this paper, we are concerned with the generalization performance of non-parametric estimation for pairwise learning. Most of the existing work requires the hypothesis space to be convex or a VC-class, and the loss to be convex. However, these restrictive assumptions limit the applicability of the results in studying many popular methods, especially kernel methods and neural networks. We significantly relax these restrictive assumptions and establish a sharp oracle inequality of the empirical minimizer with a general hypothesis space for the Lipschitz continuous pairwise losses. Our results can be used to handle a wide range of pairwise learning problems including ranking, AUC maximization, pairwise regression, and metric and similarity learning. As an application, we apply our general results to study pairwise least squares regression and derive an excess generalization bound that matches the minimax lower bound for pointwise least squares regression up to a logrithmic term. The key novelty here is to construct a structured deep ReLU neural network as an approximation of the true predictor and design the targeted hypothesis space consisting of the structured networks with controllable complexity. This successful application demonstrates that the obtained general results indeed help us to explore the generalization performance on a variety of problems that cannot be handled by existing approaches.

Machine Learning
Online Regularized Learning with Pairwise Loss Functions

Zheng-Chu Guo,Yiming Ying,Ding-Xuan Zhou

DOI: https://doi.org/10.1007/s10444-016-9479-7

2016-01-01

Advances in Computational Mathematics

Abstract:Recently, there has been considerable work on analyzing learning algorithms with pairwise loss functions in the batch setting. There is relatively little theoretical work on analyzing their online algorithms, despite of their popularity in practice due to the scalability to big data. In this paper, we consider online learning algorithms with pairwise loss functions based on regularization schemes in reproducing kernel Hilbert spaces. In particular, we establish the convergence of the last iterate of the online algorithm under a very weak assumption on the step sizes and derive satisfactory convergence rates for polynomially decaying step sizes. Our technique uses Rademacher complexities which handle function classes associated with pairwise loss functions. Since pairwise learning involves pairs of examples, which are no longer i.i.d., standard techniques do not directly apply to such pairwise learning algorithms. Hence, our results are a non-trivial extension of those in the setting of univariate loss functions to the pairwise setting.
Applications Of Learning To Rank

Richard Combes,Stefan Magureanu,Alexandre Proutiere,Cyrille Laroche

DOI: https://doi.org/10.1007/978-3-642-14267-3_14

2011-01-01

Abstract:In this chapter, we introduce some applications of learning to rank. The major purpose is to demonstrate how to use an existing learning-to-rank algorithm to solve a real ranking problem. In particular, we will take question answering, multimedia retrieval, text summarization, online advertising, etc. as examples, for illustration. One will see from these examples that the key step is to extract effective features for the objects to be ranked by considering the unique properties of the application, and to prepare a set of training data. Then it becomes straightforward to train a ranking model from the data and use it for ranking new objects.
Estimation from Pairwise Comparisons: Sharp Minimax Bounds with Topology Dependence

Nihar B. Shah,Sivaraman Balakrishnan,Joseph Bradley,Abhay Parekh,Kannan Ramchandran,Martin J. Wainwright

DOI: https://doi.org/10.48550/arXiv.1505.01462

2015-05-07

Abstract:Data in the form of pairwise comparisons arises in many domains, including preference elicitation, sporting competitions, and peer grading among others. We consider parametric ordinal models for such pairwise comparison data involving a latent vector $w^* \in \mathbb{R}^d$ that represents the "qualities" of the $d$ items being compared; this class of models includes the two most widely used parametric models--the Bradley-Terry-Luce (BTL) and the Thurstone models. Working within a standard minimax framework, we provide tight upper and lower bounds on the optimal error in estimating the quality score vector $w^*$ under this class of models. The bounds depend on the topology of the comparison graph induced by the subset of pairs being compared via its Laplacian spectrum. Thus, in settings where the subset of pairs may be chosen, our results provide principled guidelines for making this choice. Finally, we compare these error rates to those under cardinal measurement models and show that the error rates in the ordinal and cardinal settings have identical scalings apart from constant pre-factors.

Machine Learning,Information Theory

The Pairwise Approach

The Pointwise Approach

Online Learning to Rank in a Listwise Approach for Information Retrieval

The Listwise Approach

Approximate Ranking from Pairwise Comparisons

Online Learning with Pairwise Loss Functions

Pareto Pairwise Ranking for Fairness Enhancement of Recommender Systems

Pairwise Learning via Stagewise Training in Proximal Setting

Fair Pairs: Fairness-Aware Ranking Recovery from Pairwise Comparisons

Listwise approach to learning to rank: theory and algorithm

Ranking with multiple types of pairwise comparisons

Learning Combinatorial Functions from Pairwise Comparisons

Unbiased Pairwise Learning to Rank in Recommender Systems

Pairwise Ranking with Gaussian Kernels

Pairwise Ranking with Gaussian Kernel

Towards Non-Parametric Learning to Rank

Distributed Spectral Pairwise Ranking Algorithms

Fine-grained analysis of non-parametric estimation for pairwise learning

Online Regularized Learning with Pairwise Loss Functions

Applications Of Learning To Rank

Estimation from Pairwise Comparisons: Sharp Minimax Bounds with Topology Dependence