Abstract:Learning to rank is an important task for many data mining applications. Essentially, the goal of learning to rank is to learn an appropriate similarity or distance metric to determine the relevance relationships among data points. However, most of the existing approaches for distance metric learning are limited in three aspects. First, they often assume a fixed form of distance metric for the entire input space. Second, the assumed distance functions are often computationally expensive or even intractable to learn for high dimensional data, such as Mahalanobis distance. Third, most of these approaches lack robustness to noisily labeled data, which is pervasive in many real-world applications. In this paper, we study learning to rank as a problem of distance metric learning to address the above three problems. We choose Bregman distance as the target distance function, due to its general functional form as a generalization of a wide class of distance functions, and its capacity of exploiting complicated nonlinear patterns underlying the data. Under the framework of structural SVM, we formulate the problem of learning Bregman distance functions for ranking as a QP problem by a nonparametric approach, and present an effective algorithm. Furthermore, we propose a self-reinforcement scheme that adaptively differentiates each data point in the role of learning to secure the robustness. We emphasize that the proposed method SBLR-S (Structural Bregman distance functions Learning to Rank with Self-reinforcement) is more general than the conventional distance metric learning approaches, and is able to handle high dimensional data as well as noisily labeled data. The experiments of data ranking on real-world datasets show the superiority of this method to the state-of-the-art literature.

Generalization Analysis of Listwise Learning-to-rank Algorithms

Generalization Analysis For Ranking

Two-Layer Generalization Analysis for Ranking Using Rademacher Average.

Listwise approach to learning to rank: theory and algorithm

Online Learning to Rank in a Listwise Approach for Information Retrieval

Generalization Bounds for Metric and Similarity Learning

Query-level stability and generalization in learning to rank

Position-Aware ListMLE: A Sequential Learning Process for Ranking.

Statistical Learning Theory For Ranking

Fine-grained Generalization Analysis of Vector-valued Learning

Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

Learning rates for regularized least squares ranking algorithm

Statistical Consistency of Ranking Methods in A Rank-Differentiable Probability Space

Rethinking and Reweighting the Univariate Losses for Multi-Label Ranking: Consistency and Generalization

Structural Bregman Distance Functions Learning to Rank with Self-Reinforcement

Ranking Measures and Loss Functions in Learning to Rank.

Ranking In Generalized Linear Bandits

On the numerical rank of radial basis function kernels in high dimension

The Listwise Approach

RankFormer: Listwise Learning-to-Rank Using Listwide Labels

Statistical Consistency of Top-k Ranking.