Abstract:The conventional solution to learning to rank problems ranks individual documents by prediction scores greedily. Recent emerged re-ranking models, which take as input initial lists, aim to capture document interdependencies and directly generate the optimal ordered lists. Typically, a re-ranking model is learned from a set of labeled data, which can achieve favorable performance on average. However, it can be suboptimal for individual queries because the available training data is usually highly imbalanced. This problem is challenging due to the absence of informative data for some queries and furthermore, the lack of a good data augmentation policy. In this paper, we propose a novel method named Learning to Augment (LTA), which mitigates the imbalance issue through learning to augment the initial lists for re-ranking models. Specifically, we first design a data generation model based on Gaussian Mixture Variational Autoencoder (GMVAE) for generating informative data. GMVAE imposes a mixture of Gaussians on the latent space, which allows it to cluster queries in an unsupervised manner and then generate new data with different query types using the learned components. Then, to obtain a good augmentation strategy (instead of heuristics), we design a teacher model that consists of two intelligent agents to determine how to generate new data for a given list and how to rank both the raw data and generated data to produce augmented lists, respectively. The teacher model leverages the feedback from the re-ranking model to optimize its augmentation policy by means of reinforcement learning. Our method offers a general learning paradigm that is applicable to both supervised and reinforced re-ranking models. Experimental results on benchmark learning to rank datasets show that our proposed method can significantly improve the performance of re-ranking models.

Ranking model selection and fusion for effective microblog search

Learning to Rank Microblog Posts for Real-Time Ad-Hoc Search.

A Content-Based Intelligent Ranking Model for Microblog

QCRI at TREC 2013 Microblog Track.

A Ranking SVM Based Fusion Model for Cross-Media Meta-Search Engine

Compact Indexing and Judicious Searching for Billion-Scale Microblog Retrieval.

Search Result Reranking with Visual and Structure Information Sources

Ranking Using Multi-Features In Blog Search

Multi-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search

Query clustering for learning to rank models on web search

Learning to Rank for Multiple Retrieval-Augmented Models through Iterative Utility Maximization

Irank: A Rank-Learn-combine Framework for Unsupervised Ensemble Ranking.

Multimodal Fusion for Video Search Reranking

RankTower: A Synergistic Framework for Enhancing Two-Tower Pre-Ranking Model

Learning to Match for Multi-criteria Document Relevance

Learning to Augment Imbalanced Data for Re-ranking Models.

List-aware Reranking-Truncation Joint Model for Search and Retrieval-augmented Generation

Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System

Leveraging Tweet Ranking In An Optimization Framework For Tweet Timeline Generation

Investigating Weak Supervision in Deep Ranking.

Leveraging Tweet Ranking in an Optimization Frameworkfor Tweet Timeline Generation.