Abstract:Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based recommender systems. Typically, these models undergo training on triplets consisting of binary relevance assignments, comprising one positive and one negative passage. However, their utilization involves a context where a significantly more nuanced understanding of relevance is necessary, especially when re-ranking a large pool of potentially relevant passages. Although collecting positive examples through user feedback like impressions or clicks is straightforward, identifying suitable negative pairs from a vast pool of possibly millions or even billions of documents possess a greater challenge. Generating a substantial number of negative pairs is often necessary to maintain the high quality of the model. Several approaches have been suggested in literature to tackle the issue of selecting suitable negative pairs from an extensive corpus. This study focuses on explaining the crucial role of hard negatives in the training process of cross-encoder models, specifically aiming to explain the performance gains observed with hard negative sampling compared to random sampling. We have developed a robust hard negative mining technique for efficient training of cross-encoder re-rank models on an enterprise dataset which has domain specific context. We provide a novel perspective to enhance retrieval models, ultimately influencing the performance of advanced LLM systems like Retrieval-Augmented Generation (RAG) and Reasoning and Action Agents (ReAct). The proposed approach demonstrates that learning both similarity and dissimilarity simultaneously with cross-encoders improves performance of retrieval systems.

Optimizing Dense Retrieval Model Training with Hard Negatives.

Learning To Retrieve: How to Train a Dense Retrieval Model Effectively and Efficiently

Hard Negatives or False Negatives: Correcting Pooling Bias in Training Neural Ranking Models

SyNeg: LLM-Driven Synthetic Hard-Negatives for Dense Retrieval

Towards Robust Ranker for Text Retrieval

Enhancing Retrieval Performance: An Ensemble Approach For Hard Negative Mining

Multi-Source Soft Labeling and Hard Negative Sampling for Retrieval Distractor Ranking

Adversarial Retriever-Ranker for Dense Text Retrieval.

Enhancing the Ranking Context of Dense Retrieval Methods through Reciprocal Nearest Neighbors

Preprint. Under review

Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval

Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization

YES SIR!Optimizing Semantic Space of Negatives with Self-Involvement Ranker

Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval

ROGER: Ranking-oriented Generative Retrieval

Optimizing Top-N Collaborative Filtering Via Dynamic Negative Item Sampling

Constructing Tree-based Index for Efficient and Effective Dense Retrieval

Practical Strategies of Active Learning to Rank for Web Search

Directly optimizing evaluation measures in learning to rank.

On the Theories Behind Hard Negative Sampling for Recommendation

Back to Basics: A Simple Recipe for Improving Out-of-Domain Retrieval in Dense Encoders