Abstract:Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based recommender systems. Typically, these models undergo training on triplets consisting of binary relevance assignments, comprising one positive and one negative passage. However, their utilization involves a context where a significantly more nuanced understanding of relevance is necessary, especially when re-ranking a large pool of potentially relevant passages. Although collecting positive examples through user feedback like impressions or clicks is straightforward, identifying suitable negative pairs from a vast pool of possibly millions or even billions of documents possess a greater challenge. Generating a substantial number of negative pairs is often necessary to maintain the high quality of the model. Several approaches have been suggested in literature to tackle the issue of selecting suitable negative pairs from an extensive corpus. This study focuses on explaining the crucial role of hard negatives in the training process of cross-encoder models, specifically aiming to explain the performance gains observed with hard negative sampling compared to random sampling. We have developed a robust hard negative mining technique for efficient training of cross-encoder re-rank models on an enterprise dataset which has domain specific context. We provide a novel perspective to enhance retrieval models, ultimately influencing the performance of advanced LLM systems like Retrieval-Augmented Generation (RAG) and Reasoning and Action Agents (ReAct). The proposed approach demonstrates that learning both similarity and dissimilarity simultaneously with cross-encoders improves performance of retrieval systems.

Diversity in Ranking using Negative Reinforcement

Personalized Diversification for Neural Re-ranking in Recommendation.

Evaluating the Diversity of Top-N Recommendations

Avoiding monotony: improving the diversity of recommendation lists

Set-oriented personalized ranking for diversified top-n recommendation.

Novelty and Diversity in Top-N Recommendation - Analysis and Evaluation

Directly Optimize Diversity Evaluation Measures: A New Approach to Search Result Diversification.

Personalized Re-ranking for Improving Diversity in Live Recommender Systems

Learning Maximal Marginal Relevance Model Via Directly Optimizing Diversity Evaluation Measures.

Statistical Modeling of Diversity in Top-N Recommender Systems

On Diversity in Discriminative Neural Networks

Reinforcement negative sampling recommendation based on collaborative knowledge graph

Improving Accuracy and Diversity in Matching of Recommendation with Diversified Preference Network

Mining diversity on networks

Structural Learning of Diverse Ranking.

Efficient Diverse Rank Of Hot-Topics-Discussion On Social Network

Layer-diverse Negative Sampling for Graph Neural Networks

Diversity-Aware Top-N Recommendation: A Deep Reinforcement Learning Way

Enhancing Retrieval Performance: An Ensemble Approach For Hard Negative Mining

Research Ideas Discovery Via Hierarchical Negative Correlation

Diversity in Kemeny Rank Aggregation: A Parameterized Approach