Abstract:Contradiction retrieval refers to identifying and extracting documents that explicitly disagree with or refute the content of a query, which is important to many downstream applications like fact checking and data cleaning. To retrieve contradiction argument to the query from large document corpora, existing methods such as similarity search and crossencoder models exhibit significant limitations. The former struggles to capture the essence of contradiction due to its inherent nature of favoring similarity, while the latter suffers from computational inefficiency, especially when the size of corpora is large. To address these challenges, we introduce a novel approach: SparseCL that leverages specially trained sentence embeddings designed to preserve subtle, contradictory nuances between sentences. Our method utilizes a combined metric of cosine similarity and a sparsity function to efficiently identify and retrieve documents that contradict a given query. This approach dramatically enhances the speed of contradiction detection by reducing the need for exhaustive document comparisons to simple vector calculations. We validate our model using the Arguana dataset, a benchmark dataset specifically geared towards contradiction retrieval, as well as synthetic contradictions generated from the MSMARCO and HotpotQA datasets using GPT-4. Our experiments demonstrate the efficacy of our approach not only in contradiction retrieval with more than 30% accuracy improvements on MSMARCO and HotpotQA across different model architectures but also in applications such as cleaning corrupted corpora to restore high-quality QA retrieval. This paper outlines a promising direction for improving the accuracy and efficiency of contradiction retrieval in large-scale text corpora.

SynC: A Dense Retrieval Method based on Syntactical Contrastive Learning.

OssCSE: Overcoming Surface Structure Bias in Contrastive Learning for Unsupervised Sentence Embedding

Sentence-aware Contrastive Learning for Open-Domain Passage Retrieval

Span prompt dense passage retrieval for Chinese open domain question answering

SparseCL: Sparse Contrastive Learning for Contradiction Retrieval

PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval.

Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training

Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models

InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings

CONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation

ControlRetriever: Harnessing the Power of Instructions for Controllable Retrieval

Unsupervised Dense Information Retrieval with Contrastive Learning

Learning To Retrieve: How to Train a Dense Retrieval Model Effectively and Efficiently

Challenging Decoder helps in Masked Auto-Encoder Pre-training for Dense Passage Retrieval

DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings

Post-encoding and Contrastive Learning Method for Response Selection Task

Sparse, Dense, and Attentional Representations for Text Retrieval

More Robust Dense Retrieval with Contrastive Dual Learning

Densifying Sparse Representations for Passage Retrieval by Representational Slicing

Noise-Robust Dense Retrieval via Contrastive Alignment Post Training

CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search