Abstract:Contradiction retrieval refers to identifying and extracting documents that explicitly disagree with or refute the content of a query, which is important to many downstream applications like fact checking and data cleaning. To retrieve contradiction argument to the query from large document corpora, existing methods such as similarity search and crossencoder models exhibit significant limitations. The former struggles to capture the essence of contradiction due to its inherent nature of favoring similarity, while the latter suffers from computational inefficiency, especially when the size of corpora is large. To address these challenges, we introduce a novel approach: SparseCL that leverages specially trained sentence embeddings designed to preserve subtle, contradictory nuances between sentences. Our method utilizes a combined metric of cosine similarity and a sparsity function to efficiently identify and retrieve documents that contradict a given query. This approach dramatically enhances the speed of contradiction detection by reducing the need for exhaustive document comparisons to simple vector calculations. We validate our model using the Arguana dataset, a benchmark dataset specifically geared towards contradiction retrieval, as well as synthetic contradictions generated from the MSMARCO and HotpotQA datasets using GPT-4. Our experiments demonstrate the efficacy of our approach not only in contradiction retrieval with more than 30% accuracy improvements on MSMARCO and HotpotQA across different model architectures but also in applications such as cleaning corrupted corpora to restore high-quality QA retrieval. This paper outlines a promising direction for improving the accuracy and efficiency of contradiction retrieval in large-scale text corpora.

Generating Triples Based on Dependency Parsing for Contradiction Detection.

Contrastive Triple Extraction with Generative Transformer

Adjacency List Oriented Relational Fact Extraction Via Adaptive Multi-task Learning.

Contradiction Detection with Contradiction-Specific Word Embedding

Relational Triple Extraction: One Step is Enough

A Bi-consolidating Model for Joint Relational Triple Extraction

Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency

Reasoning in Different Directions: Triplet Learning for Scene Graph Generation

SparseCL: Sparse Contrastive Learning for Contradiction Retrieval

Learning Reasoning Patterns for Relational Triple Extraction with Mutual Generation of Text and Graph

Contrastive Information Extraction with Generative Transformer

Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction.

Triple-To-Text: Converting Rdf Triples Into High-Quality Natural Languages Via Optimizing An Inverse Kl Divergence

RelU-Net: Syntax-aware Graph U-Net for Relational Triple Extraction.

Capturing divergence in dependency trees to improve syntactic projection

Jointly Modeling Fact Triples and Text Information for Knowledge Base Completion.

Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation

Leveraging Predicate and Triplet Learning for Scene Graph Generation

Triplet Contrastive Learning for Aspect Level Sentiment Classification