Abstract:Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval process. However, current dense retrievers require splitting documents into short passages that usually contain local, partial, and sometimes biased context, and highly depend on the splitting process. As a consequence, it may yield inaccurate and misleading hidden representations, thus deteriorating the final retrieval result. In this work, we propose Dense Hierarchical Retrieval (DHR), a hierarchical framework that can generate accurate dense representations of passages by utilizing both macroscopic semantics in the document and microscopic semantics specific to each passage. Specifically, a document-level retriever first identifies relevant documents, among which relevant passages are then retrieved by a passage-level retriever. The ranking of the retrieved passages will be further calibrated by examining the document-level relevance. In addition, hierarchical title structure and two negative sampling strategies (i.e., In-Doc and In-Sec negatives) are investigated. We apply DHR to large-scale open-domain QA datasets. DHR significantly outperforms the original dense passage retriever and helps an end-to-end QA system outperform the strong baselines on multiple open-domain QA benchmarks.

A Method of Passage-Based Document Retrieval in Question Answering System

An Answer Passage Retrieval Strategy for Web-Based Question Answering

Graph-Based Answer Passage Ranking for Question Answering

Hot-spot passage retrieval in question answering

Automatic question answering from Web documents

Passage retrieval for web-based question answering

A Neural Passage Model for Ad-hoc Document Retrieval.

Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answering

QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMs

Automatic question-answer pairs generation and question similarity mechanism in question answering system

A Multimodal Dense Retrieval Approach for Speech-Based Open-Domain Question Answering

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering

When to Read Documents or QA History: On Unified and Selective Open-domain QA

Dense Hierarchical Retrieval for Open-Domain Question Answering

Top K Relevant Passage Retrieval for Biomedical Question Answering

Hybrid and Collaborative Passage Reranking.

Multi-view Content-aware Indexing for Long Document Retrieval

Hierarchical Answer Selection Framework For Multi-Passage Machine Reading Comprehension

A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Context

A Hybrid Approach to DBQA