Abstract:Community Question Answering (CQA) sites such as Yahoo! Answers and Baidu Knows have emerged as rich knowledge resources for information seekers. However, answers posted to CQA sites often vary a lot in their qualities. User votes from the community may partially reflect the overall quality of the answer, but they are often missing. Hence, automatic selection of "good'' answers becomes a practical research problem that will help us manage the quality of accumulated knowledge. Without loss of generality, a good answer should deliver not only relevant but also trustworthy information that can help resolve the information needs of the posted question, but the latter has received less investigation in the past. In this paper, we propose a novel matching-verification framework for automatic answer selection. The matching component assesses the relevance of a candidate answer to a given question as conventional QA methods. The major enhancement is the verification component, which aims to leverage the wisdom of crowds, e.g., some big information repository, for trustworthiness measurement. Given a question, we take the top retrieved results from the information repository as the supporting evidences to distill the consensus representation. A major challenge is that there is no guarantee that one can always obtain reliable consensus from the wisdom of crowds for a question due to the noisy nature and the limitation of the existing search technology.Therefore, we decompose the trustworthiness measurement into two parts, i.e., a verification score which measures the consistency between a candidate answer and the consensus representation, and a confidence score which measures the reliability of the consensus itself. Empirical studies on three real-world CQA data collections, i.e. YahooQA, QuoraQA and AmazonQA, show that our approach can significantly outperform the state-of-the-art methods on the answer selection task.

Re-ranking Answer Selection with Similarity Aggregation

Ranking via partial ordering for answer selection

Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering

Data-Driven Answer Selection in Community QA Systems.

aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model

Original Content Is All You Need! an Empirical Study on Leveraging Answer Summary for WikiHowQA Answer Selection Task.

Re-ranking search results using semantic similarity.

Beyond Relevance: Trustworthy Answer Selection Via Consensus Verification.

Optimal Answerer Ranking for New Questions in Community Question Answering

Dependency Relation Triples Matching for Question Answering

Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination

Enhancing the Ranking Context of Dense Retrieval Methods through Reciprocal Nearest Neighbors

Attentive Interactive Neural Networks for Answer Selection in Community Question Answering.

Enhancing Q&A Text Retrieval with Ranking Models: Benchmarking, fine-tuning and deploying Rerankers for RAG

SERank: Optimize Sequencewise Learning to Rank Using Squeeze-and-Excitation Network

Learning to Combine Answer Boundary Detection and Answer Re-ranking for Phrase-Indexed Question Answering

MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model

Search Result Reranking with Visual and Structure Information Sources

Addressing Community Question Answering in English and Arabic

LINKAGE: Listwise Ranking among Varied-Quality References for Non-Factoid QA Evaluation via LLMs

A comparative study on ranking and selection strategies for multi-document summarization