Abstract:Community Question Answering (CQA) sites such as Yahoo! Answers and Baidu Knows have emerged as rich knowledge resources for information seekers. However, answers posted to CQA sites often vary a lot in their qualities. User votes from the community may partially reflect the overall quality of the answer, but they are often missing. Hence, automatic selection of "good'' answers becomes a practical research problem that will help us manage the quality of accumulated knowledge. Without loss of generality, a good answer should deliver not only relevant but also trustworthy information that can help resolve the information needs of the posted question, but the latter has received less investigation in the past. In this paper, we propose a novel matching-verification framework for automatic answer selection. The matching component assesses the relevance of a candidate answer to a given question as conventional QA methods. The major enhancement is the verification component, which aims to leverage the wisdom of crowds, e.g., some big information repository, for trustworthiness measurement. Given a question, we take the top retrieved results from the information repository as the supporting evidences to distill the consensus representation. A major challenge is that there is no guarantee that one can always obtain reliable consensus from the wisdom of crowds for a question due to the noisy nature and the limitation of the existing search technology.Therefore, we decompose the trustworthiness measurement into two parts, i.e., a verification score which measures the consistency between a candidate answer and the consensus representation, and a confidence score which measures the reliability of the consensus itself. Empirical studies on three real-world CQA data collections, i.e. YahooQA, QuoraQA and AmazonQA, show that our approach can significantly outperform the state-of-the-art methods on the answer selection task.

A Research on the Text Reliability Based on Evidentiality.

Evidentiality for text trustworthiness detection

Incorporate Credibility Into Context For The Best Social Media Answers

Research on Information Credibility based on Web Text

A tentative study on the annotation of evidentiality

Beyond Relevance: Trustworthy Answer Selection Via Consensus Verification.

A Typological Research on Evidentiality of Chinese News Text and English News Text

Credible, Unreliable or Leaked?: Evidence Verification for Enhanced Automated Fact-checking

Answer Extraction Based on System Similarity Model and Stratified Sampling Logistic Regression in Rare Date

A Survey on Automatic Credibility Assessment of Textual Credibility Signals in the Era of Large Language Models

Evaluating the Credibility of Web Information Based on Content Trust

Veracity Computing from Lexical Cues and Perceived Certainty Trends

Evaluating Consistencies in LLM responses through a Semantic Clustering of Question Answering

Give Me More Details: Improving Fact-Checking with Latent Retrieval

RELIANCE: Reliable Ensemble Learning for Information and News Credibility Evaluation

A New Document Retrieval Model Using Dempster-Shafer Theory of Evidence

Leveraging Textual Features for Best Answer Prediction in Community-based Question Answering

Quantifying the Role of Textual Predictability in Automatic Speech Recognition

ECNU: Using Multiple Sources of CQA-based Information for Answers Selection and YES/NO Response Inference.

A Text Analysis Based Method for Obtaining Credibility Assessment of Chinese Microblog Users.

A Semantic Relevancy Measure Algorithm of Chinese Sentences.