Abstract:Community Question Answering (CQA) sites such as Yahoo! Answers and Baidu Knows have emerged as rich knowledge resources for information seekers. However, answers posted to CQA sites often vary a lot in their qualities. User votes from the community may partially reflect the overall quality of the answer, but they are often missing. Hence, automatic selection of "good'' answers becomes a practical research problem that will help us manage the quality of accumulated knowledge. Without loss of generality, a good answer should deliver not only relevant but also trustworthy information that can help resolve the information needs of the posted question, but the latter has received less investigation in the past. In this paper, we propose a novel matching-verification framework for automatic answer selection. The matching component assesses the relevance of a candidate answer to a given question as conventional QA methods. The major enhancement is the verification component, which aims to leverage the wisdom of crowds, e.g., some big information repository, for trustworthiness measurement. Given a question, we take the top retrieved results from the information repository as the supporting evidences to distill the consensus representation. A major challenge is that there is no guarantee that one can always obtain reliable consensus from the wisdom of crowds for a question due to the noisy nature and the limitation of the existing search technology.Therefore, we decompose the trustworthiness measurement into two parts, i.e., a verification score which measures the consistency between a candidate answer and the consensus representation, and a confidence score which measures the reliability of the consensus itself. Empirical studies on three real-world CQA data collections, i.e. YahooQA, QuoraQA and AmazonQA, show that our approach can significantly outperform the state-of-the-art methods on the answer selection task.

A Maximum Entropy Model Based Confidence Scoring Algorithm for QA

A maximum entropy model based answer extraction for chinese question answering

Performance evaluation based on maximum entropy Markov model

A Quantum Expectation Value Based Language Model with Application to Question Answering

Combination of rough set theory and maximum entropy model for conjunctive structure detection in QA system

Semantic Chunk Annotation for questions using Maximum Entropy

Building Optimal Question Answering System Automatically Using Configuration Space Exploration (CSE) for QA4MRE 2013 Tasks.

ECNU: Using Multiple Sources of CQA-based Information for Answers Selection and YES/NO Response Inference.

AUnet: An Unsupervised Method for Answer Reliability Evaluation in Community QA Systems.

CFMatch: Aligning Automated Answer Equivalence Evaluation with Expert Judgments For Open-Domain Question Answering

Research on the Quality Prediction of Online Chinese Question Answering Community Answers Based on Comments.

Algorithm for Recommending Answer Providers in Community-Based Question Answering

Beyond Relevance: Trustworthy Answer Selection Via Consensus Verification.

An instance-based approach for pinpointing answers in Chinese question answering

QAScore -- An Unsupervised Unreferenced Metric for the Question Generation Evaluation

Optimal Answerer Ranking for New Questions in Community Question Answering

An Unsupervised Approach for Low-Quality Answer Detection in Community Question-Answering

Modeling and Analyzing Scorer Preferences in Short-Answer Math Questions

A New Question Analysis Approach for Community Question Answering System.

Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination

Answer Quality Analysis on Community Question Answering