Abstract:We study the problem of question retrieval in community question answering (CQA). The biggest challenge within this task is lexical gaps between questions since similar questions are usually expressed with different but semantically related words. To bridge the gaps, state-of-the-art methods incorporate extra information such as word-to-word translation and categories of questions into the traditional language models. We find that the existing language model based methods can be interpreted using a new framework, that is they represent words and question categories in a vector space and calculate question-question similarities with a linear combination of dot products of the vectors. The problem is that these methods are either heuristic on data representation or difficult to scale up. We propose a principled and efficient approach to learning representations of data in CQA. In our method, we simultaneously learn vectors of words and vectors of question categories by optimizing an objective function naturally derived from the framework. In question retrieval, we incorporate learnt representations into traditional language models in an effective and efficient way. We conduct experiments on large scale data from Yahoo! Answers and Baidu Knows, and compared our method with state-of-the-art methods on two public data sets. Experimental results show that our method can significantly improve on baseline methods for retrieval relevance. On 1 million training data, our method takes less than 50 minutes to learn a model on a single multicore machine, while the translation based language model needs more than 2 days to learn a translation table on the same machine.

Predicting Best Answerers for New Questions: An Approach Leveraging Distributed Representations of Words in Community Question Answering

Predicting Best Answerers for New Questions: An Approach Leveraging Convolution Neural Networks in Community Question Answering.

Toward Personalized Activity Level Prediction in Community Question Answering Websites

Learning Distributed Representations of Data in Community Question Answering for Question Retrieval

Predicting Best Responder in Community Question Answering Using Topic Model Method.

Optimal Answerer Ranking for New Questions in Community Question Answering

Algorithm for Recommending Answer Providers in Community-Based Question Answering

Community-Based Question Answering Via Heterogeneous Social Network Learning

Question Retrieval with High Quality Answers in Community Question Answering.

Analyzing and Predicting Not-Answered Questions in Community-based Question Answering Services.

Community-Based Question Answering Via Asymmetric Multi-Faceted Ranking Network Learning.

Scalable Algorithms for CQA Post Voting Prediction

Retrieving people: Identifying potential answerers in community question‐answering

TSAR-based Expert Recommendation Mechanism for Community Question Answering

Finding Experts in Community Question Answering Based on Topic-Sensitive Link Analysis.

Leading Users Detecting Model in Professional Community Question Answering Services

Joint Voting Prediction for Questions and Answers in CQA.

Personalized Recommendation for New Questions in Community Question Answering.

Tapping on the Potential of Q&a Community by Recommending Answer Providers

Subordinating to the majority: Factoid question answering over CQA sites