Abstract:Stack Overflow is a popular on-line question and answer site for software developers to share their experience and expertise. Among the numerous questions posted in Stack Overflow, two or more of them may express the same point and thus are duplicates of one another. Duplicate questions make Stack Overflow site maintenance harder, waste resources that could have been used to answer other questions, and cause developers to unnecessarily wait for answers that are already available. To reduce the problem of duplicate questions, Stack Overflow allows questions to be manually marked as duplicates of others. Since there are thousands of questions submitted to Stack Overflow every day, manually identifying duplicate questions is a difficult work. Thus, there is a need for an automated approach that can help in detecting these duplicate questions. To address the above-mentioned need, in this paper, we propose an automated approach named DupPredictor that takes a new question as input and detects potential duplicates of this question by considering multiple factors. DupPredictor extracts the title and description of a question and also tags that are attached to the question. These pieces of information (title, description, and a few tags) are mandatory information that a user needs to input when posting a question. DupPredictor then computes the latent topics of each question by using a topic model. Next, for each pair of questions, it computes four similarity scores by comparing their titles, descriptions, latent topics, and tags. These four similarity scores are finally combined together to result in a new similarity score that comprehensively considers the multiple factors. To examine the benefit of DupPredictor, we perform an experiment on a Stack Overflow dataset which contains a total of more than two million questions. The result shows that DupPredictor can achieve a recall-rate@20 score of 63.8%. We compare our approach with the standard search engine of Stack Overflow, and DupPredictor improves its recall-rate@10 score by 40.63%. We also compare our approach with approaches that only use title, description, topic, and tag similarity and Runeson et al.’s approach that has been used to detect duplicate bug reports, and DupPredictor improves their recall-rate@10 scores by 27.2%, 97.4%, 746.0%, 231.1%, and 16.4% respectively.

Feature Analysis for Duplicate Detection in Programming QA Communities.

An Intent-based and Annotation-free Method for Duplicate Question Detection in CQA Forums

Duplicate Pull Request Detection

Detecting Duplicate Questions in Stack Overflow Via Source Code Modeling

Detecting Duplicate Questions in Stack Overflow Via Deep Learning Approaches

Multi-Factor Duplicate Question Detection in Stack Overflow

Detecting Duplicate Questions in Stack Overflow Via Semantic and Relevance Approaches

Mining Duplicate Questions of Stack Overflow

Similar Question Retrieval with Incorporation of Multi-Dimensional Quality Analysis for Community Question Answering

Answer Quality Analysis on Community Question Answering

A Topic Clustering Approach to Finding Similar Questions from Large Question and Answer Archives

Enhanced Answer Selection in CQA Using Multi-Dimensional Features Combination

Enhancing User Experience on Q&A Platforms: Measuring Text Similarity Based on Hybrid CNN-LSTM Model for Efficient Duplicate Question Detection

MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain

Detecting high-quality posts in community question answering sites

ProCQA: A Large-scale Community-based Programming Question Answering Dataset for Code Search

Quality Matters: Assessing Cqa Pair Quality Via Transductive Multi-View Learning

Efficient Near-Duplicate Detection for Q&A Forum.

A Length-variable Feature Code Based Fuzzy Duplicates Elimination Approach for Large Scale Chinese WebPages.

A New Question Analysis Approach for Community Question Answering System.

A Context Approach to Measuring Similarity Between Questions in the Community-Based QA Services.