Abstract:Stack Overflow is a popular on-line question and answer site for software developers to share their experience and expertise. Among the numerous questions posted in Stack Overflow, two or more of them may express the same point and thus are duplicates of one another. Duplicate questions make Stack Overflow site maintenance harder, waste resources that could have been used to answer other questions, and cause developers to unnecessarily wait for answers that are already available. To reduce the problem of duplicate questions, Stack Overflow allows questions to be manually marked as duplicates of others. Since there are thousands of questions submitted to Stack Overflow every day, manually identifying duplicate questions is a difficult work. Thus, there is a need for an automated approach that can help in detecting these duplicate questions. To address the above-mentioned need, in this paper, we propose an automated approach named DupPredictor that takes a new question as input and detects potential duplicates of this question by considering multiple factors. DupPredictor extracts the title and description of a question and also tags that are attached to the question. These pieces of information (title, description, and a few tags) are mandatory information that a user needs to input when posting a question. DupPredictor then computes the latent topics of each question by using a topic model. Next, for each pair of questions, it computes four similarity scores by comparing their titles, descriptions, latent topics, and tags. These four similarity scores are finally combined together to result in a new similarity score that comprehensively considers the multiple factors. To examine the benefit of DupPredictor, we perform an experiment on a Stack Overflow dataset which contains a total of more than two million questions. The result shows that DupPredictor can achieve a recall-rate@20 score of 63.8%. We compare our approach with the standard search engine of Stack Overflow, and DupPredictor improves its recall-rate@10 score by 40.63%. We also compare our approach with approaches that only use title, description, topic, and tag similarity and Runeson et al.’s approach that has been used to detect duplicate bug reports, and DupPredictor improves their recall-rate@10 scores by 27.2%, 97.4%, 746.0%, 231.1%, and 16.4% respectively.

Detecting Duplicate Pull-requests in GitHub

Duplicate Pull Request Detection

Detecting Similar Repositories On Github

DupHunter: Detecting Duplicate Pull Requests in Fork-Based Development

Redundancy, Context, and Preference: An Empirical Study of Duplicate Pull Requests in OSS Projects

Code Clone Detection: A Literature Review

Multi-Factor Duplicate Question Detection in Stack Overflow

Who Should Review This Change?: Putting Text and File Location Analyses Together for More Accurate Recommendations

Natural Language Processing Based Detection of Duplicate Defect Patterns

Analysis of Duplicate Issue Reports for Issue Tracking System

An approach to detecting duplicate bug reports using natural language and execution information

Practical Duplicate Bug Reports Detection in a Large Web-Based Development Community.

A Method for Identifying References Between Projects in GitHub

Enhancing Software Maintenance: A Learning to Rank Approach for Co-changed Method Identification

Detecting Duplicate Questions in Stack Overflow Via Source Code Modeling

An empirical study of code reuse between GitHub and stack overflow during software development

Detecting Differences Across Multiple Instances of Code Clones

Detecting Near Duplicates in Software Documentation

CORRECT: Code Reviewer Recommendation in GitHub Based on Cross-Project and Technology Experience

Recommending relevant projects via user behaviour: an exploratory study on github.

Looking for related discussions on GitHub Discussions