Abstract:Stack Overflow is a popular on-line question and answer site for software developers to share their experience and expertise. Among the numerous questions posted in Stack Overflow, two or more of them may express the same point and thus are duplicates of one another. Duplicate questions make Stack Overflow site maintenance harder, waste resources that could have been used to answer other questions, and cause developers to unnecessarily wait for answers that are already available. To reduce the problem of duplicate questions, Stack Overflow allows questions to be manually marked as duplicates of others. Since there are thousands of questions submitted to Stack Overflow every day, manually identifying duplicate questions is a difficult work. Thus, there is a need for an automated approach that can help in detecting these duplicate questions. To address the above-mentioned need, in this paper, we propose an automated approach named DupPredictor that takes a new question as input and detects potential duplicates of this question by considering multiple factors. DupPredictor extracts the title and description of a question and also tags that are attached to the question. These pieces of information (title, description, and a few tags) are mandatory information that a user needs to input when posting a question. DupPredictor then computes the latent topics of each question by using a topic model. Next, for each pair of questions, it computes four similarity scores by comparing their titles, descriptions, latent topics, and tags. These four similarity scores are finally combined together to result in a new similarity score that comprehensively considers the multiple factors. To examine the benefit of DupPredictor, we perform an experiment on a Stack Overflow dataset which contains a total of more than two million questions. The result shows that DupPredictor can achieve a recall-rate@20 score of 63.8%. We compare our approach with the standard search engine of Stack Overflow, and DupPredictor improves its recall-rate@10 score by 40.63%. We also compare our approach with approaches that only use title, description, topic, and tag similarity and Runeson et al.’s approach that has been used to detect duplicate bug reports, and DupPredictor improves their recall-rate@10 scores by 27.2%, 97.4%, 746.0%, 231.1%, and 16.4% respectively.

Predicting Which Pull Requests Will Get Reopened in GitHub

Automatic, High Accuracy Prediction of Reopened Bugs

Early Prediction of Merged Code Changes to Prioritize Reviewing Tasks

Duplicate Pull Request Detection

Just-In-Time TODO-Missed Commits Detection

A Comparative Study of Supervised Learning Algorithms for Re-opened Bug Prediction.

Predicting the First Response Latency of Maintainers and Contributors in Pull Requests

Accurate Developer Recommendation For Bug Resolution

Which Pull Requests Get Accepted and Why? A study of popular NPM Packages

Deep Learning for Just-In-Time Defect Prediction

BugPre: an intelligent software version-to-version bug prediction system using graph convolutional neural networks

Enhancing Software Maintenance: A Learning to Rank Approach for Co-changed Method Identification

Long-Term Active Integrator Prediction in the Evaluation of Code Contributions.

The Impact of Dormant Defects on Defect Prediction: A Study of 19 Apache Projects

Multi-Factor Duplicate Question Detection in Stack Overflow

ReBack: recommending backports in social coding environments

Effort-aware and just-in-time defect prediction with neural network

An Empirical Study on Code Review Activity Prediction and Its Impact in Practice

Parameter-efficient fine-tuning of pre-trained code models for just-in-time defect prediction

Characterization and Prediction of Popular Projects on GitHub

Predicting Recidivism With Machine Learning: An Analysis of Risk Factors and Proposal of Preventions