Abstract:Stack Overflow is a popular on-line question and answer site for software developers to share their experience and expertise. Among the numerous questions posted in Stack Overflow, two or more of them may express the same point and thus are duplicates of one another. Duplicate questions make Stack Overflow site maintenance harder, waste resources that could have been used to answer other questions, and cause developers to unnecessarily wait for answers that are already available. To reduce the problem of duplicate questions, Stack Overflow allows questions to be manually marked as duplicates of others. Since there are thousands of questions submitted to Stack Overflow every day, manually identifying duplicate questions is a difficult work. Thus, there is a need for an automated approach that can help in detecting these duplicate questions. To address the above-mentioned need, in this paper, we propose an automated approach named DupPredictor that takes a new question as input and detects potential duplicates of this question by considering multiple factors. DupPredictor extracts the title and description of a question and also tags that are attached to the question. These pieces of information (title, description, and a few tags) are mandatory information that a user needs to input when posting a question. DupPredictor then computes the latent topics of each question by using a topic model. Next, for each pair of questions, it computes four similarity scores by comparing their titles, descriptions, latent topics, and tags. These four similarity scores are finally combined together to result in a new similarity score that comprehensively considers the multiple factors. To examine the benefit of DupPredictor, we perform an experiment on a Stack Overflow dataset which contains a total of more than two million questions. The result shows that DupPredictor can achieve a recall-rate@20 score of 63.8%. We compare our approach with the standard search engine of Stack Overflow, and DupPredictor improves its recall-rate@10 score by 40.63%. We also compare our approach with approaches that only use title, description, topic, and tag similarity and Runeson et al.’s approach that has been used to detect duplicate bug reports, and DupPredictor improves their recall-rate@10 scores by 27.2%, 97.4%, 746.0%, 231.1%, and 16.4% respectively.

Predicting Rollback Edits on Stack Overflow Based on Deep Fusion of Metadata and Text

Who Should Review This Change?: Putting Text and File Location Analyses Together for More Accurate Recommendations

Characterizing and Identifying Reverted Commits

Predicting Collaborative Edits of Questions and Answers in Online Q&A Sites

Deep Learning for Just-In-Time Defect Prediction

DeepAnna: Deep Learning Based Java Annotation Recommendation and Misuse Detection

Automatic Document Metadata Extraction Based on Deep Networks.

Multi-Factor Duplicate Question Detection in Stack Overflow

Discovering, Explaining and Summarizing Controversial Discussions in Community Q&A Sites

Beyond Trial-and-Error: Predicting User Abandonment After a Moderation Intervention

Reasons and Solutions for the Decline in Model Performance after Editing

Wear prediction model of hot rolling backup roll based on FEM + ML algorithm

RECAST: Interactive Auditing of Automatic Toxicity Detection Models

History Matters: Temporal Knowledge Editing in Large Language Model

RECAST: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization

Image Tampering Detection Using Error Level Analysis and Metadata Analysis

Efficiently Quantifying and Mitigating Ripple Effects in Model Editing

Quality Prediction of Open Educational Resources A Metadata-based Approach

DeepTagRec: A Content-cum-User Based Tag Recommendation Framework for Stack Overflow

Bridging Expert Knowledge with Deep Learning Techniques for Just-In-Time Defect Prediction

Detecting refactoring type of software commit messages based on ensemble machine learning algorithms