Abstract:Context: The pull-based model, widely used in distributed software development, offers an extremely low barrier to entry for potential contributors (anyone can submit of contributions to any project, through pull-requests). Meanwhile, the project's core team must act as guardians of code quality, ensuring that pull-requests are carefully inspected before being merged into the main development line. However, with pull-requests becoming increasingly popular, the need for qualified reviewers also increases. GitHub facilitates this, by enabling the crowd-sourcing of pull-request reviews to a larger community of coders than just the project's core team, as a part of their social coding philosophy. However, having access to more potential reviewers does not necessarily mean that it's easier to find the right ones (the "needle in a haystack" problem). If left unsupervised, this process may result in communication overhead and delayed pull-request processing.Objective: This study aims to investigate whether and how previous approaches used in bug triaging and code review can be adapted to recommending reviewers for pull-requests, and how to improve the recommendation performance.Method: First, we extend three typical approaches used in bug triaging and code review for the new challenge of assigning reviewers to pull-requests. Second, we analyze social relations between contributors and reviewers, and propose a novel approach by mining each project's comment networks (CNs). Finally, we combine the CNs with traditional approaches, and evaluate the effectiveness of all these methods on 84 GitHub projects through both quantitative and qualitative analysis.Results: We find that CN-based recommendation can achieve, by itself, similar performance as the traditional approaches. However, the mixed approaches can achieve significant improvements compared to using either of them independently.Conclusion: Our study confirms that traditional approaches to bug triaging and code review are feasible for pull-request reviewer recommendations on GitHub. Furthermore, their performance can be improved significantly by combining them with information extracted from prior social interactions between developers on GitHub. These results prompt for novel tools to support process automation in social coding platforms, that combine social (e.g., common interests among developers) and technical factors (e.g., developers' expertise).

Recommending Code Reviewers for Proprietary Software Projects: A Large Scale Study

Code Reviewer Recommendation in Tencent: Practice, Challenge, and Direction*

Code Reviewer Recommendation in Tencent

Who Should Review This Change?: Putting Text and File Location Analyses Together for More Accurate Recommendations

Comparative Case Studies of Open Source Software Peer Review Practices

RevRec: A Two-Layer Reviewer Recommendation Algorithm in Pull-Based Development Model

Code context-based reviewer recommendation

Code Reviewer Intelligent Prediction in Open Source Industrial Software Project

A Hybrid Approach to Code Reviewer Recommendation with Collaborative Filtering

Is There A "Golden" Rule for Code Reviewer Recommendation? : —An Experimental Evaluation

An Empirical Study of Reviewer Recommendation in Pull-based Development Model

CORRECT: Code Reviewer Recommendation in GitHub Based on Cross-Project and Technology Experience

Reviewer Recommendation for Pull-Requests in GitHub: What Can We Learn from Code Review and Bug Assignment?

Multi-Feature Based Personal Recommendation Approach for Open Source Project

A Code Reviewer Recommendation Approach Based on Attentive Neighbor Embedding Propagation

Improving Code Reviewer Recommendation: Accuracy, Latency, Workload, and Bystanders

RepoLike

Reviewer Recommender of Pull-Requests in GitHub

Code Reviewer Recommendation Based on a Hypergraph with Multiplex Relationships

Who Will Be Interested In? A Contributor Recommendation Approach for Open Source Projects.

TIRR: A Code Reviewer Recommendation Algorithm with Topic Model and Reviewer Influence.