Abstract:Context: The pull-based model, widely used in distributed software development, offers an extremely low barrier to entry for potential contributors (anyone can submit of contributions to any project, through pull-requests). Meanwhile, the project's core team must act as guardians of code quality, ensuring that pull-requests are carefully inspected before being merged into the main development line. However, with pull-requests becoming increasingly popular, the need for qualified reviewers also increases. GitHub facilitates this, by enabling the crowd-sourcing of pull-request reviews to a larger community of coders than just the project's core team, as a part of their social coding philosophy. However, having access to more potential reviewers does not necessarily mean that it's easier to find the right ones (the "needle in a haystack" problem). If left unsupervised, this process may result in communication overhead and delayed pull-request processing.Objective: This study aims to investigate whether and how previous approaches used in bug triaging and code review can be adapted to recommending reviewers for pull-requests, and how to improve the recommendation performance.Method: First, we extend three typical approaches used in bug triaging and code review for the new challenge of assigning reviewers to pull-requests. Second, we analyze social relations between contributors and reviewers, and propose a novel approach by mining each project's comment networks (CNs). Finally, we combine the CNs with traditional approaches, and evaluate the effectiveness of all these methods on 84 GitHub projects through both quantitative and qualitative analysis.Results: We find that CN-based recommendation can achieve, by itself, similar performance as the traditional approaches. However, the mixed approaches can achieve significant improvements compared to using either of them independently.Conclusion: Our study confirms that traditional approaches to bug triaging and code review are feasible for pull-request reviewer recommendations on GitHub. Furthermore, their performance can be improved significantly by combining them with information extracted from prior social interactions between developers on GitHub. These results prompt for novel tools to support process automation in social coding platforms, that combine social (e.g., common interests among developers) and technical factors (e.g., developers' expertise).

Opportunities and Challenges in Repeated Revisions to Pull-Requests: an Empirical Study.

Revisiting Linus's Law: Benefits and Challenges of Open Source Software Peer Review.

Comparative Case Studies of Open Source Software Peer Review Practices

Behind Linus's law: A preliminary analysis of open source software peer review practices in Mozilla and Python

Duplicate Pull Request Detection

Why is My Code Change Abandoned?

Redundancy, Context, and Preference: An Empirical Study of Duplicate Pull Requests in OSS Projects

What Are the Characteristics of Reopened Pull Requests? A Case Study on Open Source Projects in GitHub

Code Reviewer Recommendation in Tencent: Practice, Challenge, and Direction*

Recommending Code Reviewers for Proprietary Software Projects: A Large Scale Study

Are You Still Working on This An Empirical Study on Pull Request Abandonment

How Developers Modify Pull Requests in Code Review

Reviewer Recommendation for Pull-Requests in GitHub: What Can We Learn from Code Review and Bug Assignment?

Who Should Review This Change?: Putting Text and File Location Analyses Together for More Accurate Recommendations

RevRec: A Two-Layer Reviewer Recommendation Algorithm in Pull-Based Development Model

An Empirical Study of Reviewer Recommendation in Pull-based Development Model

Effectiveness Of Code Contribution : From Patch-Based To Pull-Request-Based Tools

A Comparative Study of the Effects of Pull Request on GitHub Projects

How Do Multiple Pull Requests Change the Same Code: A Study of Competing Pull Requests in GitHub.

What Are They Talking About? Analyzing Code Reviews in Pull-Based Development Model

Pull Request Decision Explained: An Empirical Overview