An Empirical Study of Reviewer Recommendation in Pull-based Development Model

Cheng Yang,Xunhui Zhang,Lingbin Zeng,Qiang Fan,Gang Yin,Huaimin Wang
DOI: https://doi.org/10.1145/3131704.3131718
2017-01-01
Abstract:Code review is an important process to reduce code defects and improve software quality. However, in social coding communities using the pull-based model, everyone can submit code changes, which increases the required code review efforts. Therefore, there is a great need of knowing the process of code review and analyzing the pre-existing reviewer recommendation algorithms. In this paper, we do an empirical study about the PRs and their reviewers in Rails project. Moreover, we reproduce a popular and effective IR-based code reviewer recommendation algorithm and validate it on our dataset which contains 16,049 PRs. We find that the inactive reviewers are very important to code reviewing process, however, the pre-existing method's recommendation result strongly depends on the activeness of reviewers.
What problem does this paper attempt to address?