Advancing Modern Code Review Effectiveness through Human Error Mechanisms

Fuqun Huang,Henrique Madeira
DOI: https://doi.org/10.1016/j.jss.2024.112060
IF: 3.5
2024-04-16
Journal of Systems and Software
Abstract:Modern code reviews tend to take a lightweight process, in which the accuracy and efficiency of identifying defects rely heavily on code reviewers' experience. The human errors of developers, as a significant cause of software defects, is a key to identifying defects. However, there is a lack of understanding of the human error mechanisms underlying defects in code. This paper proposes an innovative code review method for identifying defects by pinpointing the scenarios that developers tend to commit errors. The method was validated by two experimental studies that involved 40 participants of about 5 years' programming experience and modest code review experience. The experiment shows that the proposed method has significantly improved True Positives and Sensitivity by about 400%, improved Precision by approximately 200%, and reduced around one-third of False Positives. The effects were consistent across different tasks and different code reviewers.
computer science, theory & methods, software engineering
What problem does this paper attempt to address?