ScaffdCF: A Prototype Interface for Managing Conflicts in Peer Review Process of Open Collaboration Projects

Wenjian Huang,Tun Lu,Ning Gu
DOI: https://doi.org/10.14257/ijdta.2017.10.12.02
2017-01-01
International Journal of Database Theory and Application
Abstract:Open collaboration projects (e.g., Wikipedia, open-source software projects) usually employ peer review mechanism to ensure the quality of productions.Due to the large variance of contributors and reviewers' backgrounds, expertise, and interests, conflicts are often unavoidable.Existing peer review systems do not support effective conflict management.This paper presents a prototype interface, named "ScaffdCF", for project reviewers and administrators to manage conflict more effectively.We identify three problems of existing peer review systems: 1) argument points are overwhelmed; 2) conflict management guidelines are lacking; and 3) contexts about members in conflict are lacking.To address these problems, ScaffdCF integrates new features to scaffold conflict management process.A survey-based user study shows that some features (e.g., highlighting arguments, explicitly expressing agreement or not) can help to manage conflict more effectively without significantly increasing administrators' cognitive overload.Meanwhile, some features (e.g., decomposition into sub-issues) fail.We discussed the limitations and future improvements.
What problem does this paper attempt to address?