CPDScorer: Modeling and Evaluating Developer Programming Ability Across Software Communities.

Weizhi Huang,Wenkai Mo,Beijun Shen,Yu Yang,Ning Li

DOI: https://doi.org/10.18293/seke2016-012

2016-01-01

Abstract:Since developer ability is recognized as a determinant of better software project performance, it is a critical step to model and evaluate the programming ability of developers.However, most existing approaches require manual assessment, like 360 degree performance evaluation.With the emergence of social networking sites such as StackOverflow and Github, a vast amount of developer information is created on a daily basis.Such personal and social context data has huge potential to support automatic and effective developer ability evaluation.In this paper, we propose CPDScorer, a novel approach to modeling and scoring the programming ability of developer through mining heterogeneous information from both Community Question Answering (CQA) sites and Open-Source Software (OSS) communities.CPDScorer analyzes the answers posted in CQA sites and evaluates the projects submitted in OSS communities to assign expertise scores to developers, considering both the quantitative and qualitative factors.When modeling the programming ability of developer, a programming ability term extraction algorithm is also designed based on set covering.We have conducted experiments on StackOverflow and Github to measure the effectiveness of CPDScorer.The results show that our approach is feasible and practical in user programming ability modeling.In particular, the precision of our approach reaches 80%.