Algorithm for Detecting Overlapping Communities from Complex Network Big Data

Shao-Jie QIAO,Nan HAN,Kai-Feng ZHANG,Lei ZOU,Hong-Zhi WANG,Alberto Louis
DOI: https://doi.org/10.13328/j.cnki.jos.005155
2017-01-01
Journal of Software
Abstract:Currently,the number of Intemet users,along with complex networks including online social networks and electronic commerce networks,is growing explosively.To effectively and efficiently detecting overlapping community structure from complex network,big data plays an essential role in point of interest recommendation and hotspot propagation.In this study,a new algorithm over complex networks is proposed to detecting overlapping communities with a time complexity of O(nlog2(n)).The algorithm applies a new method for updating node and edge modularity based on the techniques of modularity clustering and graph computing.Balanced binary tree is used to index the modularity increment,and an overlapping community detection approach is provided based on the idea of modularity optimization to reduce the frequency of node analysis compared to traditional approaches.Experiments are conducted on real complex network big data,and the results show that the DOC algorithm can effectively detect overlapping communities with high accuracy,the normalized mutual information (NMI) can reach to 0.97 in large-scale LFR benchmark datasets,and the overlapping community detecting standard F-score value is averagely higher than 0.91.In addition,the runtime efficiency beats traditional approaches in complex network big data.
What problem does this paper attempt to address?