Abstract:Community discovery plays an essential role in the analysis of the structural features of complex networks. Since online networks grow increasingly large and complex over time, the methods traditionally used for community discovery cannot efficiently handle large-scale network data. This introduces the important problem of how to effectively and efficiently discover large communities from complex networks. In this study, we propose a fast parallel community discovery model called picaso (a parallel community discovery a lgorithm based on approximate optimization), which integrates two new techniques: (1) Mountain model, which works by utilizing graph theory to approximate the selection of nodes needed for merging, and (2) Landslide algorithm, which is used to update the modularity increment based on the approximated optimization. In addition, the GraphX distribution computing framework is employed in order to achieve parallel community detection over complex networks. In the proposed model, clustering on modularity is used to initialize the Mountain model as well as to compute the weight of each edge in the networks. The relationships among the communities are then simplified by applying the Landslide algorithm, which allows us to obtain the community structures of the complex networks. Extensive experiments were conducted on real and synthetic complex network datasets, and the results demonstrate that the proposed algorithm can outperform the state of the art methods, in effectiveness and efficiency, when working to solve the problem of community detection. Moreover, we demonstratively prove that overall time performance approximates to four times faster than similar approaches. Effectively our results suggest a new paradigm for large-scale community discovery of complex networks.

Parallelizing and Optimizing Overlapping Community Detection with Speaker-Listener Label Propagation Algorithm on Multi-Core Architecture

SLPA: Uncovering Overlapping Communities in Social Networks via A Speaker-listener Interaction Dynamic Process

Scalable-Grain Pipeline Parallelization Method For Multi-Core Systems

A Scalable Community Detection Algorithm for Large Graphs Using Stochastic Block Models.

Detecting Overlapping Community Structures In Networks With Global Partition And Local Expansion

Towards Linear Time Overlapping Community Detection in Social Networks

Overlapping Community Detection Via Leader-Based Local Expansion in Social Networks

Efficient And Scalable Detection Of Overlapping Communities In Big Networks

Scalable inference for stochastic block models

Community Detection Using A Neighborhood Strength Driven Label Propagation Algorithm

A Fast Parallel Community Discovery Model on Complex Networks Through Approximate Optimization

A Streaming-based Algorithm for Overlapping Community Detection

Selecting a suitable Parallel Label-propagation based algorithm for Disjoint Community Detection

Parallel Community Detection on Large Networks with Propinquity Dynamics

A novel genetic algorithm for overlapping community detection

Scalable distributed Louvain algorithm for community detection in large graphs

An improved label propagation algorithm based on community core node and label importance for community detection in sparse network

Parallelization and Characterization of Probabilistic Latent Semantic Analysis

Role-based Label Propagation Algorithm for Community Detection.

A Distributed Community Detection Algorithm for Large Scale Networks under Stochastic Block Models

A FAST OVERLAPPING COMMUNITY DETECTION ALGORITHM BASED ON LABEL PROPAGATION AND SOCIAL NETWORK GRAPH CLUSTERING COEFFICIENT