Abstract:Research data sets are growing to unprecedented sizes and network modeling is commonly used to extract complex relationships in diverse domains, such as genetic interactions involved in disease, logistics, and social communities. As the number of nodes increases in a network, an increasing sparsity of edges is a practical limitation due to memory restrictions. Moreover, many of these sparse networks exhibit very large numbers of nodes with no adjacent edges, as well as disjoint components of nodes with no edges connecting them. A prevalent aim in network modeling is the identification of clusters, or communities, of nodes that are highly interrelated. Several definitions of strong community structure have been introduced to facilitate this task, each with inherent assumptions and biases. We introduce an intuitive objective function for quantifying the quality of clustering results in large sparse networks. We utilize a two-step method for identifying communities which is especially well-suited for this domain as the first step efficiently divides the network into the disjoint components, while the second step optimizes clustering of the produced components based on the new objective. Using simulated networks, optimization based on the new objective function consistently yields significantly higher accuracy than those based on the modularity function, with the widest gaps appearing for the noisiest networks. Additionally, applications to benchmark problems illustrate the intuitive correctness of our approach. Finally, the practicality of our approach is demonstrated in real-world data in which we identify complex genetic interactions in large-scale networks comprised of tens of thousands of nodes. Based on these three different types of trials, our results clearly demonstrate the usefulness of our two-step procedure and the accuracy of our simple objective.

Constraint-Based Clustering to Find Communities in a Social Network

Constraint-based Clustering by Fast Search and Find of Density Peaks

Scalable Community Discovery of Large Networks

Model-based clustering in networks with Stochastic Community Finding

Constrained Community Detection in Social Networks

SAG Cluster: An unsupervised graph clustering based on collaborative similarity for community detection in complex networks

Well-Connected Communities in Real-World and Synthetic Networks

Sifting out communities in large sparse networks

Semi-supervised Selective Clustering Ensemble based on constraint information

Two provably consistent divide and conquer clustering algorithms for large networks

A multilevel clustering technique for community detection

Clustering and Community Detection with Imbalanced Clusters

A new clustering method and its application in social networks

Local Intrinsic Density Based Community Detection Using Branch-and-Bound and Minimum Spanning Tree

Finding community structure in spatially constrained complex networks

Game Theoretic Clustering for Finding Strong Communities

Constrained Hierarchical Clustering via Graph Coarsening and Optimal Cuts

Exploiting small world property for network clustering

Identifying robust communities and multi-community nodes by combining top-down and bottom-up approaches to clustering

Refining Graph Partitioning For Social Network Clustering

DCC: A Cascade based Approach to Detect Communities in Social Networks