Abstract:Research data sets are growing to unprecedented sizes and network modeling is commonly used to extract complex relationships in diverse domains, such as genetic interactions involved in disease, logistics, and social communities. As the number of nodes increases in a network, an increasing sparsity of edges is a practical limitation due to memory restrictions. Moreover, many of these sparse networks exhibit very large numbers of nodes with no adjacent edges, as well as disjoint components of nodes with no edges connecting them. A prevalent aim in network modeling is the identification of clusters, or communities, of nodes that are highly interrelated. Several definitions of strong community structure have been introduced to facilitate this task, each with inherent assumptions and biases. We introduce an intuitive objective function for quantifying the quality of clustering results in large sparse networks. We utilize a two-step method for identifying communities which is especially well-suited for this domain as the first step efficiently divides the network into the disjoint components, while the second step optimizes clustering of the produced components based on the new objective. Using simulated networks, optimization based on the new objective function consistently yields significantly higher accuracy than those based on the modularity function, with the widest gaps appearing for the noisiest networks. Additionally, applications to benchmark problems illustrate the intuitive correctness of our approach. Finally, the practicality of our approach is demonstrated in real-world data in which we identify complex genetic interactions in large-scale networks comprised of tens of thousands of nodes. Based on these three different types of trials, our results clearly demonstrate the usefulness of our two-step procedure and the accuracy of our simple objective.

Deciphering Network Community Structure by Surprise

Surprise maximization reveals the community structure of complex networks

SurpriseMe: an integrated tool for network community structure characterization using Surprise maximization

Scalable Community Discovery of Large Networks

Community detection in weighted brain connectivity networks beyond the resolution limit

Identifying multi-scale communities in networks by asymptotic surprise

Modularity and community structure in networks.

Uncovering Community Structure In Social Networks By Clique Correlation

Finding Community Structure Based on Subgraph Similarity

Community Structure in Large Networks: Natural Cluster Sizes and the Absence of Large Well-Defined Clusters

Community Structure in Time-Dependent, Multiscale, and Multiplex Networks

Community structure in social and biological networks

Deciphering the global organization of clustering in real complex networks

Scalable detection of statistically significant communities and hierarchies, using message-passing for modularity

Analysis of the structure of complex networks at different resolution levels

CSIM: A Fast Community Detection Algorithm Based on Structure Information Maximization

Community Detection via Maximization of Modularity and Its Variants

Beyond Asymptotics: Practical Insights into Community Detection in Complex Networks

Sifting out communities in large sparse networks

From clusters to queries: exploiting uncertainty in the modularity landscape of complex networks

How to Measure Significance of Community Structure in Complex Networks