Abstract:Research data sets are growing to unprecedented sizes and network modeling is commonly used to extract complex relationships in diverse domains, such as genetic interactions involved in disease, logistics, and social communities. As the number of nodes increases in a network, an increasing sparsity of edges is a practical limitation due to memory restrictions. Moreover, many of these sparse networks exhibit very large numbers of nodes with no adjacent edges, as well as disjoint components of nodes with no edges connecting them. A prevalent aim in network modeling is the identification of clusters, or communities, of nodes that are highly interrelated. Several definitions of strong community structure have been introduced to facilitate this task, each with inherent assumptions and biases. We introduce an intuitive objective function for quantifying the quality of clustering results in large sparse networks. We utilize a two-step method for identifying communities which is especially well-suited for this domain as the first step efficiently divides the network into the disjoint components, while the second step optimizes clustering of the produced components based on the new objective. Using simulated networks, optimization based on the new objective function consistently yields significantly higher accuracy than those based on the modularity function, with the widest gaps appearing for the noisiest networks. Additionally, applications to benchmark problems illustrate the intuitive correctness of our approach. Finally, the practicality of our approach is demonstrated in real-world data in which we identify complex genetic interactions in large-scale networks comprised of tens of thousands of nodes. Based on these three different types of trials, our results clearly demonstrate the usefulness of our two-step procedure and the accuracy of our simple objective.

Identifying Community-Bridge Network Structures Via Bayesian Learning with Mixed Sparsity Mode

Sparse Bayesian Learning for Switching Network Identification

Sparse Bayesian Learning for Network Structure Reconstruction Based on Evolutionary Game Data

On Identification of Dynamical Structure Functions: A Sparse Bayesian Learning Approach.

Finding Community Structure in Bayesian Networks by Heuristic K-Standard Deviation Method

Identification of Nonlinear Sparse Networks Using Sparse Bayesian Learning

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

Complex Networks Identification Using Bayesian Model With Independent Laplace Prior

Community Detection in Sparse Networks Using the Symmetrized Laplacian Inverse Matrix (SLIM)

On Identification of Sparse Multivariable ARX Model: A Sparse Bayesian Learning Approach

Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Models

Network Structure Exploration Via Bayesian Nonparametric Models

Estimating Topology of Complex Networks Based on Sparse Bayesian Learning

Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring

Sifting out communities in large sparse networks

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors

Sparse Dynamical Boltzmann Machine for Reconstructing Complex Networks with Binary Dynamics

HB-DSBM: Modeling the Dynamic Complex Networks From Community Level to Node Level

Joint Detection of Community and Structural Hole Spanner of Networks in Hyperbolic Space

Network Structure Exploration in Networks with Node Attributes

Structural Regularity Exploration in Multidimensional Networks Via Bayesian Inference