Abstract:Research data sets are growing to unprecedented sizes and network modeling is commonly used to extract complex relationships in diverse domains, such as genetic interactions involved in disease, logistics, and social communities. As the number of nodes increases in a network, an increasing sparsity of edges is a practical limitation due to memory restrictions. Moreover, many of these sparse networks exhibit very large numbers of nodes with no adjacent edges, as well as disjoint components of nodes with no edges connecting them. A prevalent aim in network modeling is the identification of clusters, or communities, of nodes that are highly interrelated. Several definitions of strong community structure have been introduced to facilitate this task, each with inherent assumptions and biases. We introduce an intuitive objective function for quantifying the quality of clustering results in large sparse networks. We utilize a two-step method for identifying communities which is especially well-suited for this domain as the first step efficiently divides the network into the disjoint components, while the second step optimizes clustering of the produced components based on the new objective. Using simulated networks, optimization based on the new objective function consistently yields significantly higher accuracy than those based on the modularity function, with the widest gaps appearing for the noisiest networks. Additionally, applications to benchmark problems illustrate the intuitive correctness of our approach. Finally, the practicality of our approach is demonstrated in real-world data in which we identify complex genetic interactions in large-scale networks comprised of tens of thousands of nodes. Based on these three different types of trials, our results clearly demonstrate the usefulness of our two-step procedure and the accuracy of our simple objective.

Big network analytics based on nonconvex optimization

A Survey on Network Community Detection Based on Evolutionary Computation

The Networked Evolutionary Algorithm: A Network Science Perspective

Survey on Application of Evolutionary Algorithms in Complex Networks

Community Detection in Networks by Using Multiobjective Evolutionary Algorithm with Decomposition

Distributed Learning with Convex SUM-of -Non-convex Objective

A Network Reduction-Based Multiobjective Evolutionary Algorithm for Community Detection in Large-Scale Complex Networks

A Compression-Based Multi-Objective Evolutionary Algorithm for Community Detection in Social Networks.

Discrete Bacterial Foraging Optimization for Community Detection in Networks

Genetic representations for network design optimizations by evolutionary algorithm

A Multi-Objective Approach For Community Detection In Complex Network

Multiobjective Biogeography Based Optimization Algorithm with Decomposition for Community Detection in Dynamic Networks

Network Structural Balance Based on Evolutionary Multiobjective Optimization: A Two-Step Approach

MOEA-based community detection

An Attention-Based Multiobjective Optimization Evolutionary Algorithm for Community Detection in Attributed Networks

Sifting out communities in large sparse networks

Detecting Communities in Massive Networks Based on Local Community Attractive Force Optimization

An Evolutionary Multiobjective Framework for Complex Network Reconstruction Using Community Structure

Network Lasso: Clustering and Optimization in Large Graphs

Network Models and Optimization: Multiobjective Genetic Algorithm Approach

Overlapping Community Detection in Complex Networks Using Multi-Objective Evolutionary Algorithm