Abstract:Research data sets are growing to unprecedented sizes and network modeling is commonly used to extract complex relationships in diverse domains, such as genetic interactions involved in disease, logistics, and social communities. As the number of nodes increases in a network, an increasing sparsity of edges is a practical limitation due to memory restrictions. Moreover, many of these sparse networks exhibit very large numbers of nodes with no adjacent edges, as well as disjoint components of nodes with no edges connecting them. A prevalent aim in network modeling is the identification of clusters, or communities, of nodes that are highly interrelated. Several definitions of strong community structure have been introduced to facilitate this task, each with inherent assumptions and biases. We introduce an intuitive objective function for quantifying the quality of clustering results in large sparse networks. We utilize a two-step method for identifying communities which is especially well-suited for this domain as the first step efficiently divides the network into the disjoint components, while the second step optimizes clustering of the produced components based on the new objective. Using simulated networks, optimization based on the new objective function consistently yields significantly higher accuracy than those based on the modularity function, with the widest gaps appearing for the noisiest networks. Additionally, applications to benchmark problems illustrate the intuitive correctness of our approach. Finally, the practicality of our approach is demonstrated in real-world data in which we identify complex genetic interactions in large-scale networks comprised of tens of thousands of nodes. Based on these three different types of trials, our results clearly demonstrate the usefulness of our two-step procedure and the accuracy of our simple objective.

Efficient Identification of Linchpin Vertices in Dependence Clusters

Build system analysis with link prediction.

Visual Exploration of Dependency Graph in Source Code Via Embedding-Based Similarity.

An Empirical Study on Dependence Clusters for Effort-Aware Fault-Proneness Prediction

Matching Dependence-Related Queries in the System Dependence Graph

Dependence Analysis for Java

Efficient Parallel D-Core Decomposition at Scale

Profiling Dependence Vectors for Loop Parallelization.

Detecting highly overlapping community structure by greedy clique expansion

Scalable and Effective Conductance-based Graph Clustering

DCCD: an Efficient and Scalable Distributed Code Clone Detection Technique for Big Code

Discovering critical vertices for reinforcement of large-scale bipartite networks

Identifying Features in Forks

Optimal Parallel Algorithms for Dendrogram Computation and Single-Linkage Clustering

Sifting out communities in large sparse networks

Efficient maximum clique computation and enumeration over large sparse graphs

A Fast Parallel Approach for Neighborhood-based Link Prediction by Disregarding Large Hubs

An Efficient and Exact Algorithm for Locally h-Clique Densest Subgraph Discovery

An Approach to Analyzing Dependence Based on Exception Propagation Analysis

Identification of Device Dependencies Using Link Prediction

Identifying Non-Control Security-Critical Data through Program Dependence Learning