Abstract:In a wide variety of emerging data-intensive applications, such as social network analysis, Web document clustering, entity resolution, and detection of consistently co-expressed genes in systems biology, the detection of dense subgraphs cliques and k-plex is an essential component. Unfortunately, these problems are NP-Complete and thus computationally intensive at scale hence there is a need to come up with techniques for distributing the computation across multiple machines such that the computation, which is too time-consuming on a single machine, can be efficiently performed on a machine cluster given that it is large enough.In this paper, we first propose a new approach for maximal clique and k-plex enumeration, which identifies dense subgraphs by binary graph partitioning. Given a connected graph G = (V, E), it has a space complexity of O(|E|) and a time complexity of O(|E|mu(G)), where mu(G) represents the number of different cliques (k-plexes) existing in G. It recursively divides a graph until each task is sufficiently small to be processed in parallel. We then develop parallel solutions and demonstrate how graph partitioning can enable effective load balancing. Finally, we evaluate the performance of the proposed approach on real and synthetic graph data and show that it performs considerably better than existing approaches in both centralized and parallel settings. In the parallel setting, it can achieve the speedups of up to 10x over existing approaches on large graphs. Our parallel algorithms are primarily implemented and evaluated on MapReduce, a popular shared-nothing parallel framework, but can easily generalize to other shared nothing or shared-memory parallel frameworks. The work presented in this paper is an extension of our preliminary work on the approach of binary graph partitioning for maximal clique enumeration. In this work, we extend the proposed approach to handle maximal k-plex detection as well. (C) 2017 Elsevier Inc. All rights reserved.

Graphical Representation and Hierarchical Decomposition Mechanism for Vertex-Cover Solution Space

Hierarchical Decomposition Mechanism by König-Egérvary Layer-Subgraph with Application on Vertex-Cover

Hierarchical Decomposition Mechanism by K\"{o}nig-Eg\'{e}rvary Layer-Subgraph with Application on Vertex-Cover

Research on Solution Space of Bipartite Graph Vertex-Cover by Maximum Matchings

Detecting the Solution Space of Vertex Cover by Mutual Determinations and Backbones

Statistics and Algorithms on the Organization and Quantitative Analysis of Minimal Vertex Covers.

Organization mechanism and counting algorithm on Vertex-Cover solutions

An Algorithm for Minimum Vertex Cover Based on Max-I Share Degree

Kernelization of 2-Vertex for Vertex Cover in Random Graphs Based on Subgraphs

An approximation algorithm for minimum vertex cover on general graphs

Parallelizing Maximal Clique and K-Plex Enumeration over Graph Data

Critical Graphs for Minimum Vertex Cover

A Note on Vertex Cover in Graphs with Maximum Degree 3

Finding the Best k in Core Decomposition: A Time and Space Optimal Solution

Solution-space structure of (some) optimization problems

A Hybrid Evolutionary Algorithm With Taboo And Competition Strategies For Minimum Vertex Cover Problem

Efficient Progressive Minimum K-Core Search

Finding Optimal Solutions with Neighborly Help

Finding A Small Vertex Cover in Massive Sparse Graphs: Construct, Local Search, and Preprocess

Efficient Graph Hierarchical Decomposition with User Engagement and Tie Strength

Simulated Hill Climbing Search for the Solutions of K-Vertex Cut Problems