Abstract:In a wide variety of emerging data-intensive applications, such as social network analysis, Web document clustering, entity resolution, and detection of consistently co-expressed genes in systems biology, the detection of dense subgraphs cliques and k-plex is an essential component. Unfortunately, these problems are NP-Complete and thus computationally intensive at scale hence there is a need to come up with techniques for distributing the computation across multiple machines such that the computation, which is too time-consuming on a single machine, can be efficiently performed on a machine cluster given that it is large enough.In this paper, we first propose a new approach for maximal clique and k-plex enumeration, which identifies dense subgraphs by binary graph partitioning. Given a connected graph G = (V, E), it has a space complexity of O(|E|) and a time complexity of O(|E|mu(G)), where mu(G) represents the number of different cliques (k-plexes) existing in G. It recursively divides a graph until each task is sufficiently small to be processed in parallel. We then develop parallel solutions and demonstrate how graph partitioning can enable effective load balancing. Finally, we evaluate the performance of the proposed approach on real and synthetic graph data and show that it performs considerably better than existing approaches in both centralized and parallel settings. In the parallel setting, it can achieve the speedups of up to 10x over existing approaches on large graphs. Our parallel algorithms are primarily implemented and evaluated on MapReduce, a popular shared-nothing parallel framework, but can easily generalize to other shared nothing or shared-memory parallel frameworks. The work presented in this paper is an extension of our preliminary work on the approach of binary graph partitioning for maximal clique enumeration. In this work, we extend the proposed approach to handle maximal k-plex detection as well. (C) 2017 Elsevier Inc. All rights reserved.

A Greedy Strategy for Graph Cut

MeanCut: A Greedy-Optimized Graph Clustering via Path-based Similarity and Degree Descent Criterion

A scalable clustering algorithm to approximate graph cuts

Approximate Normalized Cuts Without Eigen-decomposition

FINC: an Efficient and Effective Optimization Method for Normalized Cut

A Graph Clustering Algorithm Providing Scalability

A New Relaxation Approach to Normalized Hypergraph Cut

Normalized Cheeger Cut with Neighborhood Rough Approximation

A Novel Normalized-Cut Solver with Nearest Neighbor Hierarchical Initialization

Efficient Maximal Clique Enumeration Over Graph Data

A Graph Clustering Algorithm Based on Minimum and Normalized Cut

An improved multi-scale Graph cut algorithm

Global suppression heuristic: fast GraphCut in GPU for image stitching

Parallelizing Maximal Clique and K-Plex Enumeration over Graph Data

Normalized Gaussian Distance Graph Cuts for Image Segmentation

Fast Iterative Normalized Cut

Graph Cuts with Arbitrary Size Constraints Through Optimal Transport

Scalable Normalized Cut with Improved Spectral Rotation

A Novel Graph-Based Clustering Method Using Noise Cutting

In Search of Dense Subgraphs: How Good is Greedy Peeling?

Graph Clustering with Local Density-Cut