Abstract:We study the problem of structural graph clustering, a fundamental problem in managing and analyzing graph data. Given an undirected unweighted graph, structural graph clustering is to assign vertices to clusters, and to identify the sets of hub vertices and outlier vertices as well, such that vertices in the same cluster are densely connected to each other while vertices in different clusters are loosely connected. In this paper, we develop a new two-step paradigm for scalable structural graph clustering based on our three observations. Then, we present a <inline-formula> <tex-math notation="LaTeX">$\mathsf {pSCAN}$</tex-math><alternatives> <inline-graphic xlink:href="chang-ieq2-2618795.gif"/></alternatives></inline-formula> approach, within the paradigm, aiming to reduce the number of structural similarity computations, and propose optimization techniques to speed up checking whether two vertices are structure-similar. <inline-formula><tex-math notation="LaTeX">$\mathsf {pSCAN}$ </tex-math><alternatives><inline-graphic xlink:href="chang-ieq3-2618795.gif"/></alternatives></inline-formula> outputs exactly the same clusters as the existing approaches <inline-formula><tex-math notation="LaTeX">$\mathsf {SCAN}$ </tex-math><alternatives><inline-graphic xlink:href="chang-ieq4-2618795.gif"/></alternatives></inline-formula> and <inline-formula><tex-math notation="LaTeX">$\mathsf {SCAN\text{++}}$</tex-math><alternatives> <inline-graphic xlink:href="chang-ieq5-2618795.gif"/></alternatives></inline-formula>, and we prove that <inline-formula><tex-math notation="LaTeX">$\mathsf {pSCAN}$</tex-math><alternatives> <inline-graphic xlink:href="chang-ieq6-2618795.gif"/></alternatives></inline-formula> is worst-case optimal. Moreover, we propose efficient techniques for updating the clusters when the input graph dynamically changes, and we also extend our techniques to other similarity measures, e.g., Jaccard similarity. Performance studies on large real and synthetic graphs demonstrate the efficiency of our new approach and our dynamic cluster maintenance techniques. Noticeably, for the twitter graph with 1 billion edges, our approach takes 25 minutes while the state-of-the-art approach cannot finish even after 24 hours.

Clustering Algorithms for Large-scale Social Networks Based on Structural Similarity

PSCAN: A Parallel Structural Clustering Algorithm for networks

Distributed structural clustering on large graph

Parallel Index-Based Structural Graph Clustering and Its Approximation

An Efficient Algorithm for Distance-based Structural Graph Clustering

Parallel Algorithm for Discovering Communities in Large-Scale Complex Networks

$\mathsf {pSCAN}$ : Fast and Exact Structural Graph Clustering

Research on a large-scale community detection algorithm based on non-weighted graph

Randomized Spectral Co-Clustering for Large-Scale Directed Networks

Research On The Parallelization Of The Dbscan Clustering Algorithm For Spatial Data Mining Based On The Spark Platform

Index-based Structural Clustering on Directed Graphs

Towards Distributed Node Similarity Search on Graphs

Large-Scale Social Network Analysis Based on MapReduce

Identifying Influential Nodes in Large-Scale Directed Networks: The Role of Clustering

Distributed Parallel Structural Hole Detection on Big Graphs

A Parallel DBSCAN Algorithm Based on Spark

Parallel Community Detection on Large Networks with Propinquity Dynamics

A Two-Tier Partition Algorithm for the Optimization of the Large-Scale Simulation of Information Diffusion in Social Networks.

A Parallel Computing Model for Large-Graph Mining with MapReduce.

Clustering Large Attributed Information Networks: an Efficient Incremental Computing Approach.

Maximal Influence Spread for Social Network Based on MapReduce