Abstract:Approximate graph pattern mining (A-GPM) is an important data analysis tool for many graph-based applications. There exist sampling-based A-GPM systems to provide automation and generalization over a wide variety of use cases. However, there are two major obstacles that prevent existing A-GPM systems being adopted in practice. First, the termination mechanism that decides when to end sampling lacks theoretical backup on confidence, and is unstable and slow in practice. Second, they suffer poor performance when dealing with the "needle-in-the-hay" cases, because a huge number of samples are required to converge, given the extremely low hit rate of their fixed sampling schemes. We build ScaleGPM, an accurate and fast A-GPM system that removes the two obstacles. First, we propose a novel on-the-fly convergence detection mechanism to achieve stable termination and provide theoretical guarantee on the confidence, with negligible overhead. Second, we propose two techniques to deal with the "needle-in-the-hay" problem, eager-verify and hybrid sampling. Our eager-verify method improves sampling hit rate by pruning unpromising candidates as early as possible. Hybrid sampling improves performance by automatically choosing the better scheme between fine-grained and coarse-grained sampling schemes. Experiments show that our online convergence detection mechanism can detect convergence and results in stable and rapid termination with theoretically guaranteed confidence. We show the effectiveness of eager-verify in improving the hit rate, and the scheme-selection mechanism in correctly choosing the better scheme for various cases. Overall, ScaleGPM achieves a geomean average of 565x (up to 610169x) speedup over the state-of-the-art A-GPM system, Arya. In particular, ScaleGPM handles billion-scale graphs in seconds, where existing systems either run out of memory or fail to complete in hours.

Exploiting Fine-Grained Redundancy in Set-Centric Graph Pattern Mining.

Efficient Algorithms for Summarizing Graph Patterns

GraphPi: High Performance Graph Pattern Matching through Effective Redundancy Elimination

GraphSet: High Performance Graph Mining Through Equivalent Set Transformations

Mining Top-k Minimal Redundancy Frequent Patterns over Uncertain Databases.

Efficient and Scalable Graph Pattern Mining on GPUs

Accurate and Fast Approximate Graph Pattern Mining at Scale

A GPU-based Graph Pattern Mining System.

Sandslash: A Two-Level Framework for Efficient Graph Pattern Mining

JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Near-optimal Top-k Pattern Mining

DIMMining

Mining Frequent Neighborhood Patterns in Large Labeled Graphs

XMiner: Efficient Directed Subgraph Matching with Pattern Reduction

Extracting Frequent Connected Subgraphs from Large Graph Sets.

LessMine: Reducing Sample Space and Data Access for Dense Pattern Mining

Efficient Mining Of Minimal Distinguishing Subgraph Patterns From Graph Databases

Efficient Mining of Frequent Subgraphs with Two-Vertex Exploration

Extract Frequent Pattern from Simple Graph Data.

GCG: Mining Maximal Complete Graph Patterns from Large Spatial Data

A cost-effective approach for mining near-optimal top- k patterns