GraphMini: Accelerating Graph Pattern Matching Using Auxiliary Graphs

Juelin Liu,Sandeep Polisetty,Hui Guan,Marco Serafini

DOI: https://doi.org/10.1109/PACT58117.2023.00026

2024-03-02

Abstract:Graph pattern matching is a fundamental problem encountered by many common graph mining tasks and the basic building block of several graph mining systems.

Databases,Performance

What problem does this paper attempt to address?

Efficient Algorithms for Summarizing Graph Patterns

Jianzhong Li,Yong Liu,Hong Gao

DOI: https://doi.org/10.1109/tkde.2010.249

IF: 9.235

2010-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:We investigate the problem of summarizing frequent subgraphs by a smaller set of representative patterns. We show that some special graph patterns, called δ-jump patterns in this paper, must be representative patterns. Based on the fact, we devise two algorithms, RP-FP and RP-GD, to mine a representative set that summarizes frequent subgraphs. RP-FP derives a representative set from frequent closed subgraphs, whereas RP-GD mines a representative set from graph databases directly. Three novel heuristic strategies, Last-Succeed-First-Check, Reverse-Path-Trace, and Nephew-Representative-Based-Cover, are proposed to further improve the efficiency of RP-GD. RP-FP can provide a tight ratio bound but has heavy computation cost. RP-GD cannot provide a ratio bound guarantee but is more efficient than RP-FP. We also make use of the similarity between sibling branches in the graph pattern space to devise another much more efficient algorithm, RP-Leap, for mining a representative set that can approximately summarize frequent subgraphs. Our extensive experiments on both real and synthetic data sets verify the summarization quality and efficiency of our algorithms. To further demonstrate the interestingness of representative patterns, we study an application of representative patterns to classification. We demonstrate that the classification accuracy achieved by representative pattern-based model is no less than that achieved by closed graph pattern-based model.
XMiner: Efficient Directed Subgraph Matching with Pattern Reduction

Pingpeng Yuan,Yujiang Wang,Tianyu Ma,Siyuan He,Ling Liu

2024-04-17

Abstract:Graph pattern matching, one of the fundamental graph mining problems, aims to extract structural patterns of interest from an input graph. The state-of-the-art graph matching algorithms and systems are mainly designed for undirected graphs. Directed graph matching is more complex than undirected graph matching because the edge direction must be taken into account before the exploration of each directed edge. Thus, the technologies (e.g. storage, exploiting symmetry for graph matching) for undirected graph matching may not be fully applicable to directed graphs. For example, the redundancy implied in directed graph pattern can not be detected using the symmetry breaking for undirected pattern graph. Here, we present XMiner for efficient directed graph pattern matching whose core idea is 'pattern reduction'. It first analyzes the relationship between constraints implied in a pattern digraph. Then it reduces the pattern graph into a simplified form by finding a minimum constraint cover. Finally, XMiner generates an execution plan and follows it to extract matchings of the pattern graph. So, XMiner works on simplified pattern graph and avoids much data access and redundant computation throughout the matching process. Our experimental results show that XMiner outperforms state-of the-art stand-alone graph matching systems, and scales to complex graph pattern matching tasks on larger graph.

Databases,Distributed, Parallel, and Cluster Computing
GraphMiner

Wei Wang,Chen Wang,Yongtai Zhu,Baile Shi,Jian Pei,Xifeng Yan,Jiawei Han

DOI: https://doi.org/10.1145/1066157.1066273

2005-01-01

Abstract:Mining frequent structural patterns from graph databases is an important research problem with broad applications. Recently, we developed an effective index structure, ADI, and efficient algorithms for mining frequent patterns from large, disk-based graph databases [5], as well as constraint-based mining techniques. The techniques have been integrated into a research prototype system--- GraphMiner. In this paper, we describe a demo of GraphMiner which showcases the technical details of the index structure and the mining algorithms including their efficient implementation, the mining performance and the comparison with some state-of-the-art methods, the constraint-based graph-pattern mining techniques and the procedure of constrained graph mining, as well as mining real data sets in novel applications.
Parallel Graph Pattern Matching in Massive Networks Based on MapReduce

ding yuanxiong,chen qun

2012-01-01

Abstract:In many popular applications, e.g., social network and bioinformatics, there is a growing need for supporting efficient graph pattern matching over massive graph data. Since the problem of graph pattern matching is NP-complete, it is challenging to operate over large graphs. Existing solutions to this problem are centralized, thus have limited use in practice. In this paper, we propose a parallel approach for graph pattern matching based on the popular computing framework Map Reduce. The proposed approach divides query and data graphs into paths, and then performs pattern matching in a path-at-a-time manner. Our experiments on real datasets verify its efficiency.
SumPA: Efficient Pattern-Centric Graph Mining with Pattern Abstraction

Chuangyi Gui,Xiaofei Liao,Long Zheng,Pengcheng Yao,Qinggang Wang,Hai Jin

DOI: https://doi.org/10.1109/pact52795.2021.00030

2021-01-01

Abstract:Graph mining aims to explore interesting structural information of a graph. Pattern-centric systems typically transform a generic-purpose graph mining problem into a series of subgraph matching problems for high performance. Existing pattern-centric mining systems reduce the substantial search space towards a single pattern by exploring a highly-optimized matching order, but inherent computational redundancies of such a matching order itself still suffer severely, leading to significant performance degradation. The key innovation of this work lies in a general redundancy criterion that characterizes computational redundancies arising in not only handing a single pattern but also matching multiple patterns simultaneously. In this paper, we present SumPA, a high-performance pattern-centric graph mining system that can sufficiently remove redundant computations for any complex graph mining problems. SumPA features three key designs: (1) a pattern abstraction technique that can simplify numerous complex patterns into a few simple abstract patterns based on pattern similarity, (2) abstraction-guided pattern matching that completely eliminates (totally and partially) redundant computations during subgraph enumeration, and (3) a suite of system optimizations to maximize storage and computation efficiency. Our evaluation on a wide variety of real-world graphs shows that SumPA outperforms the two state-of-the-art systems Peregrine and GraphPi by up to 61.89× and 8.94×, respectively. For many mining problems on large graphs, Peregrine takes hours or even days while SumPA finishes in only a few minutes.
Towards Fast and Scalable Graph Pattern Mining.

Anand Padmanabha Iyer,Zaoxing Liu,Xin Jin,Shivaram Venkataraman,Vladimir Braverman,Ion Stoica

2018-01-01

Abstract:While there has been a tremendous interest in processing graph-structured data, existing distributed graph processing systems take several minutes or even hours to mine simple patterns on graphs. In this paper, we try to answer the question of whether it is possible to build a graph pattern mining engine that is both fast and scalable . Leveraging the observation that in several pattern mining tasks, providing an approximate answer is good enough, we propose the use of approximation for graph pattern mining. However, we find that existing approximation techniques do not work for this purpose. Based on this, we present a new approach for approximate graph pattern mining that leverages recent advancements in graph approximation theory. Our preliminary evaluations show encouraging results: compared to state-of-the-art, finding 3-motifs in Twitter graph is 165× faster while incurring only 5% error. We conclude by discussing several systems challenges to make our proposal practical.
JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Yong Liu,Jianzhong Li,Hong Gao

DOI: https://doi.org/10.1109/FSKD.2009.670

2009-01-01

Abstract:A major challenge in frequent subgraph mining is the sheer size of its mining results. In many cases, a low minimum support may generate an explosive number of frequent subgraphs, which severely restricts the usage of frequent subgraph mining. In this paper, we study a new problem of mining frequent jump patterns from graph databases. Mining frequent jump patterns can dramatically reduce the number of output graph patterns, and still capture interesting graph patterns. By integrating the operation of checking jump patterns into the well-known DFS code tree enumeration framework, we present an efficient algorithm JPMiner for this new problem. We experimentally evaluate various aspects of JPMiner using both real and synthetic datasets. Experimental results demonstrate that the number of frequent jump patterns is much smaller than that of closed frequent graph patterns, and JPMiner is efficient and scalable in mining frequent jump patterns.
Graph pattern matching: from intractable to polynomial time

Wenfei Fan,Jianzhong Li,Shuai Ma,Nan Tang,Yinghui Wu,Yunpeng Wu

DOI: https://doi.org/10.14778/1920841.1920878

2010-01-01

Abstract:Graph pattern matching is typically defined in terms of subgraph isomorphism, which makes it an np-complete problem. Moreover, it requires bijective functions, which are often too restrictive to characterize patterns in emerging applications. We propose a class of graph patterns, in which an edge denotes the connectivity in a data graph within a predefined number of hops. In addition, we define matching based on a notion of bounded simulation, an extension of graph simulation. We show that with this revision, graph pattern matching can be performed in cubic-time, by providing such an algorithm. We also develop algorithms for incrementally finding matches when data graphs are updated, with performance guarantees for dag patterns. We experimentally verify that these algorithms scale well, and that the revised notion of graph pattern matching allows us to identify communities commonly found in real-world networks.
Towards Scalable Subgraph Pattern Matching over Big Graphs on MapReduce.

Bo Suo,Zhanhuai Li,Qun Chen,Wei Pan

DOI: https://doi.org/10.1109/icpads.2016.0147

2016-01-01

Abstract:Big graph-structured data pervade our world, ranging from microworld such as gene regulatory networks to macroworld such as social networks. Subgraph matching is a fundamental operation for many graph applications, such as graph database and graph mining. However, existing sequential algorithms have limited applicability on large graphs because of the inherent NP-completeness of subgraph isomorphism and distributed graph storage. Therefore, there is a need to parallelize subgraph matching over big graph data in a distributed environment. With MapReduce as the backdrop, this paper proposes a new approach, named ParMa, for efficient subgraph matching on distributed platforms. It consists of alternate computation and communication phases. We first build a cost model and then propose approaches to optimize the execution process. Instead of existing parallel approaches which only considers intermediate result size, the proposed cost model takes the number of iteration invocations as the primary cost. Based on this, our optimizations mainly focus on the aspects that affects iteration number throughout the execution of matching. One is query decomposition. We propose an effective query decomposition approach to minimize the number of subqueries and their matches. The other is join processing. We introduce a suite of mechanisms, including join plan making, local join processing and join cost estimation, to join partial matches in an appropriate way to reduce its cost. Finally, our extensive experiments on both synthetic and real graphs demonstrated that ParMa outperforms the state-of-the-art solutions by considerable margins.
GraphPi: High Performance Graph Pattern Matching through Effective Redundancy Elimination

Tianhui Shi,Mingshu Zhai,Yi Xu,Jidong Zhai

DOI: https://doi.org/10.48550/arXiv.2009.10955

2020-09-23

Abstract:Graph pattern matching, which aims to discover structural patterns in graphs, is considered one of the most fundamental graph mining problems in many real applications. Despite previous efforts, existing systems face two main challenges. First, inherent symmetry existing in patterns can introduce a large amount of redundant computation. Second, different matching orders for a pattern have significant performance differences and are quite hard to predict. When these factors are mixed, this problem becomes extremely complicated. High efficient pattern matching remains an open problem currently. To address these challenges, we propose GraphPi, a high performance distributed pattern matching system. GraphPi utilizes a new algorithm based on 2-cycles in group theory to generate multiple sets of asymmetric restrictions, where each set can eliminate redundant computation completely. We further design an accurate performance model to determine the optimal matching order and asymmetric restriction set for efficient pattern matching. We evaluate GraphPi on Tianhe-2A supercomputer. Results show that GraphPi outperforms the state-ofthe-art system, by up to 105X for 6 real-world graph datasets on a single node. We also scale GraphPi to 1,024 computing nodes (24,576 cores).

Distributed, Parallel, and Cluster Computing,Databases
Efficient Pattern Matching for Graphs with Multi-Labeled Nodes

Ali Shemshadi,Quan Z. Sheng,Yongrui Qin

DOI: https://doi.org/10.1016/j.knosys.2016.07.009

IF: 8.139

2016-01-01

Knowledge-Based Systems

Abstract:Graph matching is important for a wide variety of applications in different domains such as social network analysis and knowledge discovery. Despite extensive research over the last few decades, graph matching is still challenging particularly when it comes with new conditions and constraints. In this paper, we focus on a new class of graph matching, in which each node can accept multiple labels instead of one. In particular, we address the problem of finding the top-k nodes of a data graph which best match a labeled query node from a given pattern graph. We firstly prove this to be an NP-Complete problem. Then, to address this issue and improve the scalability of our approach, we introduce a more flexible graph simulation, namely surjective simulation. This new graph simulation reduces the unnecessary complexity that is due to the unnecessary constraints imposed by the existing definitions while achieving high-quality matching results. In addition, our approach is associated with an early stop strategy to further boost the performance. To approximate the maximum size of a simulation, our approach utilizes Metropolis Hastings algorithm and ranks the top-k matches after computing the set of surjective simulations. The experimental results over social network graphs demonstrate the efficiency of the proposed approach and superiority over existing approaches.
Parallel Subgraph Matching on Massive Graphs

Bo Suo,Zhanhuai Li,Wei Pan

DOI: https://doi.org/10.1109/cisp-bmei.2016.7853034

2016-01-01

Abstract:While numerous applications, such as social networks, protein-protein interaction networks, and bibliographic networks, mainly consist of graph-structured data, massive graphs, of which the scales range from million nodes to billion nodes, are common-place. Searching within these kinds of graphs is urged to be efficient. Unfortunately, since the subgraph isomorphism problem is NP-complete, querying on large graphs is still challenging.
GraphSet: High Performance Graph Mining Through Equivalent Set Transformations

Tianhui Shi,Jidong Zhai,Haojie Wang,Qiqian Chen,Mingshu Zhai,Zixu Hao,Haoyu Yang,Wenguang Chen

DOI: https://doi.org/10.1145/3581784.3613213

2023-01-01

Abstract:Graph mining is of critical use in a number of fields such as social networks, knowledge graphs, and fraud detection. As an NP-complete problem, accelerating computation performance is the main target for current optimizations. Due to excellent performance, state-of-the-art graph mining systems mainly rely on pattern-aware algorithms. Despite previous efforts, complex control flows introduced by pattern-aware algorithms bring significant overhead and also impede further acceleration on heterogeneous hardware. To address these challenges, we propose a set-based equivalent transformation approach to optimize pattern-aware graph mining applications, which can leverage classic set properties to eliminate most control flows and reduce computation overhead exponentially. We further implement a high-performance pattern-aware graph mining system supporting both CPU and GPU, namely GraphSet, to automatically apply these transformations. Evaluation results show that GraphSet outperforms state-of-the-art cross-platform and hardware-specific graph mining frameworks by up to 3384.1× and 243.2× (18.0× and 10.2× on average), respectively.
Pattern Morphing for Efficient Graph Mining

Kasra Jamshidi,Keval Vora

DOI: https://doi.org/10.48550/arXiv.2012.04553

2020-12-09

Abstract:Graph mining applications analyze the structural properties of large graphs, and they do so by finding subgraph isomorphisms, which makes them computationally intensive. Existing graph mining techniques including both custom graph mining applications and general-purpose graph mining systems, develop efficient execution plans to speed up the exploration of the given query patterns that represent subgraph structures of interest. In this paper, we step beyond the traditional philosophy of optimizing the execution plans for a given set of patterns, and exploit the sub-structural similarities across different query patterns. We propose Pattern Morphing, a technique that enables structure-aware algebra over patterns to accurately infer the results for a given set of patterns using the results of a completely different set of patterns that are less expensive to compute. Pattern morphing "morphs" (or converts) a given set of query patterns into alternative patterns, while retaining full equivalency. It is a general technique that supports various operations over matches of a pattern beyond just counting (e.g., support calculation, enumeration, etc.), making it widely applicable to various graph mining applications like Motif Counting and Frequent Subgraph Mining. Since pattern morphing mainly transforms query patterns before their exploration starts, it can be easily incorporated in existing general-purpose graph mining systems. We evaluate the effectiveness of pattern morphing by incorporating it in Peregrine, a recent state-of-the-art graph mining system, and show that pattern morphing significantly improves the performance of different graph mining applications.

Distributed, Parallel, and Cluster Computing,Databases
Scalable Pattern Matching in Computation Graphs

Luca Mondada,Pablo Andrés-Martínez

2024-02-20

Abstract:Graph rewriting is a popular tool for the optimisation and modification of graph expressions in domains such as compilers, machine learning and quantum computing. The underlying data structures are often port graphs - graphs with labels at edge endpoints. These port labels greatly simplify pattern matching.

Data Structures and Algorithms,Combinatorics,Quantum Physics
Enhanced Graph Pattern Matching

Nicola Cotumaccio

2024-02-26

Abstract:Pattern matching queries on strings can be solved in linear time by Knuth-Morris-Pratt (KMP) algorithm. In 1973, Weiner introduced the suffix tree of a string [FOCS 1973] and showed that the seemingly more difficult problem of computing matching statistics can also be solved in liner time. Pattern matching queries on graphs are inherently more difficult: under the Orthogonal Vector hypothesis, the graph pattern matching problem cannot be solved in subquadratic time [TALG 2023]. The complexity of graph pattern matching can be parameterized by the topological complexity of the considered graph, which is captured by a parameter $ p $ [JACM 2023]. In this paper, we show that, as in the string setting, computing matching statistics on graph is as difficult as solving standard pattern matching queries. To this end, we introduce a notion of longest common prefix (LCP) array for arbitrary graphs.

Data Structures and Algorithms
Continuous Matching of Evolving Patterns over Dynamic Graph Data

Zhang Qianzhen,Guo Deke,Zhao Xiang,Wang Xi

DOI: https://doi.org/10.1007/s11280-020-00860-5

2021-01-01

World Wide Web

Abstract:Nowadays, the scale of various graphs soars rapidly, which imposes a serious challenge to develop processing and analytic algorithms. Among them, graph pattern matching is the one of the most primitive tasks that find a wide spectrum of applications, the performance of which is yet often affected by the size and dynamicity of graphs. In order to handle large dynamic graphs, incremental pattern matching is proposed to avoid re-computing matches of patterns over the entire data graph, hence reducing the matching time and improving the overall execution performance. Due to the complexity of the problem, little work has been reported so far to solve the problem, and most of them only solve the graph pattern matching problem under the scenario of the data graph varying alone. In this article, we are devoted to a more complicated but very practical graph pattern matching problem, continuous matching of evolving patterns over dynamic graph data , and the investigation presents a novel algorithm CEPDG for continuously pattern matching along with changes of both pattern graph and data graph. Specifically, we propose a concise representation TreeMat of partial matching solutions, which can help to avoid re-computing matches of the pattern and speed up subsequent matching process. In order to enable the updates of data graph and pattern graph, we propose an incremental maintenance strategy, to efficiently maintain the intermediate results. Moreover, we conceive an effective model for estimating step-wise cost of pattern evaluation to drive the matching process. Extensive experiments verify the superiority of CEPDG.
High efficiency and quality: large graphs matching

Yuanyuan Zhu,Lu Qin,Jeffrey Xu Yu,Yiping Ke,Xuemin Lin

DOI: https://doi.org/10.1007/s00778-012-0292-8

2012-01-01

Abstract:Graph matching plays an essential role in many real applications. In this paper, we study how to match two large graphs by maximizing the number of matched edges, which is known as maximum common subgraph matching and is NP-hard. To find exact matching, it cannot a graph with more than 30 nodes. To find an approximate matching, the quality can be very poor. We propose a novel two-step approach that can efficiently match two large graphs over thousands of nodes with high matching quality. In the first step, we propose an anchor-selection/expansion approach to compute a good initial matching. In the second step, we propose a new approach to refine the initial matching. We give the optimality of our refinement and discuss how to randomly refine the matching with different combinations. We further show how to extend our solution to handle labeled graphs. We conducted extensive testing using real and synthetic datasets and report our findings in this paper.
Efficient Mining Of Minimal Distinguishing Subgraph Patterns From Graph Databases

Zhiping Zeng,Jianyong Wang,Lizhu Zhou

DOI: https://doi.org/10.1007/978-3-540-68125-0_114

2008-01-01

Abstract:Distinguishing patterns represent strong distinguishing knowledge and are very useful for constructing powerful, accurate and robust classifiers. The distinguishing graph patterns(DGPs) are able to capture structure differences between any two categories of graph datasets. Whereas, few previous studies worked on the discovery of DGPs. In this paper, as the first, we study the problem of mining the complete set of minimal DGPs with any number of positive graphs, arbitrary positive support and negative support. We proposed a novel algorithm, MDGP-Mine, to discover the complete set of minimal DGPs. The empirical results show that MDGP-Mine is efficient and scalable.
Efficient Pattern Matching on Big Uncertain Graphs.

Ye Yuan,Guoren Wang,Lei Chen,Bo Ning

DOI: https://doi.org/10.1016/j.ins.2015.12.034

IF: 8.1

2016-01-01

Information Sciences

Abstract:A significant amount of research has been devoted to seeking efficient solutions to the problem of pattern matching over graphs. This interest is largely due to the many applications that require such efficient solutions, including protein complex prediction, social network analysis, and structural pattern recognition. However, in many real applications, the graph data are often noisy, incomplete, and inaccurate. In other words, there exist many uncertain graphs. Therefore, in this paper, we study pattern matching in the context of large uncertain graphs. Specifically, we want to retrieve all qualified matches of a query pattern in the uncertain graph. Though pattern matching over uncertain graphs is NP-hard, we employ a filtering-and-verification framework to speed up the search. In the filtering phase, we propose a probabilistic matching tree (PM-tree) built from match cuts obtained by a cut selection process. Based on the PM-tree, we devise a collective pruning strategy to prune a large number of unqualified matches. During the verification phase, we develop an efficient sampling algorithm to validate the remaining candidates. Extensive experimental results demonstrate the effectiveness and efficiency of the proposed algorithms. Finally, we show how our solution can be applied to querying knowledge graphs.

GraphMini: Accelerating Graph Pattern Matching Using Auxiliary Graphs

Efficient Algorithms for Summarizing Graph Patterns

XMiner: Efficient Directed Subgraph Matching with Pattern Reduction

GraphMiner

Parallel Graph Pattern Matching in Massive Networks Based on MapReduce

SumPA: Efficient Pattern-Centric Graph Mining with Pattern Abstraction

Towards Fast and Scalable Graph Pattern Mining.

JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Graph pattern matching: from intractable to polynomial time

Towards Scalable Subgraph Pattern Matching over Big Graphs on MapReduce.

GraphPi: High Performance Graph Pattern Matching through Effective Redundancy Elimination

Efficient Pattern Matching for Graphs with Multi-Labeled Nodes

Parallel Subgraph Matching on Massive Graphs

GraphSet: High Performance Graph Mining Through Equivalent Set Transformations

Pattern Morphing for Efficient Graph Mining

Scalable Pattern Matching in Computation Graphs

Enhanced Graph Pattern Matching

Continuous Matching of Evolving Patterns over Dynamic Graph Data

High efficiency and quality: large graphs matching

Efficient Mining Of Minimal Distinguishing Subgraph Patterns From Graph Databases

Efficient Pattern Matching on Big Uncertain Graphs.