Pattern Matching in Trees and Strings

Philip Bille

DOI: https://doi.org/10.48550/arXiv.0708.4288

2007-08-31

Data Structures and Algorithms

Abstract:We study the design of efficient algorithms for combinatorial pattern matching. More concretely, we study algorithms for tree matching, string matching, and string matching in compressed texts.

What problem does this paper attempt to address?

Enhanced Graph Pattern Matching

Nicola Cotumaccio

2024-02-26

Abstract:Pattern matching queries on strings can be solved in linear time by Knuth-Morris-Pratt (KMP) algorithm. In 1973, Weiner introduced the suffix tree of a string [FOCS 1973] and showed that the seemingly more difficult problem of computing matching statistics can also be solved in liner time. Pattern matching queries on graphs are inherently more difficult: under the Orthogonal Vector hypothesis, the graph pattern matching problem cannot be solved in subquadratic time [TALG 2023]. The complexity of graph pattern matching can be parameterized by the topological complexity of the considered graph, which is captured by a parameter $ p $ [JACM 2023]. In this paper, we show that, as in the string setting, computing matching statistics on graph is as difficult as solving standard pattern matching queries. To this end, we introduce a notion of longest common prefix (LCP) array for arbitrary graphs.

Data Structures and Algorithms
Pattern Matching with Wildcards Based on Suffix Tree

HOU Bao-jian,XIE Fei,HU Xue-gang,LIU Ying-ling,WANG Hai-ping

DOI: https://doi.org/10.3969/j.issn.1002-137x.2012.12.040

2012-01-01

Computer Science

Abstract:Pattern matching with wildcards is a hot research problem that can be used in biological sequence analysis,text indexing,network intrusion detection,and so on.Aiming at the problem that the wildcards have strong limitations in the existing research work,pattern matching with flexible wildcards was studied.The wildcards can appear between any two substrings and can be specified with flexible length constraints.The nonlinear data structure—suffix tree was used to design a completeness algorithm PAST.In the prepare process,an online incremental algorithm was used to build the suffix tree which has priori knowledge of the text.In the search phase,the idea of dynamic programming was used to match the characters of the pattern.Experiments on DNA sequences show that our method has better perfor-mances in time than the related matching algorithm.
Tree-matching Object Concept Assignment to Support Program Comprehension

H Chen,JF Qian,Q Chen,RZ Yu

DOI: https://doi.org/10.1109/icccyb.2004.1437719

2004-01-01

Abstract:This paper outlines a method for assisting program comprehension by addressing the concept assignment problem. The method, termed tree-matching object concept assignment, uses information gathered from program execution to assign plausible object concept to source code. The candidate concepts are selected from knowledge base. An evaluation of prototype system has shown that the method can accurately recognize object concepts in a range of real-world programs
Pattern Matching with Wildcards Based on Multiple Suffix Trees

Yingling Liu,Xindong Wu,Xuegang Hu,Jun Gao,Chi Wang

DOI: https://doi.org/10.1109/grc.2012.6468626

2012-01-01

Abstract:Pattern matching with wildcards is very important in many fields such as information retrieval and bioinformatics. Suffix trees are used in pattern matching with variable length wildcards. But the construction of a suffix tree needs significant time and space overload. This paper presents a new pattern matching algorithm, PST, based on multiple suffix trees. The PST algorithm uses a cutting process to divide a string S into several parts firstly, and then establishes a suffix tree for each part of S respectively. If multiple patterns are to be retrieved, the suffix trees should be adjusted according to the cutting points: prefix sequence deletion and suffix sequence addition; prefix sequence addition and suffix sequence deletion. Theoretical analysis and experiments show that the PST algorithm can decrease the time and space overload than other peers.
Arithmetic for Matching Multiple Patterns Based on Improved Doubly-Chained Tree

Xin Lu

2005-01-01

Abstract:In the arithmetic for matching multiple patterns based on digital search tree,the physical storage mode of digital search tree is doubly-chained tree. Using the idea of KMP arithmetic, digital search tree has been turned into improved doubly-chained tree through added assistant jump-node. The improved storage mode and arithmetic have quickened the speed of matching, and have implemented non-backtracking in process of matching.
Exact pattern matching. Current achievements and research

Anton Zuiev,

DOI: https://doi.org/10.17721/1812-5409.2023/1.11

2023-01-01

Abstract:The problem of exact pattern matching is an essential programming problem. Different algorithms that solve this problem are core elements of search engines, version control systems, text editors, DNA analyzers, and many others. For simplification reasons articles usually denote pattern as P or p and pattern length as M or m. Similarly, the text is usually denoted as T or t and its length - N or n. Alphabet is denoted Σ and its length - |Σ|. Based on these notations the problem of pattern matching can be written as follows: Find all positions/ amount of i, such that P[0...m] = T[i...i + m], or: Find all positions i in text for which substring starting at position i of the text of length m is equal to the pattern. The main parameters of this problem are pattern length and alphabet size. The length of the text usually doesn’t matter because, for any long enough text of a specific structure, the run time of the algorithm per character will be close to constant. Besides that, the specifics of the input data and text may also impact the performances of the algorithms. All of that makes the problem both very nuanced and interesting to investigate. This problem features a lot of different existing solutions developed over the course of the last 5 decades. The main part of the work provides short descriptions and analyses of a set of algorithms that are still relevant in the field. Besides that, some remarks are made on the topic of their theoretical regions of efficiency and how they depend on the specifics of the input. The results of the practical experimentation on the variety of randomly generated test data are provided. The conclusion provides some analysis of the received results and algorithms’ class efficiency based on the input as well as a visual representation of the received results in a form of a table representing the most efficient algorithm for each pair of pattern length and alphabet size.
Strict Pattern Matching under Non-Overlapping Condition

Youxi Wu,Cong Shen,He Jiang,Xindong Wu

DOI: https://doi.org/10.1007/s11432-015-0935-3

2016-01-01

Science China Information Sciences

Abstract:Pattern matching(or string matching) is an essential task in computer science, especially in sequential pattern mining, since pattern matching methods can be used to calculate the support(or the number of occurrences) of a pattern and then to determine whether the pattern is frequent or not. A state-of-the-art sequential pattern mining with gap constraints(or flexible wildcards) uses the number of non-overlapping occurrences to denote the frequency of a pattern. Non-overlapping means that any two occurrences cannot use the same character of the sequence at the same position of the pattern. In this paper, we investigate strict pattern matching under the non-overlapping condition. We show that the problem is in P at first. Then we propose an algorithm, called NETLAP-Best, which uses Nettree structure. NETLAP-Best transforms the pattern matching problem into a Nettree and iterates to find the rightmost root-leaf path, to prune the useless nodes in the Nettree after removing the rightmost root-leaf path. We show that NETLAP-Best is a complete algorithm and analyse the time and space complexities of the algorithm. Extensive experimental results demonstrate the correctness and efficiency of NETLAP-Best.
Approximate Cartesian Tree Matching: an Approach Using Swaps

Bastien Auvray,Julien David,Richard Groult,Thierry Lecroq

2024-10-18

Abstract:Cartesian tree pattern matching consists of finding all the factors of a text that have the same Cartesian tree than a given pattern. There already exist theoretical and practical solutions for the exact case. In this paper, we propose the first algorithm for solving approximate Cartesian tree pattern matching. We consider Cartesian tree pattern matching with one swap: given a pattern of length m and a text of length n we present two algorithms that find all the factors of the text that have the same Cartesian tree of the pattern after one transposition of two adjacent symbols. The first algorithm uses a characterization of a linear representation of the Cartesian trees called parent-distance after one swap and runs in time Theta(mn) using Theta(m) space. The second algorithm generates all the parent-distance tables of sequences that have the same Cartesian tree than the pattern after one swap. It runs in time O((m^2 + n)log m) and has O(m^2) space complexity.

Data Structures and Algorithms
Extending the Burrows-Wheeler Transform for Cartesian Tree Matching and Constructing It

Eric M. Osterkamp,Dominik Köppl

2024-11-19

Abstract:Cartesian tree matching is a form of generalized pattern matching where a substring of the text matches with the pattern if they share the same Cartesian tree. This form of matching finds application for time series of stock prices and can be of interest for melody matching between musical scores. For the indexing problem, the state-of-the-art data structure is a Burrows-Wheeler transform based solution due to [Kim and Cho, CPM'21], which uses nearly succinct space and can count the number of substrings that Cartesian tree match with a pattern in time linear in the pattern length. The authors address the construction of their data structure with a straight-forward solution that, however, requires pointer-based data structures, which asymptotically need more space than compact solutions [Kim and Cho, CPM'21, Section A.4]. We address this bottleneck by a construction that requires compact space and has a time complexity linear in the product of the text length with some logarithmic terms. Additionally, we can extend this index for indexing multiple circular texts in the spirit of the extended Burrows-Wheeler transform without sacrificing the time and space complexities. We present this index in a dynamic variant, where we pay a logarithmic slowdown and need compact space for the extra functionality that we can incrementally add texts. Our extended setting is of interest for finding repetitive motifs common in the aforementioned applications, independent of offsets and scaling.

Data Structures and Algorithms
A New Algorithm for Pattern Matching in String

庞善臣,王淑栋

DOI: https://doi.org/10.3969/j.issn.1000-1220.2004.03.019

2004-01-01

Abstract:In this paper, we present a new algorithm of pattern-matching in string(Text Divided Algorithm) .The idea of the algorithm is as follows: Firstly, we find the longest prefix substring of pattern P, named as subp, such that its end-letter appears only once in the subp. Secondly, we divide the text T into several sections according to the characters of the end-letter of subp, then match P with every section of T. The important characters of the new algorithm are stated as follows: 1. The complexity of the algorithm is reduced efficiently; 2. The matching algorithm is more easily extended to two dimensions and approximate matching; 3. The matching process is similar to the direct algorithm, and convenient to accept and understand.
Internal Pattern Matching in Small Space and Applications

Gabriel Bathie,Panagiotis Charalampopoulos,Tatiana Starikovskaya

DOI: https://doi.org/10.4230/LIPIcs.CPM.2024.26

2024-04-27

Abstract:In this work, we consider pattern matching variants in small space, that is, in the read-only setting, where we want to bound the space usage on top of storing the strings. Our main contribution is a space-time trade-off for the Internal Pattern Matching (IPM) problem, where the goal is to construct a data structure over a string $S$ of length $n$ that allows one to answer the following type of queries: Compute the occurrences of a fragment $P$ of $S$ inside another fragment $T$ of $S$, provided that $|T| < 2|P|$. For any $\tau \in [1 .. n/\log^2 n]$, we present a nearly-optimal $Õ(n/\tau)$-size data structure that can be built in $Õ(n)$ time using $Õ(n/\tau)$ extra space, and answers IPM queries in $O(\tau+\log n \log^3 \log n)$ time. IPM queries have been identified as a crucial primitive operation for the analysis of algorithms on strings. In particular, the complexities of several recent algorithms for approximate pattern matching are expressed with regards to the number of calls to a small set of primitive operations that include IPM queries; our data structure allows us to port these results to the small-space setting. We further showcase the applicability of our IPM data structure by using it to obtain space-time trade-offs for the longest common substring and circular pattern matching problems in the asymmetric streaming setting.

Data Structures and Algorithms
Multiple Pattern Matching Algorithm Based on Sequential Binary Tree1

刘功申,李宁

DOI: https://doi.org/10.3969/j.issn.1000-1220.2004.07.069

2004-01-01

Abstract:By analyzing the traditional multiple pattern matching algorithm based on tree structure, a new algorithm is proposed by substituting sequential binary tree for tree. The algorithm is suitable for the application which requires preprocessing the patterns dynamically. It is proved by experiment that the algorithm has three features: Its construction process is quick. Its cost of memory is small. At the same time, its searching process is as quick as the traditional algorithm.
Counting Permutation Patterns with Multidimensional Trees

Gal Beniamini,Nir Lavee

2024-07-06

Abstract:We consider the well-studied pattern counting problem: given a permutation $\pi \in \mathbb{S}_n$ and an integer $k > 1$, count the number of order-isomorphic occurrences of every pattern $\tau \in \mathbb{S}_k$ in $\pi$. Our first result is an $\widetilde{\mathcal{O}}(n^2)$-time algorithm for $k=6$ and $k=7$. The proof relies heavily on a new family of graphs that we introduce, called pattern-trees. Every such tree corresponds to an integer linear combination of permutations in $\mathbb{S}_k$, and is associated with linear extensions of partially ordered sets. We design an evaluation algorithm for these combinations, and apply it to a family of linearly-independent trees. For $k=8$, we show a barrier: the subspace spanned by trees in the previous family has dimension exactly $|\mathbb{S}_8| - 1$, one less than required. Our second result is an $\widetilde{\mathcal{O}}(n^{7/4})$-time algorithm for $k=5$. This algorithm extends the framework of pattern-trees by speeding-up their evaluation in certain cases. A key component of the proof is the introduction of pair-rectangle-trees, a data structure for dominance counting.

Data Structures and Algorithms,Combinatorics
Internal Pattern Matching Queries in a Text and Applications

Tomasz Kociumaka,Jakub Radoszewski,Wojciech Rytter,Tomasz Waleń

DOI: https://doi.org/10.1137/23m1567618

2024-10-16

SIAM Journal on Computing

Abstract:SIAM Journal on Computing, Volume 53, Issue 5, Page 1524-1577, October 2024. We consider several types of internal queries, that is, questions about fragments of a given text [math] specified in constant space by their locations in [math]. Our main result is an optimal data structure for internal pattern matching (IPM) queries, which, given two fragments [math] and [math], ask for a representation of all fragments contained in [math] and matching [math] exactly. This problem can be viewed as an internal version of the fundamental exact pattern matching problem: We are looking for exact occurrences of one substring of [math] within another substring of [math]. Our data structure answers IPM queries in time proportional to the quotient [math] of the fragments' lengths, which is required due to the worst-case information content of the output. If [math] is a text of length [math] over an integer alphabet of size [math], then our data structure occupies [math] machine words (that is, [math] bits) and admits an [math]-time construction algorithm. We also show how to use IPM queries for answering internal queries corresponding to other classic string processing problems. Among others, we derive optimal data structures reporting the periods of a fragment and testing the cyclic equivalence of two fragments. Since the publication of the conference version of this paper [Kociumaka et al., Internal pattern matching queries in a text and applications, SODA 2015], IPM queries have found numerous further applications, following the path paved by the classic longest common extension (LCE) queries of Landau and Vishkin [J. Comput. System Sci., 37 (1988), pp. 63–78]. In particular, IPM queries have been implemented in grammar-compressed and dynamic settings and, along with LCE queries, constitute elementary operations of the [math] model, developed by Charalampopoulos, Kociumaka, and Wellnitz [Faster approximate pattern matching: A unified approach, FOCS 2020] to design approximate pattern matching algorithms that work in multiple settings. All our algorithms are deterministic, whereas the data structure in the conference version of the paper only admits a randomized construction in [math] expected time. To achieve this, we provide a novel construction of string synchronizing sets of Kempa and Kociumaka [String synchronizing sets: Sublinear-time BWT construction and optimal LCE data structure, STOC 2019]. Our method, based on a new restricted version of the recompression technique of Jeż [J. ACM, 63 (2016), pp. 4:1–4:51], yields a hierarchy of [math] string synchronizing sets covering the whole spectrum of the fragments' lengths.

computer science, theory & methods,mathematics, applied
An Efficient Adaptive Architecture for Multi-pattern Matching

Peng Zhan,Yuping Wang,Lijuan Hu,Zhenyan Jing

2018-01-01

Abstract:Multi-pattern matching is a core technique of many applications. However, many of the existing algorithms cannot efficiently deal with large pattern sets or pattern sets with very short patterns. To address these issues, in this paper, an adaptive architecture for multi-pattern matching (AAMPM), which is based on a new data structure called adaptive matching tree (AMT), is proposed. In particular, each tree node in AMT saves only some pattern fragments of the whole pattern set, and the inner data structure of each tree node is adaptively chosen according to the features of those pattern fragments. Due to this adaptivity, each tree node can take as little memory as possible, additionally, matching the text fragments with the pattern fragments in the tree nodes can be very efficient. Based on AMT, AAMPM adopts an effective approach to search patterns in the text string. The experimental results show that, AAMPM has a strong robustness on pattern sets with short patterns. Moreover, due to the good scalability of AMT, AAMPM offers an excellent support for large pattern sets.
Combinatorial generation via permutation languages. VI. Binary trees

Petr Gregor,Torsten Mütze,Namrata

2024-06-14

Abstract:In this paper we propose a notion of pattern avoidance in binary trees that generalizes the avoidance of contiguous tree patterns studied by Rowland and non-contiguous tree patterns studied by Dairyko, Pudwell, Tyner, and Wynn. Specifically, we propose algorithms for generating different classes of binary trees that are characterized by avoiding one or more of these generalized patterns. This is achieved by applying the recent Hartung-Hoang-Mütze-Williams generation framework, by encoding binary trees via permutations. In particular, we establish a one-to-one correspondence between tree patterns and certain mesh permutation patterns. We also conduct a systematic investigation of all tree patterns on at most 5 vertices, and we establish bijections between pattern-avoiding binary trees and other combinatorial objects, in particular pattern-avoiding lattice paths and set partitions.

Discrete Mathematics,Combinatorics
Scalable Pattern Matching in Computation Graphs

Luca Mondada,Pablo Andrés-Martínez

2024-02-20

Abstract:Graph rewriting is a popular tool for the optimisation and modification of graph expressions in domains such as compilers, machine learning and quantum computing. The underlying data structures are often port graphs - graphs with labels at edge endpoints. These port labels greatly simplify pattern matching.

Data Structures and Algorithms,Combinatorics,Quantum Physics
PhyloPattern: regular expressions to identify complex patterns in phylogenetic trees

Philippe Gouret,Julie D Thompson,Pierre Pontarotti

DOI: https://doi.org/10.1186/1471-2105-10-298

IF: 3.307

2009-09-19

BMC Bioinformatics

Abstract:Background: To effectively apply evolutionary concepts in genome-scale studies, large numbers of phylogenetic trees have to be automatically analysed, at a level approaching human expertise. Complex architectures must be recognized within the trees, so that associated information can be extracted. Results: Here, we present a new software library, PhyloPattern, for automating tree manipulations and analysis. PhyloPattern includes three main modules, which address essential tasks in high-throughput phylogenetic tree analysis: node annotation, pattern matching, and tree comparison. PhyloPattern thus allows the programmer to focus on: i) the use of predefined or user defined annotation functions to perform immediate or deferred evaluation of node properties, ii) the search for user-defined patterns in large phylogenetic trees, iii) the pairwise comparison of trees by dynamically generating patterns from one tree and applying them to the other. Conclusion: PhyloPattern greatly simplifies and accelerates the work of the computer scientist in the evolutionary biology field. The library has been used to automatically identify phylogenetic evidence for domain shuffling or gene loss events in the evolutionary histories of protein sequences. However any workflow that relies on phylogenetic tree analysis, could be automated with PhyloPattern.
Non-Contiguous Pattern Avoidance in Binary Trees

Michael Dairyko,Lara Pudwell,Samantha Tyner,Casey Wynn

DOI: https://doi.org/10.48550/arXiv.1203.0795

2012-06-21

Abstract:In this paper we consider the enumeration of binary trees avoiding non-contiguous binary tree patterns. We begin by computing closed formulas for the number of trees avoiding a single binary tree pattern with 4 or fewer leaves and compare these results to analogous work for contiguous tree patterns. Next, we give an explicit generating function that counts binary trees avoiding a single non-contiguous tree pattern according to number of leaves. In addition, we enumerate binary trees that simultaneously avoid more than one tree pattern. Finally, we explore connections between pattern-avoiding trees and pattern-avoiding permutations.

Combinatorics
A probabilistic analysis of a pattern matching problem

Mikhail J. Atallah,Philippe Jacquet,Wojciech Szpankowski

DOI: https://doi.org/10.1002/rsa.3240040206

1993-01-01

Random Structures and Algorithms

Abstract:The study and comparison of strings of symbols from a finite or an infinite alphabet is relevant to various areas of science, notably molecular biology, speech recognition, and computer science. In particular, the problem of finding the minimum “distance” between two strings (in general, two blocks of data) is of a practical importance. In this article we investigate the (string) pattern matching problem in a probabilistic framework, namely, it is assumed that both strings form an independent sequences of i.i.d. symbols. Given a text string a of length n and a pattern string b of length m, let Mm,n be the maximum number of matches between b and all m‐substrings of a. Our main probabilistic result shows that for a wide range of input parameters in probability (pr.) provided m, n →∞ such that log n = o(m), where P is the probability of a match between any two symbols of these strings, and T is the probability of a match between two positions in the text string and a given position of the pattern string. We also prove that Mm,n/m→P almost surely (a.s.) for log n = o(m). © 1993 John Wiley & Sons. Inc.

mathematics, applied,computer science, software engineering

Pattern Matching in Trees and Strings

Enhanced Graph Pattern Matching

Pattern Matching with Wildcards Based on Suffix Tree

Tree-matching Object Concept Assignment to Support Program Comprehension

Pattern Matching with Wildcards Based on Multiple Suffix Trees

Arithmetic for Matching Multiple Patterns Based on Improved Doubly-Chained Tree

Exact pattern matching. Current achievements and research

Strict Pattern Matching under Non-Overlapping Condition

Approximate Cartesian Tree Matching: an Approach Using Swaps

Extending the Burrows-Wheeler Transform for Cartesian Tree Matching and Constructing It

A New Algorithm for Pattern Matching in String

Internal Pattern Matching in Small Space and Applications

Multiple Pattern Matching Algorithm Based on Sequential Binary Tree1

Counting Permutation Patterns with Multidimensional Trees

Internal Pattern Matching Queries in a Text and Applications

An Efficient Adaptive Architecture for Multi-pattern Matching

Combinatorial generation via permutation languages. VI. Binary trees

Scalable Pattern Matching in Computation Graphs

PhyloPattern: regular expressions to identify complex patterns in phylogenetic trees

Non-Contiguous Pattern Avoidance in Binary Trees

A probabilistic analysis of a pattern matching problem