<Emphasis Type="Italic">pq</Emphasis>-Hash: An Efficient Method for Approximate XML Joins

Fei Li,Hongzhi Wang,Liang Hao,Jianzhong Li,Hong Gao

DOI: https://doi.org/10.1007/978-3-642-16720-1_13

2010-01-01

Abstract:Approximate matching between large tree sets is broadly used in many applications such as data integration and XML de-duplication. However, most existing methods suffer for low efficiency, thus do not scale to large tree sets.

What problem does this paper attempt to address?

Hash(Ed)-Join: Approximate String Similarity Join With Hashing

Peisen Yuan,Chaofeng Sha,Yi Sun

DOI: https://doi.org/10.1007/978-3-662-43984-5_16

2014-01-01

Abstract:The string similarity join, which finds similar string pairs from string sets, has received extensive attention in database and information retrieval fields. To this problem, the filter-and-refine framework is usually adopted by the existing research work, and various filtering methods have been proposed. Recently, tree based index techniques with the edit distance constraint are effectively employed for evaluating the string similarity join. However, they do not scale well with large distance threshold. In this paper, we propose an approach for approximate string similarity join based on Min-Hashing locality sensitive hashing and trie-based index techniques. Our approach is flexible between trading the efficiency and performance. Empirical study using the real datasets demonstrates that our framework is more efficient and scales better.
Extend Tree Edit Distance for Effective Object Identification

Yue Wang,Hongzhi Wang,Liyan Zhang,Yang Wang,Jianzhong Li,Hong Gao

DOI: https://doi.org/10.1007/s10115-014-0816-1

IF: 2.7

2015-01-01

Knowledge and Information Systems

Abstract:Similarity join on XML documents which are usually modeled as rooted ordered labeled trees is widely applied, due to the ambiguity of references to the real-world objects. The conventional method dealing with this issue is based on tree edit distance, which is shortage of flexibility and efficiency. In this paper, we propose two novel edit operations together with extended tree edit distance, which can achieve good performance in similarity matching with hierarchical data structures [the run-time is \(O(n^{3})\) in the worst case]. And then, we propose \(k\)-generation set distance as a good approximation of the tree edit distance to further improve the join efficiency with quadric time complexity. Experiments on real and synthetic databases demonstrate the benefit of our method in efficiency and scalability.
An Index Scheme for XML Documents Based on Relationship Joins

Chengwen Wu,Jinxiang Dong,Gang Chen,Lihua Yu

DOI: https://doi.org/10.1109/CSCWD.2006.253228

2006-01-01

Abstract:XML is rapidly emerging as a standard for information storage, representation and exchange on the Web. How to rapidly search and query XML documents efficiently has received many attentions in resent research. However, current querying schemes of XML documents typically involve in both node content and tree structural information, which may limit efficiency when facing the application that the tree structural information is more complicated than the tree node itself. In this paper, we propose the node relationships joins algorithms that utilize available indexes mainly on tree structural information. The relationships join algorithms work perfectly especially for searching paths that are very long or whose lengths are unknown. Experimental results from our prototype system implementation highlight the correctness and efficiency of our solution
A Structural Index Based XML Pattern Matching Approach

QIAO Jian,CHEN Tong-Bing,WANG Wei,SHI Bai-Le

2005-01-01

Computer Science

Abstract:XML document employs a tree-structured data model and its queries typically specify patterns of selection predicates to match XML data. So finding all occurrences of such a pattern in a XML document is the core operation of XMLquery processing. In this paper, a kind of structural index called JoinGuide is introduced and then a novel XML pattern matching approach based on it is presented. The approach utilizes joinGuide to pre-match a pattern tree, then when querying XML documents, the pre-match result is used to avoid some join predicates and input XML elements list. Also three algorithms are presented to query XML documents using pre-match result. Experiments show that the approach outperforms the previous ones, and the index size is small.
Grams(3): An Efficient Framework For Xml Structural Similarity Search

Peisen Yuan,Xiaoling Wang,Chaofeng Sha,Ming Gao,Aoying Zhou

DOI: https://doi.org/10.1007/978-3-642-14589-6_43

2010-01-01

Abstract:Structural similarity search is a fundamental technology for XML data management. However, existing methods do not scale well with large volume of XML document. The pq-gram is an efficient way of extracting substructure from the tree-structured data for approximate structural similarity search. In this paper, we propose an effective framework GRAMS(3) for evaluating structural similarity of XML data. First pq-grams of XML document are extracted; then we study the characteristics of pq-gram of XML and generate doc-gram vector using TGF-IGF model for XML tree; finally we employ locality sensitive hashing for efficiently structural similarity search of XML documents. An empirical study using both synthetic and real datasets demonstrates the framework is efficient.
Exploiting Even Partition to Accelerate Structure Join

Guoliang Li,Jianhua Feng,Yong Zhang,Na Ta,Lizhu Zhou

DOI: https://doi.org/10.1109/WAIMW.2006.13

2006-01-01

Abstract:Among most of the approaches about XML query processing, structure join is more popular and efficient. The evaluation of structural relationship in the join, specifically the parent-child or ancestordescendant relationship, between XML element sets has imposed a great challenge on efficient XML query processing. In this paper, we present, PRIAM, an efficient algorithm for structure join by evenly partitioning the input element sets, which skips many more ancestor or descendant elements than previous algorithms. PRIAM accelerates structure join dramatically, but requires neither the order of input element sets nor any indices. Moreover, when the distribution of elements of a particular tag/label is skew, general partition-based techniques are not costefficient, however, PRIAM partitions the two input sets into different buckets evenly and only the structure join of suit buckets is helpful to the result, therefore it avoids scanning the two input sets many times and is efficient. In addition, PRIAM is portable to various coding schemes. Our extensive experiments show that PRIAM significantly outperforms previous ones.
Xml Structural Similarity Search Using Mapreduce

Peisen Yuan,Chaofeng Sha,Xiaoling Wang,Bin Yang,Aoying Zhou,Su Yang

DOI: https://doi.org/10.1007/978-3-642-14246-8_19

2010-01-01

Abstract:XML is a de-facto standard for web data exchange and information representation. Efficient management of these large volumes of XML data brings challenges to conventional technique. To cope with large scale data, MapReduce computing framework as an efficient solution has attracted more and more attention in the database community recently. In this paper, an efficient and scalable framework is proposed for XML structural similarity search on large cluster with MapReduce. First, sub-structures of XML structure are extracted from large XML corpus located on a large cluster in parallel. Then Min-Hashing and locality sensitive hashing techniques are developed on the distributed and parallel computing framework for efficient structural similarity search processing. An empirical study on the cluster with real large datasets demonstrates the effectiveness and efficiency of our approach.
An Efficient Schema Matching Approach Using Previous Mapping Result Set

Hongjie Fan,Junfei Liu,Wenfeng Luo,Kejun Deng

DOI: https://doi.org/10.1007/978-3-319-32055-7_23

2016-01-01

Abstract:The widespread adoption of eXtensible Markup Language pushed a growing number of researchers to design XML specific Schema Matching approaches, aiming at finding the semantic correspondence of concepts between different data sources. In the latest years, there has been a growing need for developing high performance matching systems in order to identify and discover such semantic correspondence across XML data. XML schema matching methods face several challenges in the form of definition, utilization, and combination of element similarity measures. In this paper, we propose the XML schema matching framework based on previous mapping result set (PMRS). We first parse XML schemas as schema trees and extract schema feature. Then we construct PMRS as the auxiliary information and conduct the retrieving algorithm based on PMRS. To cope with complex matching discovery, we compute the similarity among XML schemas semantic information carried by XML data. Our experimental results demonstrate the performance benefits of the schema matching framework using PMRS.
Approximate top-k structural similarity search over XML documents

Tao Xie,Chaofeng Sha,Xiaoling Wang,Aoying Zhou

DOI: https://doi.org/10.1007/11610113_29

2006-01-01

Abstract:With the development of XML applications, such as Digital Library, XML subscribe/publish system, and other XML repositories, top-k structural similarity search over XML documents is attracting more attention. The similarity of two XML documents can be measured by using the edit distance defined between XML trees in previous work. Since the computation of edit distances is time consuming, some recent work presented some approaches to calculate edit distance by using structural summaries to improve the algorithm performance. However, most existing algorithms for calculating edit distance between trees ignore the fact that nodes in a tree may be of different significance, and the same edit operation costs are assumed inappropriately for all nodes in XML document tree. This paper addresses this problem by proposing a summary structure which could be used to make the tree-based edit distance more rational; furthermore, a novel weighting scheme is proposed to indicate that some nodes are more important than others with respect for structural similarity. We introduce a new cost model for computing structural distance and takes weight information into account for nodes in distance computation in this paper. Compared with former techniques, our approach can approximately answer the top-k queries efficiently. We verify this approach through a series of experiments, and the results show that using weighted structural summaries for top-k queries is efficient and practical.
Application of XML Tree with Incomplete Information in Query Efficiency Improvement

肖金升,宋军,施伯乐

DOI: https://doi.org/10.3969/j.issn.1000-3428.2003.20.018

2003-01-01

Abstract:A lot of research has been done to improve the query efficiency of research engines. In the digital library project, people uses a method of taking full use of the previous results of users to improve the query efficiency. It uses the XML tree with incomplete information to record the results of the previous queries and uses the results to answer the following queries. The XML tree with incomplete information will be modified after each query.
Efficient processing of complex XML twig pattern queries based on path-joins

JIANG Jin-hua,WU Yu,HU Tian-lei,CHEN Gang

DOI: https://doi.org/10.3785/j.issn.1008-973X.2011.01.001

2011-01-01

Abstract:A novel path-joins based method was proposed to support efficient processing of complex twig pattern queries with OR-predicates of extensible markup language(XML) queries.The method processed the complex twig pattern matching in a holistic way based on the concept AND/OR branch extension(AOBE) and path-joins by dividing the twig pattern into individual paths.Then an index-based algorithm was proposed to efficiently skip useless elements and avoid unnecessary computations.The path-joins based method simplified the complex twig pattern queries processing compared with the existing algorithms.The method only accessed the labels of leaf query nodes,thus the I/O and CPU costs were greatly reduced.Experimental results demonstrate that the method is more efficient than previous approaches.
A General Framework to Resolve the MisMatch Problem in XML Keyword Search

Zhifeng Bao,Yong Zeng,Tok Wang Ling,Dongxiang Zhang,Guoliang Li,H. V. Jagadish

DOI: https://doi.org/10.1007/s00778-015-0386-1

2015-01-01

The VLDB Journal

Abstract:When users issue a query to a database, they have expectations about the results. If what they search for is unavailable in the database, the system will return an empty result or, worse, erroneous mismatch results. We call this problem the MisMatch problem. In this paper, we solve the MisMatch problem in the context of XML keyword search. Our solution is based on two novel concepts that we introduce: target node type and Distinguishability. Target Node Type represents the type of node a query result intends to match, and Distinguishability is used to measure the importance of the query keywords. Using these concepts, we develop a low-cost post-processing algorithm on the results of query evaluation to detect the MisMatch problem and generate helpful suggestions to users. Our approach has three noteworthy features: (1) for queries with the MisMatch problem, it generates the explanation, suggested queries and their sample results as the output to users, helping users judge whether the MisMatch problem is solved without reading all query results; (2) it is portable as it can work with any lowest common ancestor-based matching semantics (for XML data without ID references) or minimal Steiner tree-based matching semantics (for XML data with ID references) which return tree structures as results. It is orthogonal to the choice of result retrieval method adopted; (3) it is lightweight in the way that it occupies a very small proportion of the whole query evaluation time. Extensive experiments on three real datasets verify the effectiveness, efficiency and scalability of our approach. A search engine called XClear has been built and is available at http://xclear.comp.nus.edu.sg.
UD(k, l)-Index: An Efficient Approximate Index for XML Data

Hongwei Wu,Qing Wang,Jeffrey Xu Yu,Aoying Zhou,Shuigeng Zhou

DOI: https://doi.org/10.1007/978-3-540-45160-0_8

2003-01-01

Abstract:XML has become the main standard of data presentation and exchange on the Internet. Processing path expressions plays a key role in XML queries evaluation. Path indices can speed up path expressions evaluation on XML data by restricting search only to the relevant portion. However, to answer all path expressions accurately, traditional path indices group data nodes according to the paths from the root of the data graph to the nodes in question, regardless of the paths fanning out from these nodes. This leads to large indices size and low efficiency of branching path expressions evaluation. In this paper, we present UD(k, l)-indices, a family of efficient approximate index structures in which data nodes are grouped according to their incoming paths of length up to k and outgoing paths of length up to l. UD(k, l)-indices fully exploit local similarity of XML data nodes on their upward and downward paths, so can be used for efficiently evaluating path expressions, especially branching path expressions. For small values of k and l, UD(k, l)-index is approximate, we use validation-based approach to find exact answers to the path expressions. Experiments show that with proper values of k and l, UD(k, l)-index can improve the performance of path expressions evaluation significantly with low space overhead.
Approximate Membership Localization within a Web-Based Join Framework

zhixu li,laurianne sitbon,liwei wang,xiaofang zhou,xiaoyong du

2010-01-01

Abstract:In this paper, we propose a search-based approach to join two tables in the absence of clean join attributes. Non-structured documents from the web are used to express the correlations between a given query and a reference list. To implement this approach, a major challenge we meet is how to efficiently determine the number of times and the locations of each clean reference from the reference list that is approximately mentioned in the retrieved documents. We formalize the Approximate Membership Localization (AML) problem and propose an efficient partial pruning algorithm to solve it. A study using real-word data sets demonstrates the effectiveness of our search-based approach, and the efficiency of our AML algorithm.
Approximate membership localization (AML) for web-based join.

Zhixu Li,Laurianne Sitbon,Liwei Wang,Xiaofang Zhou,Xiaoyong Du

DOI: https://doi.org/10.1145/1871437.1871611

2010-01-01

Abstract:In this paper, we propose a search-based approach to join two tables in the absence of clean join attributes. Non-structured documents from the web are used to express the correlations between a given query and a reference list. To implement this approach, a major challenge we meet is how to efficiently determine the number of times and the locations of each clean reference from the reference list that is approximately mentioned in the retrieved documents. We formalize the Approximate Membership Localization (AML) problem and propose an efficient partial pruning algorithm to solve it. A study using real-word data sets demonstrates the effectiveness of our search-based approach, and the efficiency of our AML algorithm.
Efficient Holistic Twig Join Algorithm on XML Documents with Optimization Rules and Index

Jinhua Jiang,Gang Chen,Lidan Shou,Ke Chen

DOI: https://doi.org/10.1109/CW.2008.11

2008-01-01

Abstract:Efficiently finding all occurrences of a twig pattern is a core operation of XML query processing. In this paper, we first propose a generic twig join algorithm TJFGeneric which only scans the leaf query nodes using a cursor interface to return elements. And then we present TJFGeneric+ algorithm incorporating two optimization rules into TJFGeneric to explore potential benefit of disk read and CPU cost. In particular, available indices (such as B+-tree) are applied to skip the elements that do not participate in final results. Experimental results on various datasets indicate that our algorithms outperform previous approaches significantly.
AML: Efficient Approximate Membership Localization within a Web-Based Join Framework

Zhixu Li,Laurianne Sitbon,Liwei Wang,Xiaofang Zhou,Xiaoyong Du

DOI: https://doi.org/10.1109/TKDE.2011.178

IF: 9.235

2013-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:In this paper, we propose a new type of Dictionary-based Entity Recognition Problem, named Approximate Membership Localization (AML). The popular Approximate Membership Extraction (AME) provides a full coverage to the true matched substrings from a given document, but many redundancies cause a low efficiency of the AME process and deteriorate the performance of real-world applications using the extracted substrings. The AML problem targets at locating nonoverlapped substrings which is a better approximation to the true matched substrings without generating overlapped redundancies. In order to perform AML efficiently, we propose the optimized algorithm P-Prune that prunes a large part of overlapped redundant matched substrings before generating them. Our study using several real-word data sets demonstrates the efficiency of P-Prune over a baseline method. We also study the AML in application to a proposed web-based join framework scenario which is a search-based approach joining two tables using dictionary-based entity recognition from web documents. The results not only prove the advantage of AML over AME, but also demonstrate the effectiveness of our search-based approach.
Estimate XML Containment Join Size Using Weighted Haar Wavelet

SHAO Feng,CHEN Gang,CHEN Ke,BEI Yi-jun,DONG Jin-xiang

DOI: https://doi.org/10.3785/j.issn.1008-973x.2009.01.006

2009-01-01

Abstract:A novel weighted Haar wavelet method was proposed to estimate the size of extensible markup language(XML) containment join that is the basic operation in XML structural query processing.The method efficiently compressed the statistic of XML containment join size by the Haar wavelet.The statistic was maintained in the wavelet synopsis.XML containment join size was computed by the wavelet coefficient reconstruction during XML estimation.A novel weight model was presented based on the query frequency of XML tag name to reduce estimation error.The weight model was integrated into the Haar wavelet method.The experimental results show that the method outperforms previous join estimation methods,e.g.,histogram-based means,sample-based means.The method has smaller mean relative error than previous methods under the same space budget.
Analysis of Algorithms for XML Database Structural Join

MEN Ai-Hua,ZHOU Li-Zhu,ZHANG Ya-Peng

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.06.036

2007-01-01

Computer Science

Abstract:Structural join is the core operation in XML query processing, and catches the research community’s attention. Efficient algorithm is the key of efficient query processing. There have been a number of algorithms proposed for structural join. The article introduces several algorithms proposed for XML structural join, providing careful description and analysis for each of them, and compares their functions and their strongpoint and shortcoming.
Multi-query Join Algorithm Based on Sharing for XML Publish/subscribe Data Stream Systems

李永锋,潘懋

DOI: https://doi.org/10.3724/sp.j.1087.2008.03231

2008-01-01

Journal of Computer Applications

Abstract:In XML publish/subscribe system,, multi-query join involves the processing of subscriptions of several XML documents, including XPath evaluation, comparison computation and time management. XML join algorithm based on sharing observes that much join computation can be shared by several subscriptions to save the computation time of join. Experimental results demonstrate that the algorithm is efficient and suitable for the system of millions of subscriptions.

<Emphasis Type="Italic">pq</Emphasis>-Hash: An Efficient Method for Approximate XML Joins

Hash(Ed)-Join: Approximate String Similarity Join With Hashing

Extend Tree Edit Distance for Effective Object Identification

An Index Scheme for XML Documents Based on Relationship Joins

A Structural Index Based XML Pattern Matching Approach

Grams(3): An Efficient Framework For Xml Structural Similarity Search

Exploiting Even Partition to Accelerate Structure Join

Xml Structural Similarity Search Using Mapreduce

An Efficient Schema Matching Approach Using Previous Mapping Result Set

Approximate top-k structural similarity search over XML documents

Application of XML Tree with Incomplete Information in Query Efficiency Improvement

Efficient processing of complex XML twig pattern queries based on path-joins

A General Framework to Resolve the MisMatch Problem in XML Keyword Search

UD(k, l)-Index: An Efficient Approximate Index for XML Data

Approximate Membership Localization within a Web-Based Join Framework

Approximate membership localization (AML) for web-based join.

Efficient Holistic Twig Join Algorithm on XML Documents with Optimization Rules and Index

AML: Efficient Approximate Membership Localization within a Web-Based Join Framework

Estimate XML Containment Join Size Using Weighted Haar Wavelet

Analysis of Algorithms for XML Database Structural Join

Multi-query Join Algorithm Based on Sharing for XML Publish/subscribe Data Stream Systems