Research on Evaluating Structural Similarity between XML Documents

Li-guo YAN,Fei HE

DOI: https://doi.org/10.3969/j.issn.1001-3695.2006.03.015

2006-01-01

Abstract:For sake of increasing requirement about approximate search,data cluster and data exchange from XML documents in the Web,a new effective metric for evaluating structural similarity between XML documents is brought forward.It's accurateness and effectiveness are testified by the experiments.

What problem does this paper attempt to address?

A comparative study on performance of XML parser APIs (DOM and SAX) in parsing efficiency

DaYong Wu,Kien Tsong Chau,JingYi Wang,ChuTing Pan

DOI: https://doi.org/10.1145/3309074.3309124

2019-01-01

Abstract:As a semi-structure language, XML is widely used in converting unstructured data to structured data due to its simplicity, extendibility and interoperability. There are numerous XML parser APIs that perform the same function of parsing XML document. This paper compares the performance between two famous XML parser APIs, DOM and SAX, in terms of speed, memory consumption and modifiability in parsing process. This experiment concluded that DOM API takes more time, more memory with higher level of modifiability while SAX API takes less time, less memory with lower level of modifiability.
Similarity Metric for XML Documents

Zhongping Zhang,Rong Li,Shunliang Cao,Yangyong Zhu

2003-01-01

Abstract:Since XML documents can be represented as trees, Based on traditional tree edit distance, this paper presents structural similarity metric for XML documents ,which is based on edge constraint, path constraint, and inclusive path constraint, and similarity metric based on machine learning with node costs. It extends scope for searching XML documents, and improves recall and precision for searching XML documents.
Improve Semantic Web Services Discovery Through Similarity Search in Metric Space

Minghui Wu,Fanwei Zhu,Jia Lv,Tao Jiang,Jing Ying

DOI: https://doi.org/10.1109/tase.2009.50

2009-01-01

Abstract:Most current semantic web services (SWS) discovery approaches focus on the matchmaking of services in a specific description language while in practical application the advertised services are often heterogeneous and distributed. This paper proposes a metric space approach to resolve this problem in which all heterogeneous web services are modeled as metric objects regardless of concrete description languages, and thereby the discovery problem can be treated as similarity search in metric space with a uniform criterion. In the matchmaking process, both the functional semantics and non-functional semantics of the web services are integrated as selection conditions for similarity query. And two types of similarity queries: range query and an improved nearest neighbor query are combined to produce a sorted result set.
Evaluate Structure Similarity In Xml Documents With Merge-Edit-Distance

Chong Zhou,Yansheng Lu,Lei Zou,Rong Hu

DOI: https://doi.org/10.1007/978-3-540-77018-3_31

2007-01-01

Abstract:XML language is widely used as a standard for data representation and exchange among Web applications. In recent years, many efforts have been spent in querying, integrating and clustering XML documents. Measuring the similarity among XML documents is the foundation of such applications. In this paper, we propose a new similarity measure method among the XML documents, which is based on Merge-Edit-Distance (MED). MED upholds the distribution information of the common tree in XML document trees. We urge the distribution information is useful for determining the similarity of XML documents. A novel algorithm is also proposed to calculate MED as follows. Given two XML document trees A and B, it compresses the two trees into one merge tree C and then transforms the tree C to the common tree of A and B with the defined operations such as "Delete", "Reduce", "Combine". The cost of the operation sequence is defined as MED. The experiments on real datasets give the evidence that the proposed similarity measure is effective.
Approximate top-k structural similarity search over XML documents

Tao Xie,Chaofeng Sha,Xiaoling Wang,Aoying Zhou

DOI: https://doi.org/10.1007/11610113_29

2006-01-01

Abstract:With the development of XML applications, such as Digital Library, XML subscribe/publish system, and other XML repositories, top-k structural similarity search over XML documents is attracting more attention. The similarity of two XML documents can be measured by using the edit distance defined between XML trees in previous work. Since the computation of edit distances is time consuming, some recent work presented some approaches to calculate edit distance by using structural summaries to improve the algorithm performance. However, most existing algorithms for calculating edit distance between trees ignore the fact that nodes in a tree may be of different significance, and the same edit operation costs are assumed inappropriately for all nodes in XML document tree. This paper addresses this problem by proposing a summary structure which could be used to make the tree-based edit distance more rational; furthermore, a novel weighting scheme is proposed to indicate that some nodes are more important than others with respect for structural similarity. We introduce a new cost model for computing structural distance and takes weight information into account for nodes in distance computation in this paper. Compared with former techniques, our approach can approximately answer the top-k queries efficiently. We verify this approach through a series of experiments, and the results show that using weighted structural summaries for top-k queries is efficient and practical.
Xml Structural Similarity Search Using Mapreduce

Peisen Yuan,Chaofeng Sha,Xiaoling Wang,Bin Yang,Aoying Zhou,Su Yang

DOI: https://doi.org/10.1007/978-3-642-14246-8_19

2010-01-01

Abstract:XML is a de-facto standard for web data exchange and information representation. Efficient management of these large volumes of XML data brings challenges to conventional technique. To cope with large scale data, MapReduce computing framework as an efficient solution has attracted more and more attention in the database community recently. In this paper, an efficient and scalable framework is proposed for XML structural similarity search on large cluster with MapReduce. First, sub-structures of XML structure are extracted from large XML corpus located on a large cluster in parallel. Then Min-Hashing and locality sensitive hashing techniques are developed on the distributed and parallel computing framework for efficient structural similarity search processing. An empirical study on the cluster with real large datasets demonstrates the effectiveness and efficiency of our approach.
Web mining of relations from XML and construct database schema

Zhou Xu,Pan Xuezeng,Ren Yu

DOI: https://doi.org/10.1109/CIMCA.2006.233

2007-01-01

Abstract:Increasing amount of commercial data is presented in XML format for exchanging or publishing on the web. It is emerging as a new standard for information representation and exchanging over the Internet. How to retrieve valuable information from XML documents on the web is a new challenge to data mining research. Compared with relational database, XML data in documents is stored as file with tree logical structure inside, it results in lower efficiency and performance in directly querying data. So it is still necessary to transform data into database (warehouse) for data mining afterwards. In this paper, we present a scheme to analyze relation of elements in XML on the web, and construct relational database schema based on the analysis. During the process, there would be a worthy accessory product - a glossary, which can facilitate the process of data mining warehouse designing and building. © 2006 IEEE.
Grams(3): An Efficient Framework For Xml Structural Similarity Search

Peisen Yuan,Xiaoling Wang,Chaofeng Sha,Ming Gao,Aoying Zhou

DOI: https://doi.org/10.1007/978-3-642-14589-6_43

2010-01-01

Abstract:Structural similarity search is a fundamental technology for XML data management. However, existing methods do not scale well with large volume of XML document. The pq-gram is an efficient way of extracting substructure from the tree-structured data for approximate structural similarity search. In this paper, we propose an effective framework GRAMS(3) for evaluating structural similarity of XML data. First pq-grams of XML document are extracted; then we study the characteristics of pq-gram of XML and generate doc-gram vector using TGF-IGF model for XML tree; finally we employ locality sensitive hashing for efficiently structural similarity search of XML documents. An empirical study using both synthetic and real datasets demonstrates the framework is efficient.
Research of XML document similarity based on edit graph

Peijuan XU,Fuhui QI,Zhuo LI,Limin WANG

DOI: https://doi.org/10.3778/j.issn.1002-8331.1401-0252

2016-01-01

Abstract:There are many algorithms for comparing XML similarity so far, and ED-based method is one of the most impor-tant classes. Because of the high efficiency feature, the edit graph algorithm becomes the basis of many ED algorithms. Firstly, the article introduces the idea of edit graph, because it has a strong dependence on the order of sibling nodes which is in the same layer in the sorting process, so the edit graph algorithm is not accurate and effective to compare the data-center XML document similarity. To resolve the problem, splitting edit graph algorithm based on edit graph and path algorithm is presented. Experimental results show that the algorithm reduces the dependence on the sibling order of the same layer of the edit graph algorithm, and it is more suitable for the data-center XML document similarity comparision, and the result of split edit graph algorithm is more accurate and effective.
A Model To Enhance Xml Document Clustering

Jianwu Yang,Xiaoou Chen

2001-01-01

Abstract:XML has become main data format in e-Business, e-Learning, e-Commerce, the need for tools to help manage XML documents also rises. Conventional text miners are mostly based on the vector space model of document, which views a document simply as an n-dimensional vector of terms. To retain the information in the structure and link, we have developed a structured link vector model (SLVM), which represents a document with a vector, whose elements determined by terms, element structure and neighbor documents. For briefness and clarity, they are described in the procedure of K-means: document similarity, and cluster center. Our cluster based on SLVM performs significantly more accurate than on conventional vector space model in our experiments, its K value of K-measure increase from 0.65similar to0.73 to 0.82similar to0.86.
Indexing Techniques For Query Of Xml Documents

Yuan Wang,Jianlin Sun,Jinxiang Dong

2001-01-01

Abstract:The popularity of XML in WWW calls for further research on query optimization for XML documents. In this paper, we introduce a universal indexing technique for XML documents based on DOM API and the XQuery Language. Then the design of a new kind of path indexing technique is presented, not only notably reducing the cost of query processing and facilitating its building and maintenance which would be provided later in this paper but also contributes to cost model and query visualization. Finally, we conclude the paper and address the future work.
Beyond topical similarity: a structural similarity measure for retrieving highly similar documents

Xiaojun Wan

DOI: https://doi.org/10.1007/s10115-006-0047-1

IF: 2.7

2006-01-01

Knowledge and Information Systems

Abstract:Accurately measuring document similarity is important for many text applications, e.g. document similarity search, document recommendation, etc. Most traditional similarity measures are based only on “bag of words” of documents and can well evaluate document topical similarity. In this paper, we propose the notion of document structural similarity, which is expected to further evaluate document similarity by comparing document subtopic structures. Three related factors (i.e. the optimal matching factor, the text order factor and the disturbing factor) are proposed and combined to evaluate document structural similarity, among which the optimal matching factor plays the key role and the other two factors rely on its results. The experimental results demonstrate the high performance of the optimal matching factor for evaluating document topical similarity, which is as well as or better than most popular measures. The user study shows the good ability of the proposed overall measure with all three factors to further find highly similar documents from those topically similar documents, which is much better than that of the popular measures and other baseline structural similarity measures.
Using Link-Based Content Analysis to Measure Document Similarity Effectively

Pei Li,Zhixu Li,Hongyan Liu,Jun He,Xiaoyong Du

DOI: https://doi.org/10.1007/978-3-642-00672-2_40

2009-01-01

Abstract:Along with a massive amount of information being placed online, it is a challenge to exploit the internal and external information of documents when assessing similarity between them. A variety of approaches have been proposed to model the document similarity based on different foundations, but usually they are not applicable for combining internal and external information. In this paper, we introduce a link-based method into content analysis, which is based on random walk on graphs. By defining similarity as the meeting probability of two random surfers, we propose a computational model for content analysis, which can also be integrated with external information of documents. Empirical study shows that our method achieves good accuracy, acceptable performance and fast convergent rate in multi-relational document similarity measuring.
Efficient Keyword Search Over Data-Centric Xml Documents

Guoliang Li,Jianhua Feng,Na Ta,Lizhu Zhou

DOI: https://doi.org/10.1007/978-3-540-72524-4_51

2007-01-01

Abstract:We in this paper investigate keyword search over data-centric XML documents. We first present a novel method to divide an XML document into self-integrated subtrees, which are connected subtrees and can capture different structural information of the XML document. We then propose the meaningful self-integrated trees, which contain all the keywords and describe how the keywords are interrelated, to answer keyword search over XML documents. In addition, we introduce the B+-tree index to accelerate the retrieval of those meaningful self-integrated trees. Moreover, to further enhance the performance of keyword search, we present Bloom Filter to improve the efficiency of generating those meaningful self-integrated trees. Finally, we conducted extensive experiments to evaluate the performance of our method, and the experimental results demonstrate that our method achieves high efficiency and outperforms the existing approaches significantly.
Querying Techniques for XML Data

KONG Ling-Bo,TANG Shi-Wei,YANG Dong-Qing,WANG Teng-Jiao,GAO Jun

DOI: https://doi.org/10.1360/jos181400

2007-01-01

Journal of Software

Abstract:XML has become the de facto standard for data representation and exchange for Web applications, such as digital library, Web service, and electronic business. How to retrieve interesting information from the promising XML data is an active research area. Among techniques in this area, the description of query patterns is a crucial section. This paper reviews the actualities of recent researches on this topic. It classifies the query descriptors into two categories, XML Query type and XML IR type (with three subcategories: XML IR/keyword, XML IR/fragment and XML IR/query), and concludes three popular problems: Twig pattern processing, SLCA (smallest lowest common ancestor) problem, and similarity measuring techniques for retrieved XML fragments. It analyzes the virtue and deficiency of related techniques based on their convenience for common users. And hereby it proposes four issues for further XML querying researches: structural keywords and corresponding structural similarity measuring, wiping off the redundancy in XML data processing between XML Query (including XML IR/query) and XML IR/keyword, theoretical discussion of XML Query and its realization, and the management of peculiar XML data.
A Rule-Based Information Extraction System for Human-Readable Semi-Structured Scientific Documents

Gang Chen,Baoran An,Sifeng Zeng

DOI: https://doi.org/10.1109/iccsnt.2015.7490711

2015-01-01

Abstract:The explosion of data over the past twenty years has fostered a huge amount of research in processing semi-structured documents like HTML and XML documents on Web. Nevertheless, the explosion of semi-structured documents that originate from outside the Web domain is more challenging. The data of semi-structured documents are everywhere: in scientific research reports, official journals, electronic health records and any records from other domains. Different from HTML and XML, semi-structured record is usually human-readable and has its own internal schema. On account of the incredible increase of data volumes, the traditional methods of studying on these data cannot meet the needs of high performance and flexible access. Relational database technique is a good alternative technique for managing and organizing data. In this paper, we aim at (1) revealing the semantic structure in human-readable scientific records (HSR), and (2) presenting a transformation system that converts HSR into structured relational database. Our approach identifies the relevant logical sub-structures and objects in HSR according to specific templates. We don't target "the best" methods but provide an available framework for facilitating the semi-structured HSR analysis tasks. The evaluation to the system shows its ability to enable the efficient transformation of HSR and therefore contributes to the increasing corpus of semi-structured HSR documents.
Similarity Measures for XML Documents Based on Kernel Matrix Learning

YANG Jian-Wu,CHEN Xiao-Ou

DOI: https://doi.org/10.1360/jos170991

2006-01-01

Journal of Software

Abstract:XML document as a new data model has been a hot research area. Similarity measure is a basic of analyses, management and text mining for XML documents. Structured Link Vector Model (SLVM) is a document model for the XML documents' similarity measure based on both the content and structure. The kernel matrix, which describes the relations between the structure units, plays an important role in the SLVM. In the paper, two algorithms are derived to learn the kernel matrix for capturing the relations between the structure units: one is based on the support vector machine and the other is based on matrix iterative analysis. For the performance evaluation, the proposed similarity measure is applied to similarity search. The experimental results show that the similarity measure based on kernel matrix learning outperform significantly the traditional measures. Furthermore, comparing with the kernel matrix leaning algorithm based on the support vector machine (SVM)'s regression, the kernel matrix leaning algorithms based on matrix iterative analysis not only acquires higher precision but also needs less training
A Novel Path-Based Method for Clustering XML Schemas

Li Nan,Yang Weidong,Fang Fei

2011-01-01

Journal of Computer Research and Development

Abstract:Most existing XML schema clustering techniques mainly focus on the element similarity,which cannot fully reveal the structural differences between schemas,especially in semantics.This paper presents a novel clustering method for XML schemas,which can capture the semantic and structural features.A novel evaluation model is devised to measure the schemas' similarities comprehensively,in which both the element similarity between best matching element pairs and their corresponding structural information are involved.Each schema is characterized with a feature vector,which facilitates the measurement of schema similarities by computing the cosine similarities between corresponding feature vectors.Extensive experiments indicate that the proposed approach outperforms existing proposals with better clustering validity and quality.
RESEARCH OF A KIND OF XML MATCHING MECHANISM

Huang Shao-Bin,Li Yan-Mei,Li Ya,Xu Li,Shen Lin-Shan

2016-01-01

Abstract:At present, the extensible markup language (XML) in many areas has become the essence of a data representation and exchange. In order to make it easier for data exchange, some organisation forms, such as the world wide web consortium (W3C), more and more committed to using the definition of a high-level language to describe the structure and content of an XML data sources, and in the process, the more frequent use of XML matching technology. XML matching, which is a process that discover semantics correspond to different data sources structure adopted by the different concept, over the years has always been an important subject in the field of database and artificial intelligence research. To this end, we propose a template of XML matcher template, which describes the main part of the XML matcher, the role and behaviour of each part, and it applies to all existing abstract structure model of the XML matcher. The putting forward of this template is very necessary for XML matching designing in the future.
Keyword Searches in Data-Centric XML Documents Using Tree Partitioning

Li Guoliang,Feng Jianhua,Zhou Lizhu

DOI: https://doi.org/10.1016/s1007-0214(09)70002-1

2009-01-01

Abstract:This paper presents an effective keyword search method for data-centric extensive markup language (XML) documents. The method divides an XML document into compact connected integral subtrees, called self-integral trees (SI-Trees), to capture the structural information in the XML document. The SI-Trees are generated based on a schema guide. Meaningful self-integral trees (MSI-Trees) are identified, which contain all or some of the input keywords for the keyword search in the XML documents. Indexing is used to accelerate the retrieval of MSI-Trees related to the input keywords. The MSI-Trees are ranked to identify the top-k results with the highest ranks. Extensive tests demonstrate that this method costs 10–100 ms to answer a keyword query, and outperforms existing approaches by 1–2 orders of magnitude.

Research on Evaluating Structural Similarity between XML Documents

A comparative study on performance of XML parser APIs (DOM and SAX) in parsing efficiency

Similarity Metric for XML Documents

Improve Semantic Web Services Discovery Through Similarity Search in Metric Space

Evaluate Structure Similarity In Xml Documents With Merge-Edit-Distance

Approximate top-k structural similarity search over XML documents

Xml Structural Similarity Search Using Mapreduce

Web mining of relations from XML and construct database schema

Grams(3): An Efficient Framework For Xml Structural Similarity Search

Research of XML document similarity based on edit graph

A Model To Enhance Xml Document Clustering

Indexing Techniques For Query Of Xml Documents

Beyond topical similarity: a structural similarity measure for retrieving highly similar documents

Using Link-Based Content Analysis to Measure Document Similarity Effectively

Efficient Keyword Search Over Data-Centric Xml Documents

Querying Techniques for XML Data

A Rule-Based Information Extraction System for Human-Readable Semi-Structured Scientific Documents

Similarity Measures for XML Documents Based on Kernel Matrix Learning

A Novel Path-Based Method for Clustering XML Schemas

RESEARCH OF A KIND OF XML MATCHING MECHANISM

Keyword Searches in Data-Centric XML Documents Using Tree Partitioning