Data Fusion Based Upon Common Data Model

LI Xiao-li,YU Dong-mei,DU Zhen-long

DOI: https://doi.org/10.3969/j.issn.1673-5196.2005.02.026

2005-01-01

Abstract:A common data model based upon hypergraph is proposed and given for transforming data into each other among various sources.The transformation method between relational schema and XML is also presented,so that the data fusion between those two kinds of data is realized.

What problem does this paper attempt to address?

A Method for Merging XML Schema Based Heterogeneous Resource Databases

周竞涛,张树生,王明微,孙宏伟,和延立,高俊杰

DOI: https://doi.org/10.3321/j.issn:1003-8728.2004.05.039

2004-01-01

Abstract:A digital library (DL) needs interoperation between diverse information services. In order to use the legacy heterogeneous resource databases in one single DL, their information requires merging into one common virtual model to facilitate the operation and interoperation. Heterogeneity, structure and semantic relationship extension are the main challenges in the process of merging. To solve these problems, we define a directed-graph data model as the common data model and propose a merging approach based on XML Schema which captures the full structures and semantic constraints in relational schema, translates them into the global XML Schema representations and merges the result through adding semantic content constraints. In addition, a security model that allows for authentication and authorization are implemented for the method to satisfy the authorization required in the merging process.
A General Multi-Source Data Fusion Framework

Weiming Liu,Chen Zhang,Bin Yu,Yitong Li

DOI: https://doi.org/10.1145/3318299.3318394

2019-01-01

Abstract:With the development of the Internet, the increase of information sources and speed of information release and transmission have led to a sharp increase in the amount of information. To enable users finding more accurate and reliable information in the large heterogeneous multi-source data, data fusion technology becomes more and more important. Data fusion technology structuralizes and integrates heterogeneous data from different sources which greatly improves the comprehensiveness, availability and extensibility of data. This paper proposes a general multi-source data fusion framework. The framework transforms multi-source structured data, semi-structured data and unstructured data into unified data format described by RDF (Resource Description Framework) standard, and then realizes information fusion through data fusion algorithm, to solve the heterogeneity and semantic conflict in multi-source data fusion under the big data environment.
Review of Dempster-Shafer Method for Data Fusion

Cong-fu XU,Wei-dong GENG,Yun-he PAN

DOI: https://doi.org/10.3321/j.issn:0372-2112.2001.03.027

2001-01-01

Abstract:As one of the most important fusion methods,Dempster-Shafer(DS)method has been used widely in all kinds of data fusion systems.In this paper,the fusion model based on DS method,typical realization approaches of this method,and DS method′s extension are discussed comprehensively.Finally,commentaries on this fusion emthod from the viewpoint of data fusion are given,and it is pointed out that combining DS method with other related theories is an important trend.
An XML-based schema translation method for relational data sharing and exchanging

Jingtao Zhou,Shusheng Zhang,Hongwei Sun,Mingwei Wang

DOI: https://doi.org/10.1109/CACWD.2004.1349118

2004-01-01

Abstract:Representing the sharing and exchanging data with machine-readable format allows cooperative task automation. In this paper we propose an XML schema and semantic based relational data translation approach, which aims at providing a coherent and meaningful view of the relational data and enabling distributed users to cooperate on large data volumes online. We define a directed-graph data model as the common data model, present a key-based relational schema reverse reconstruction arithmetic to capture the full structures and semantic constraints in relational schema, and propose a constraints-preserving mapping algorithm to translate relational data into the global XML representations.
A Multi-Dimensional Data Model and its Application

Xinfeng Tian,Zhanhuai Li,Yongge Liu

DOI: https://doi.org/10.1109/HPC.2000.843560

2000-01-01

Abstract:A data model and the relevant algebraic operations are proposed in this paper to provide a semantic foundation for the multi-dimensional database systems. The feature of this model is to treat all dimensions and measures symmetrically. It provides supports for achieving multiple hierarchies along a single dimension, for operating ad hoc aggregates, and for accomplishing multi-dimensional operations, which are closed in an application. In addition, we present an application, which is built up based on the above model, in the Object-Relational Database Management System (ORDBMS). The problems about creating a multi-dimensional data structure and defining the operations are discussed in this application. Some problems that need to be solved in the future are pointed out at the end of this paper.
A Flexible Data Structure for Heterogeneous Information Integration

Xin-Yang WANG,De-Yu QI,Wei-Wei LIN,Na-Qin ZHOU

DOI: https://doi.org/10.12783/dtcse/cst2017/12521

2017-01-01

DEStech Transactions on Computer Science and Engineering

Abstract:A uniform mechanism to express and operate various data is essential for the development of big data and internet of things, and the common data model provides fundamental supports for the integration of heterogeneous data. By comparing with the advantages and disadvantages of several primary common data models, this paper proposes a new common data model called GriDoc Data Model (GDM). Through the introduction of concepts, such as Paragraph, Section, GriData and GriDoc, the model establishes a flexible mechanism to express different kinds of heterogeneous data. On the basis of the GDM model concept, this paper defines the basic algebraic operations and presents the process of integrating and querying GDM object data.
Multi-source relational data fusion

Yue DING,Juan WANG,Wei LU,Chuitian RONG,Xiaoyong DU

DOI: https://doi.org/10.1360/ssi-2019-0172

2020-01-01

Abstract:Focusing on the problem of relational data fusion in the environment with “information isolated island”, this paper presents a multi-sources relational data fusion (MSF) framework. The framework consists of three components: schema matching, entity alignment, and entity fusion. Based on the Hungarian algorithm, we propose an alignment discovery mechanism for the attributes alignment among multi-sources relational data. By extracting the multi-dimensional features of attribute values, we efficiently realized schema matching of multi-sources relational data. To link the tuple pairs from multi-source data, we introduced the diversity sampling strategy and the entity feature extraction approach. These can effectively improve the performance of entity alignment. Finally, linked entities are fused to provide a unified view of data analysis. To verify the usefulness and efficiency of the proposed methods, we implemented a fusion system called Data Puzzle, which is verified with the real public multi-field data. Experimental results demonstrate that the proposed methods can fuse multi-source relational data efficiently with high recall and precision.
A Novel Xml-Based Power Resource Modeling Framework for Power System Heterogeneous Data Integrating

Can Wan,Zhaoyang Dong,Fengji Luo,Rui Wang,Yingying Chen,Ke Meng,Kit-Po Wong

DOI: https://doi.org/10.4028/www.scientific.net/amm.58-60.1476

2011-01-01

Abstract:This paper proposes a XML-based power heterogeneous data integrating framework. The tool uses XML to describe and model the objects of power system in a similar way with rational database. It helps transform the heterogeneous data belonging to different power organizations to the data with uniform format stored as XML files. The tool can enable the heterogeneous data integrating and exchanging of power system. Thus various distributed application can be developed base on this framework. The practical application proved the efficiency of proposed framework.
Multi-Dimensional Model Version Management System Based on Model Cloud Technology

Li Lixin,Wang Zian,Yuan Rongchang,Di Fangchun,Li Dapeng,Dai Jiao

DOI: https://doi.org/10.4028/www.scientific.net/amm.448-453.2730

2013-01-01

Applied Mechanics and Materials

Abstract:Due to the poor openness between grid models at different levels in existing dispatching centers, theres lack of unified device naming conventions, data exchange standards and interface specifications, making it difficult to easily implement the exchange and sharing of network model parameters and data. In this article, a multi-dimensional grid model version management system is promoted based on model cloud technology with centralized and integrated deployment. Taking advantage of model cloud storage and service technology, unified maintenance and management technology, model subscribing and extracting technology as well as its releasing methods and standardized access technology, the system can construct a cloud service unified in the whole grid, covering all dispatch services with the integration of the grid model information, therefore realizing the unified management, maintenance, generation, release and subscriptions.
Research on Multi-Source Heterogeneous Data Fusion Method Based on Cross-Modal Transformer

Huili Gong,Xiaowei Xin

DOI: https://doi.org/10.1109/iciba52610.2021.9687886

2021-01-01

Abstract:There are a large number of heterogeneous data in manufacturing industry, which are characterized by diversity of sources, low quality and complex types, and there are also some problems such as poor data consistency, weak availability and low sharing rate. Therefore, a multi-source heterogeneous information fusion method based on Transformer is proposed in this paper. The method can fuse multi-source heterogeneous data of multiple modes of enterprises, and make use of complementary information of cross-modal heterogeneous data to form the combination and unified expression of data features. The method focuses on the interaction between multi-mode sequences across different time steps and completes the fusion from one mode to another. The empirical analysis shows that the proposed multi-mode fusion method can well fuse different types of heterogeneous data, and a good fusion data set can effectively improve the model classification effect and provide data support for subsequent data analysis and decision-making.
Ontology-Based Fusion Method of Semantic Data

Liu Bo,Qi De-yu,Lin Wei-wei,Pang Xiong-wen

DOI: https://doi.org/10.3321/j.issn:1000-565x.2009.01.019

2009-01-01

Abstract:This paper deals with the semantic data access on demand in the grid environment and proposes a novel ontology-based semantic data fusion method named OSDF.In this method,the dataset is taken as the basic element,the mapping between the domain ontology and the dataset is used to obtain the semantics of the dataset,the nested relation model is employed to represent the pattern information of the dataset,and all the datasets integrated in a grid node are regarded as the datasets of the next node to perform a fine-to-coarse data fusion.Moreover,by defining the semantic model of OSDF and proposing the query-executing process and algorithm of the virtual database,a semantic-supported and QoS-supported data access is provided for users.The correctness and feasibility of OSDF are finally verified by a prototype.
Data Integration Schema Based on Multi-Middleware

ZHANG De-wen,XU Meng-chun,MA Hui

DOI: https://doi.org/10.3969/j.issn.1000-7024.2007.21.001

2007-01-01

Abstract:In order to accomplish.distributed heterogeneous data integration and solve information island problem,combining J2EE frame and many successful data integration schemas,a data integration schema based on multi-middleware is proposed,including data accessing middleware,message middleware and data source integration middleware.The frame and accomplishment of the data integ- ration schema is introduced particularly.The experimental result illustrates that the schema improve data integration efficie-ntly.Finally, further research fields are suggested combining with the latest technology development.
Research and implementation of feature-based data exchange method of heterogeneous 3D digital definition model

Weikang XIE,Gang ZHAO,Yong YU,Yaodong WANG

DOI: https://doi.org/10.13196/j.cims.2017.09.001

2017-01-01

Abstract:To solve the problem of feature and non-geometrical information loss in exchanging Model Based Definition (MBD) model data among heterogeneous CAD systems,by considering the geometric feature information,the non-geometrical information and the association between them,a feature-based heterogeneous 3D digital definition model exchange method was proposed.Extensible Markup Language (XML) was used to represent the feature information and non-geometrical information of 3D digital definition model and the association between them.The exchange of 3D digital definition model among heterogeneous CAD systems was achieved through the information extraction and reconstruction,and the geometric feature information and engineering note information were transformed at the same time and the relationships between them were remained.A structural model of a certain type of aircraft was introduced as an example to verify the validity of the model data exchange between Pro/E and CATIA.
Data Integration and Fusion of Multi-source Vector Map

Gang Li,Yong Gao,Min Zhang

DOI: https://doi.org/10.1109/CSO.2012.175

2012-01-01

Abstract:To the ambiguous question of data from multi-souce sources vector map, the paper described the overall framework, content and methods of data integration and fusion. Data integration includes unification of spatial reference, spatial data model and semantic coding. The method of data integration includes data format conversion, data mutual operation and data direct accessing. Data format conversion method is chosen in this paper because it is easy and practical. A self-adaptive iterative algorithm of matching the same entity in fusion is proposed in this paper which is significant in improving reliability of data. Finally, this paper takes digital vector map and digital vector chart for example to integrate and fuse data and the result is discussed.
A Data Model for XML Database

HE Zhen-Ying,LI Jian-Zhong,WANG Chao-Kun

DOI: https://doi.org/10.1360/jos170759

2006-01-01

Journal of Software

Abstract:Data model is a key research field in the community of XML data management. However, the existed works fall short in their ability to model complex data structure of XML database or to support complete operations. This paper proposes a new mapping-based data model. This model aims to give the precisely defined notations for complex data structure and semantics of XML database. Along with the model, this paper also presents an associated algebra formally which includes a set of path expression operations and data modification operations. This model has already adopted in an XML-based information integration system. It shows that this model can give the precise semantics of XML database, and support the XML database applications effectively.
Design and implementation of eXceed: a platform for integrating heterogeneous data

Zhi-cheng DOU,Xiao-jie YUAN,Wen-wei HU

DOI: https://doi.org/10.3969/j.issn.1673-095X.2005.05.013

2005-01-01

Abstract:After analyzing the features of the three architectures for heterogeneous data integration,this paper brings forward a mediator/wrapper solution based on XML,and implements a general heterogeneous data integration platform—eXceed.This platform realizes the extension of multi data source and provides the full-text index function and the specific engine for relation database.
STATUS AND DEVELOPMENT OF DATA FUSION

徐毅,金德琨,敬忠良

DOI: https://doi.org/10.3969/j.issn.1002-0411.2002.03.012

2002-01-01

Information and Control

Abstract:This paper overviews the development of data fusion. First, both the general process model and the system-architecture-oriented process model of data fusion are introduced. Second, several important topics are discussed, such as architecture, positional fusion, identity fusion, assessment of situation and threat and applications. Finally, the challenges and the further research tendencies are also discussed.
Hypernode: Entity Fusion for Data Traceability and Link Prediction

Bingbing Dong,Zan Zhang,Jiao Li,Yi Zhu,Chenyang Bu,Xindong Wu

DOI: https://doi.org/10.1109/icdm54844.2022.00021

2022-01-01

Abstract:In the era of big data, fragmented knowledge, multisource heterogeneity, and different representation forms of the same entities in various data sources have posed considerable challenges to entity fusion. How to effectively integrate multisource knowledge for the same entities has provoked vast amounts of attention and research from multiple disciplines. Most existing methods for entity fusion can be categorized into two classes: one is to establish an association between the same entities, and the other is to delete duplicate entities after knowledge fusion and create a new fusion entity. However, in these two classes of methods, the former does not achieve true knowledge fusion and semantic interoperability, while the latter may cause irreversible loss of original information. In this paper, we propose a novel entity fusion scheme: Hypernode. Hypernode fuses the same entity in different data sources into a new entity while retaining the original data. We verify the effectiveness of Hypernode on multiple models of link prediction experiments. Several practical application cases illustrate the applicability of Hypernode in data traceability, open domain knowledge fusion, and multi-modal knowledge graph fusion.
Data fusing driven graph embedding model for multi-source heterogeneous knowledge graph

Yu Zhang,Xiangyu Peng,Wang Hu

DOI: https://doi.org/10.1145/3641584.3641803

2023-09-22

Abstract:Graph embedding has been suggested as an efficient approach for discovering substantial and valuable knowledge in knowledge graphs. However, due to the vast amount and complexity of knowledge graphs, it is challenging to obtain reliable embeddings, which poses challenges in scalability and property selection. Previous research has given little attention to these challenges. In addressing this issue, a knowledge graph embedding model known as the data fusing driven graph embedding model (DFGE) is proposed, which comprises three modules: node embedding module, attribute embedding module, and merge module. Within DFGE, node attribute information is filtered and combined with graph structure information to calculate embeddings. Furthermore, multi-source heterogeneous data fusion technology (MHDF) is also proposed within this model to capture attribute features, embed and fuse nodes' attributes, and enhance DFGE's effectiveness. Extensive experiments are conducted on both Cora and a new proposed Buildings Seismic Damage dataset. Results confirm that DFGE delivers significant performance improvements over state-of-the-art models.

Computer Science
Multi-source heterogeneous data fusion

Yuxiang Xie,Xin Zhang,Lili Zhang,Luan Xidao

DOI: https://doi.org/10.1109/ICAIBD.2018.8396165

2018-05-26

Abstract:As the exponential growth of data in internet era, there comes the big data era. Big data fusion creates huge values that makes it a research hotspot. However, in big data era, data shows characters of large volume, velocity, veracity and especially variety which is also called heterogeneity. Multiple different sources of data lead to data heterogeneity. Multi-source heterogeneous data brings opportunities and challenges to big data fusion. This paper introduces big data fusion and methods for heterogeneous data fusion, especially focus on the application of deep learning methods in multi-source heterogeneous data fusion. Challenges of dealing with multi-source heterogeneous data fusion is also discussed.

Computer Science,Engineering

Data Fusion Based Upon Common Data Model

A Method for Merging XML Schema Based Heterogeneous Resource Databases

A General Multi-Source Data Fusion Framework

Review of Dempster-Shafer Method for Data Fusion

An XML-based schema translation method for relational data sharing and exchanging

A Multi-Dimensional Data Model and its Application

A Flexible Data Structure for Heterogeneous Information Integration

Multi-source relational data fusion

A Novel Xml-Based Power Resource Modeling Framework for Power System Heterogeneous Data Integrating

Multi-Dimensional Model Version Management System Based on Model Cloud Technology

Research on Multi-Source Heterogeneous Data Fusion Method Based on Cross-Modal Transformer

Ontology-Based Fusion Method of Semantic Data

Data Integration Schema Based on Multi-Middleware

Research and implementation of feature-based data exchange method of heterogeneous 3D digital definition model

Data Integration and Fusion of Multi-source Vector Map

A Data Model for XML Database

Design and implementation of eXceed: a platform for integrating heterogeneous data

STATUS AND DEVELOPMENT OF DATA FUSION

Hypernode: Entity Fusion for Data Traceability and Link Prediction

Data fusing driven graph embedding model for multi-source heterogeneous knowledge graph

Multi-source heterogeneous data fusion