Implementation of Heterogeneous Data Conversion and Information Distribution System

刘冠群,曹永生,孔繁胜

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.23.024

2004-01-01

Abstract:This paper introduces a way of converting heterogeneous data into data under a certain DBMS. Based on it the paper describes the method and architecture of heterogeneous data distribution. An implementation is also provided.

What problem does this paper attempt to address?

Application of Heterogeneous Database Systems Integration in the DMS

GUO Ming-ze,ZHANG Jian-min,FANG Wen-dao

DOI: https://doi.org/10.3969/j.issn.1009-2552.2011.08.053

2011-01-01

Abstract:Distribution management utilizes the technique of computer,communication,and automatics to supervise,control,or manage the distribution equipments.How to implement information sharing,realizing inter-application integration is difficult for DMS at present.Based on the analysis of existing data conversion methods,this paper proposed a proposal on the DMS integration,especially elaborated the realization methods of data integration.
Design and Implementation of Clinical Data Integration and Management System Based on Hadoop Platform

Dao-Ming Lyu,Yu Tian,Yu Wang,Dan-Yang Tong,Wei-Wei Yin,Jing-Song Li

DOI: https://doi.org/10.1109/ITME.2015.86

2015-01-01

Abstract:With the increasing size of the medical data, the traditional processing methods and tools could not meet the requirements. So, resolving the challenges that the big medical data faces, is critical to realizing the promise of the big data [1]. Aiming at the problems in the big data integration process, this paper proposes the clinical data integration and management system based on Hadoop platform. As a result, the system can connect with multiple heterogeneous data source, such as EMR, PACS, LIS and so on. And then, on the basis of the data sharing, it can retrieve the patient's medical records and manage the different information.
IMPLEMENT DATA SHARING OVER NETWORK HETEROGENEOUS DATABASES BY DATA DIMENSION REDUCTION METHOD

Hua JIANG,Qi CHEN,Rui-Zhao YU

2000-01-01

Journal of Computer Research and Development

Abstract:The variety of databases structures as well as multiple data correlation on database index sets are major barriers on data sharing between heterogeneous databases. Most research work currently centralized on coherence access methods over heterogeneous databases, however, those methods can't establish a system in good scalability. In this paper, a new resolution is presented, which firstly find out general characteristics between many heterogeneous databases, and then the complexity of each database is reduced by using dimension reduction methods, so that data\|sharing becomes more flexible with a good scalability. In addition, the principal component views(PCV) reduce data correlation between shared\|databases.
Toward Spreadsheet-Based Data Management in Distributed Enterprise Environment

JF Tang,B Zhou,ZJ He,P Uros

DOI: https://doi.org/10.1109/cacwd.2004.1349257

2004-01-01

Abstract:We propose a feasible approach on managing the heterogeneous data in distributed enterprise environment, which leverages the born data presentation and calculation ability of spreadsheet to unify the enterprise information access to heterogeneous data sources through its core component: universal distributed data interchanging middleware (UDDIM). Afterwards, we focus on the problem of unifying all kinds of heterogeneous data sources from heterogeneous OS in Intranet through CORBA and Internet through SOAP into one single "Spreadsheet World". And this "Spreadsheet World" is bridged to and fro other information worlds through information gateway technology. XML technique is used to achieve data exchanging regardless of the differences of low-level communication mechanisms. As a result, all clients can access and utilize information from one single "Spreadsheet World" in variety of ways, both powerfully and easily.
Multi-database Middleware System Based on SEDA

金基东,陈文智

DOI: https://doi.org/10.3969/j.issn.1001-182X.2007.08.028

2007-01-01

Abstract:Great amount of heterogeneous data source were inherited from legacy enterprise application systems during the process of enterprise information evolution.We construct a multi-database middleware system based on SEDA,and build an agile database application development platform found on such architecture. Using this system,it can protect enterprise original investment,solve the problems accessing the heterogeneous data source,and the enterprise can develop the new systems quickly found on this system.
XML Based Exchange and Integration Techniques of Heterogeneous Data with Implementation

谢芳华,任午令,唐任仲

DOI: https://doi.org/10.3969/j.issn.1009-0134.2004.04.001

2004-01-01

Abstract:An XML technique based data exchange model was proposed, with using XML documentsas the base of data communication carrier, the information communication platform underInternet/Intranet environment was established and the software component was developed,which provides an effective low-cost method and tool to integrate and share different formatdata between heterogeneous databases. The method and tool has been applied to thedata integration and exchange of a supply chain management system.
A Service-Oriented Heterogeneous Geospatial Data Sharing Method in a Distributed Environment

Longmei Teng,Renyi Liu,Nan Liu

DOI: https://doi.org/10.1117/12.651252

2005-01-01

Abstract:This study put forward a method to realize heterogeneous geospatial data sharing. To realize heterogeneous geospatial data sharing, two key issues in technology are to be solved. One is how to exchange the heterogeneous geospatial data. The other is how to integrate and share heterogeneous geospatial data in a distributed environment. geography markup language (GML) can solve problems that exist in current solutions of geospatial data sharing, such as information losing and difficulty of expanding to Internet. Web Services can overcome problems of data transmission and platform heterogeneity, which exists in distributed computing technologies. Therefore, the method that combines GML and Web Services technology can meet the demand to realize heterogeneous geospatial data sharing (HGDS). A prototype of service-oriented heterogeneous geospatial data sharing system (HGDSS) in a distributed environment is successfully developed under Mircosoft.NET environment. The system used GML as medium of data conversion. Data transformation, snapshot and metadata release services are provided, and process and visualization of massive data are also concerned in the system.
Design and Implementation of Data Integrating and Publication System Based Web

田志博,孙政顺

DOI: https://doi.org/10.3969/j.issn.1000-1220.2003.12.051

2003-01-01

Abstract:By analyzing the diversiform storage of enterprise data and their mode, this paper presents the design and implementation of a data integrating and publication system based on web. This information system solves the integrated application of structured data and unstructured data, and integrates some important enterprise applications.
To Realize Data Exchange Among Multiple Systems

Yongqin Yang,Zhijun He

DOI: https://doi.org/10.3321/j.issn:1002-8331.2001.02.023

2001-01-01

Abstract:A common method is presented for data exchange among the existing application systems of enterprises.With the method,the problem of inconsistency of table data structure among systems is effectively solved,and which data tables can be exchanged is also not limited.
Design and Implementation of a Heterogeneous Distributed Database System

Jin Zhiquan,Liu Chengfei,Sun Zhongxiu,Zhou Xiaofang,Chen Peipei,Gu Jianming

DOI: https://doi.org/10.1007/bf02945288

IF: 1.871

1990-01-01

Journal of Computer Science and Technology

Abstract:This paper introduces a heterogeneous distributed database system called LSZ system, where LSZ is an abbreviation of Li Shizhen, an ancient Chinese medical scientist. LSZ system adopts cluster as distributed database node (or site). Each cluster consists of one or several microcomputers and one server. The paper describes its basic architecture and the prototype implementation, which includes query processing and optimization, transaction manager and data language translation. The system provides a uniform retrieve and update user interface through global relational data language GRDL.
Heterogeneous Data Transfer Software Platform for On-the-spot Archiving System

ZHANG Jun,TAO Lin-mi,YANG Chen-ke,XU Guang-you

2006-01-01

Abstract:Pervasive computing is the trend of development for computing mode. On-the-spot archiving system, as one of the important applications, normally involves transferring heterogenous data between multiple devices. A software platform for supporting heterogeneous data transfer was presented in this paper. The platform utilizes subscribe-publish pattern as transmission mode to enable runtime adjustment of transmission relationship and extendibility of the system. And the platform constructs distinct transmission relationship structures for different kinds of data to maintain high efficiency. Moreover, the platform provides simple and easy-to-learn API which conceals implementation details of data transfer. This platform has been applied to a class archiving system, which proves the practicability of the platform.
A Distributed Data Management System for Heterogeneous Sensor Networks

Xudong Li,Lijun Chen

DOI: https://doi.org/10.1109/icsess.2013.6615380

2013-01-01

Abstract:Sensor networks are already being used in a wide range of application domains such as environment, medical, military and transportation etc. Along with the widespread use of sensor networks, the data management becomes important. This paper proposes a distributed data management system of heterogeneous sensor networks which integrates data processing, visualization and performance measurement. The system uses dynamic data collection and distributed data storage methods which can reduce the energy cost. And the protocol independent message communication mechanism enables developers to reuse the system to any other underlying routing protocols. Finally, the adoption of distributed and hierarchical architecture makes the system scalable and convenient to deploy.
XML-based Complex Lab Data Representing, Storing and Publishing

Shao Zhijiang,Wang Yongming

DOI: https://doi.org/10.1109/wcica.2004.1342196

2004-01-01

Abstract:The problem of heterogeneous data integration in industrial supervisory control is presented and analyzed. The demand and difficulties of complex lab data representing, storing and publishing are outlined and analyzed in this paper. It is pointed out that a self-descriptive data structure with clear organization of contents and easy connection to human-machine interface is needed. A solution based on XML (eXtended Mark-up Language) is proposed with combination of different layers of data storage, data logic and presentation, human-machine interface. An XML-based system is developed to meet the demands of laboratory data publishing with complex structure. Construction of user interface from XML schema, conversion of lab data into XML, algorithm of storing XML into RDBMS (relation database manager system), query and reconstruction of XML documents from the RDBMS are touched upon. The data structure is described in details and its unique advantage is presented.
Design and Implementation of Data Distribution System(DDS) Based on SQL_DMO and ActiveX

高云君,章方铭,张学杰

DOI: https://doi.org/10.3969/j.issn.1001-3695.2004.06.043

2004-01-01

Abstract:With information era coming and the development of information technology,it becomes more and more important to make data interaction between information system and application system.The designing principle of a data districbution system based on SQL.DMO and ActiveX is discussed,and its key implementing techniques are given,such as the whole structure,function designing and so on.
Design and Implementation of the Enterprise Information Platform

HUAN Shi-yu,DONG Yuan

DOI: https://doi.org/10.3969/j.issn.1000-1638.2007.02.020

2007-01-01

Abstract:An Enterprise Application Integration system,named Enterprise Information Platform is designed and implemented in a J2EE environment to ensure data share across any operating system and network.Based on message mechanism,JMS is used to transfer message and XML is chosen to organize the format of communication data which can provide services and application programming interfaces to integrate heterogeneous data.This system has been successfully used in some enterprises,and its generality,openness,multiplexing and extensiveness have also been proved in practice.
Business Cooperation-oriented Heterogeneous System Integration Framework and its Implementation.

Yihua Ni,Yan Lu,Haibo Wang,Xinjian Gu,Zhengxiao Wang

DOI: https://doi.org/10.1007/978-1-84996-257-5_21

2010-01-01

Abstract:In the process of enterprise informatization, mass of legacy systems (such as database and applications) need integration, different application systems (PDM, ERP, SCM, CRM) need interaction and business between enterprises demand close cooperation. Took enterprise business cooperation as object, aimed at heterogeneous system integration, this paper proposed a framework for business cooperation-oriented heterogeneous system integration, and analyzed key technologies related to the framework, such as ontology modeling, ontology mapping, and semantic interoperation mechanism. Finally, the realization of the business cooperation framework was discussed. As a proof of concept, a prototypical platform based on this framework was developed, and the operating principle of the platform was analyzed. The proposed scheme has great theoretical significance which provides a new architecture and approach for heterogeneous system integration on business cooperation.
Data Migration Model and Algorithm Between Heterogeneous Databases Based on Web Service

Guowei Wang,Zongpu Jia,Manjun Xue

DOI: https://doi.org/10.4304/jnw.9.11.3127-3134

1969-01-01

Journal of Networks

Abstract:To solve the problems of data conversion between heterogeneous databases that arising from the progress of data migration, the paper presents an improved model of data migration and a data conversion algorithm based on the research on data synchronization via web service. The data migration model is divided into legacy data tier, middle tier and target data tier, which respectively provides data extracting, data converting and data loading functions. By establishing the corresponding relationships of different data fields between heterogeneous legacy database and target database, the data conversion algorithm converts data formats of legacy database into required data formats of target database according to the relationships, then writes the converted XML document to target database to achieve data migration. Experiments show that the model and algorithm can effectively realize data migration
hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems

Tian Luo,Rubao Lee,Michael Mesnier,Feng Chen,Xiaodong Zhang

DOI: https://doi.org/10.48550/arXiv.1207.0147

2012-07-01

Abstract:As storage systems become increasingly heterogeneous and complex, it adds burdens on DBAs, causing suboptimal performance even after a lot of human efforts have been made. In addition, existing monitoring-based storage management by access pattern detections has difficulties to handle workloads that are highly dynamic and concurrent. To achieve high performance by best utilizing heterogeneous storage devices, we have designed and implemented a heterogeneity-aware software framework for DBMS storage management called hStorage-DB, where semantic information that is critical for storage I/O is identified and passed to the storage manager. According to the collected semantic information, requests are classified into different types. Each type is assigned a proper QoS policy supported by the underlying storage system, so that every request will be served with a suitable storage device. With hStorage-DB, we can well utilize semantic information that cannot be detected through data access monitoring but is particularly important for a hybrid storage system. To show the effectiveness of hStorage-DB, we have implemented a system prototype that consists of an I/O request classification enabled DBMS, and a hybrid storage system that is organized into a two-level caching hierarchy. Our performance evaluation shows that hStorage-DB can automatically make proper decisions for data allocation in different storage devices and make substantial performance improvements in a cost-efficient way.

Databases
A Dynamic Data Information Management Algorithm For Multi-Database System Under Wan

H Xu,Y Zhang,Jm Hu,Jy Song

DOI: https://doi.org/10.1109/IVS.2005.1505160

2005-01-01

Abstract:In Intelligent Transportation System (ITS), it is of great significance to share data among distributed and heterogeneous databases to realized system goal. In this paper a strategy of managing dynamic data information for multi-databases system in ITS under wide-area network (WAN) is proposed. Data directory is introduced to record data information of every database system, and is periodically updated by using alphabetical link for database structure set. Updating message is transferred peer-to-peer to avoid bottle neck at one system. Finally, the paper discusses how to detect the login and logout systems. A demo system based on the presented method is introduced to prove its validity.
H-DB: Yet Another Big Data Hybrid System of Hadoop and DBMS

Tao Luo,Guoliang Chen,Yunquan Zhang

DOI: https://doi.org/10.1007/978-3-319-03859-9_28

2013-01-01

Abstract:With the explosion of the amount of data, analytics applications require much higher performance and scalability. However, traditional DBMS encounters the tough obstacle of scalability, and could not handle big data easily. In the meantime, due to the complex relational data model, the large amount of historical data and the independent demand of subsystems, it is not suitable to use either shared-nothing MPP architecture (e.g. Hadoop) or existing hybrid architecture (e.g. HadoopDB) to replace completely. In this paper, considering the feasibility and versatility of building a hybrid system, we propose a novel prototype H-DB which takes DBMSs as the underlying storage and execution units, and Hadoop as an index layer and a cache. H-DB not only retains the analytical DBMS, but also could handle the demands of rapidly exploding data applications. The experiments show that H-DB meets the demand, outperforms original system and would be appropriate for analogous big data applications.

Implementation of Heterogeneous Data Conversion and Information Distribution System

Application of Heterogeneous Database Systems Integration in the DMS

Design and Implementation of Clinical Data Integration and Management System Based on Hadoop Platform

IMPLEMENT DATA SHARING OVER NETWORK HETEROGENEOUS DATABASES BY DATA DIMENSION REDUCTION METHOD

Toward Spreadsheet-Based Data Management in Distributed Enterprise Environment

Multi-database Middleware System Based on SEDA

XML Based Exchange and Integration Techniques of Heterogeneous Data with Implementation

A Service-Oriented Heterogeneous Geospatial Data Sharing Method in a Distributed Environment

Design and Implementation of Data Integrating and Publication System Based Web

To Realize Data Exchange Among Multiple Systems

Design and Implementation of a Heterogeneous Distributed Database System

Heterogeneous Data Transfer Software Platform for On-the-spot Archiving System

A Distributed Data Management System for Heterogeneous Sensor Networks

XML-based Complex Lab Data Representing, Storing and Publishing

Design and Implementation of Data Distribution System(DDS) Based on SQL_DMO and ActiveX

Design and Implementation of the Enterprise Information Platform

Business Cooperation-oriented Heterogeneous System Integration Framework and its Implementation.

Data Migration Model and Algorithm Between Heterogeneous Databases Based on Web Service

hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems

A Dynamic Data Information Management Algorithm For Multi-Database System Under Wan

H-DB: Yet Another Big Data Hybrid System of Hadoop and DBMS