Research of ETL Technology and Application on Digital Library

Huang Yongwen,Li Guangjian

DOI: https://doi.org/10.3969/j.issn.1000-4254.2006.02.016

2006-01-01

Library journal

Abstract:The paper introduces the background of ETL (Extraction - Transformation - Loading), analyzes its architecture and functions, and discusses its current situation and research focus. At last, presents ETL applications on digital library.

What problem does this paper attempt to address?

A Scalable, Adaptive, Self-management and Fault-Tolerant Architecture for Digital Library

Liangju Zheng,Weiming Lu,Meng Zhang,Baofeng Zhang,Baogang Wei

DOI: https://doi.org/10.1007/978-3-642-34752-8_15

2012-01-01

Abstract:With the rapid growth of data, two major challenges are taking place in digital library technologies. One is the transition from database to Data Ocean; the other is the transition from digital library to Smart Library. In order to address these challenges, we propose a scalable, adaptive, self-management, fault-tolerant architecture for various services in the digital library. Users can deploy services quite easily on the architecture, and it also enables the deployed services load balancing, scalable, adaptive and fault-tolerant. The practice in CADAL demonstrates the feasibility and efficiency of our architecture.
Digital Meets Literature: Development of the China Foreign Literature Studies Index (CFLSI) Database

Wang Yong,Yang Yiheng,Zhang Kejun

2023-01-01

Abstract:The translation and research of Chinese foreign literature have a rich and distinguished history that spans over a century, yielding numerous and substantial achievements. These research outcomes for thoroughly synthesized and scientific analyses can provide authoritative and accurate guidance for foreign literature translation and research, highlighting the significance of the China Foreign Literature Studies Index (CFLSI) database. This article focuses on three issues encountered in database development. 1) An examination of the limitations of existing public network resources based on the unique nature of the foreign literature discipline, thereby establishing the necessity for the creation of a discipline-specific database; 2) An exploration of the composition, functional design, and implementation approaches of the CFLSI database in response to the requirements of foreign literature researchers; 3) The establishment of the database framework and development technology of the system aligned with the data composition and functional design. The creation of the CFLSI database represents an exploration and application to merge digital technology with a comprehensive understanding of the foreign literature discipline.
Digitization on Demand and Digital Library Service

Liu Jun,Mao Yiguo

DOI: https://doi.org/10.7536/j.issn.0252-3116.2013.16.015

2013-01-01

Abstract:Digitization on demand is one of development directions of digital library services. This article introduces the concept,backgrounds and needs of digitization on demand,analyzes the copyright issues,the operation modes,the scan quality and post- processing,storage and deliver,operation cycle and cost of digitization services on demand in foreign libraries,and discusses its inspiration to domestic libraries to carry out digital services on demand.
An Enterprise-Wide Digital Archive Management System Infrastructure

Wei Dong,Qiandong Ji,Lina He

DOI: https://doi.org/10.4028/www.scientific.net/amm.513-517.2420

2014-01-01

Applied Mechanics and Materials

Abstract:Nowadays, many digital archive systems have been developed to facilitate archive operations such as archive query and archive update. However, for many enterprises traditional archive management methods are still utilized, and paper files are the most important materials for archives. To cope with this problem, we present an enterprise-wide digital archive management system infrastructure in this paper. Based on this infrastructure, an archive query management is developed. Through the infrastructure and the query management, it can be expected that more production efficiency can be achieved.
Research on the application of information technology of Big Data in Chinese digital library

Shuqing Li,Zhiyuan Hao,Li Ding,Xia Xu

DOI: https://doi.org/10.1108/lm-04-2019-0021

2019-11-11

Library Management

Abstract:Purpose Through the case analysis of China’s digital library, the purpose of this paper is to make readers understand the development status, achievements and problems of China’s digital library. At the same time, it also enables readers to understand the common application forms of these modern information technologies in digital libraries, so as to provide a reference basis for the application of new technologies in other countries’ digital libraries. Design/methodology/approach On the basis of literature review, the authors have analyzed a conspicuous collection of related papers in order to make a comprehensive summary and elaboration on the present situation of modern information technology application in Chinese digital libraries. Findings This paper defines and analyses the concepts, contents and relationships of the three most important modern Big Data information technologies, and then completes the analysis of the current situation of the application of information technology in Chinese digital libraries. The block chain can achieve more accurate information collection, more secure information storage and more effective information dissemination. Artificial intelligence can improve the existing digital library service level in three aspects: resource construction, information organization and information service. Internet plus will help transform the traditional digital library business mode in order to adapt to the change of user-centered service. Originality/value This is among the first structured attempts of comprehensively and generally summarizing the application of modern information technology in Chinese digital libraries. It also contains an original exploration of the relationship between the main kinds of modern information technology. Based on this, a relatively complete application scenario and possible vision of modern information technology in digital library can be built.
Research of ETL on University Data Exchange Platform

Qian Wang,Naijia Liu,Chun Yu

DOI: https://doi.org/10.1109/itime.2011.6130834

2011-01-01

Abstract:To solve data exchange problems among heterogeneous databases in university data sharing platform, in this paper, the author focused on further research on Extract Transform Load (ETL) technology, designed and executed university data sharing platform based on CloverETL. This module, the core of the whole university data exchange platform, can well achieve data exchange and sharing among heterogeneous databases and run stably with less influence on server and business system, and thus getting a better result.
Research on the Architectures of Digital Libraries

Jun Wang,Dongqing Yang,Shiwei Tang,Liexun Yang

DOI: https://doi.org/10.3969/j.issn.1000-0135.2000.06.003

2000-01-01

Abstract:Digital Libraries were emerging on the demands of efficient manipulating of information resources. What digital libraries focus on are the main problems of the Internet:the difficulties of locating the required information, the interoperability of heterogeneous information, and manipulation mechanism of the large amount of information. The key technologies of digital libraries include the efficient organization of digital information, the interoperability of information repositories, and the infrastructure of digital libraries. The purpose of digital libraries is to realize the unified information retrieval across repositories,provide a virtual integrated information net. The main part of this paper introduces three influential digital library architectures, InterSpace, InfoBus and Agent-based architecture. In the end, the technologies todesign and to implement the architectures of digital libraries are summarized, the developing trend is anticipated.
Design of Digital Library Data Search Engine Based on Cloud Computing in Big Data Era

Baoyan Tang,Bingfu Hu

DOI: https://doi.org/10.1088/1742-6596/2037/1/012137

2021-09-01

Journal of Physics: Conference Series

Abstract:In the big data environment, people's acquisition of knowledge is no longer limited to the contents of books, but more data information from the Internet. Intelligent search engine implements information retrieval based on knowledge level, with strong natural language understanding and knowledge processing ability, showing good personalized information service characteristics. he theory of information ecology uses the theory, viewpoint and method of ecology to study the constituent factors of information ecosystem. Excess information and meeting the needs of readers have become the main contradictions in library services. As an architecture model suitable for library application, cloud computing can integrate scattered internet information data, realize the intensification of digital libraries, and provide a new solution for building and sharing digital resources and intelligent search engines. This paper discusses the construction mode of digital library service platform based on cloud computing technology, and analyzes the application and design method of intelligent search engine of cloud service digital library under the background of big data.

English Else
Extraction Transformation and Loading (ETL) of Data Using ETL Tools

Manish Manoj Singh

DOI: https://doi.org/10.22214/ijraset.2022.44939

2022-06-30

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: This Research Paper presents the Extract, Transform, Load (ETL) Process and discusses various ETL Tools Available in the Market. A huge piece of BI frameworks is a well-performing Implementation of the Extract, Transform, and Load (ETL) process. In BI projects, implementing the ETL process can be the big task ETL is the core process of Data integration which is associated with Data Warehouse. This paper also focuses on the best ETL Tools and which tool can be the best for the ETL process.
The Developmental Trends of the Service of Digital Libraries

Li Guangjian,Yang Lin

2012-01-01

Abstract:Changes in the digital information environment exert an impact on the development of the digital library. Based on the various researches and practice in this field, the current paper summarizes the developmental trends of the service of the digital library: maintaining and expanding the digital content, diversifying the users, mining resources and deepening the services, emphasizing the prevalence of service and supporting academic researches, with a view to offering reference for the construction of digital libraries in China.
Discussion on the Construction of the Digital Library in Establishment Units

杨忠,董莉

DOI: https://doi.org/10.3969/j.issn.1005-6033.2008.20.017

2008-01-01

Abstract:This paper analyzes the necessity of constructing the digital library, and taking the library of China Electric Power Research Institute as the example, introduces in detail some situations of the digital library in establishment units such as the integrated framework, digital resources, teller system, and information retrieval system, etc.
Development Trends of Next Generation Digital Library Architectures

Li Guangjian,Gong Liqun,Sun Jieli

DOI: https://doi.org/10.3969/j.issn.1003-7845.2006.03.001

2006-01-01

Abstract:This paper introduces new research trends of the next generation digital library architectures inrecent years,intensely analyzes the research on the application of SOA,grid and P2P technologies in thedigital library,and presents some prototypes developed by researchers abroad.35 refs.
A Study And Development Of Thadl Digital Library

Chunxiao Xing,Lizhu Zhou,Chun Zeng,Lei Li

2001-01-01

Abstract:In the era of the knowledge economy, digital libraries will become the essential part of the information infrastructure. Tsinghua University Architecture Digital Library (THADL), as a case study and development of digital library, is constructed with the goal to study the theories, methods and key techniques in digital library. Meanwhile THADL provides key services to protect, search, store, and exhibit the digital art treasures of Chinese ancient architecture on the Internet. This paper proposes an efficient architecture to develop THADL system and discusses the key techniques such as interoperability, information model, and metadata specification in THADL.
A Study on Architecture of Massive Information Management for Digital Library

邢春晓,曾春,李超,周立柱

2004-01-01

Journal of Software

Abstract:This paper investigates the challenging issues and technologies in managing very large digital contents and collections, and gives an overview of the works and enabling technologies in the related areas. Based on the analysis and comparison of the related work, a novel architecture of massive information management for digital library is designed. The key components and core services are described in detail. Finally, a case study THADL (Tsinghua University architecture digital library) that complies with the architectural framework is presented.
Report on the Digital Reference of the Academic Library in China

黄萃

DOI: https://doi.org/10.3969/j.issn.1003-7136.2003.06.016

2003-01-01

Abstract:The author makes a investigation of the digital references of academic library in China. According to it the paper describes some results of this investigation, then puts forward some suggestions about the development of the digital references of academic library in China on the basis of analysing the results of the investigation.
Library Service during the Transformation Period-From Traditional Library to Digital Library

Zhou Chunxia,Li Shumin,Huang Tao,Gao Guiying

DOI: https://doi.org/10.3969/j.issn.1002-1027.2006.02.017

2006-01-01

Abstract:The paper firstly discusses the concept of library during the transit time, and then guides the readers to wander each period of the library development. It reviews the characteristics of traditional library and emphases on the discussion of library service during the transit time. Finally, it forecasts the trends of digital library development.
Research and Exploration of Metadata in Artificial Intelligence Digital Library

Kang Han

DOI: https://doi.org/10.1088/1742-6596/1915/2/022061

2021-05-01

Journal of Physics: Conference Series

Abstract:Abstract With the surge of information, the intelligent management of library management research has been the general trend. With the gradually in-depth development of artificial intelligence, intelligent library management system to intelligent library sharing platform and intelligent Metadata platform as the foundation, the library can be based on artificial intelligence strong deep learning, calculation and responsiveness, according to library management process, collect related information, information analysis and decision-making of the library, to gradually replace human. Therefore, it is of great significance to transform digital library into Metadata platform under the background of artificial intelligence.
Study of Data Extraction Based on XML

Gang Tong,Kesheng Qin,Jun Tang,Yaohua Sun

DOI: https://doi.org/10.1109/WCSE.2009.142

2009-01-01

Abstract:With the development of enterprises informationalization, vast amounts of data are accumulated. And a variety of heterogeneous databases appeared on the Internet. How to access and extract these heterogeneous database are key technology for enterprises increase profits and market share. Technology of extracting data has become a hot project for business and IT sector. In this article XML and its characteristics briefly are introduced. Finally, using XML and JAVA technology, the realization process was presented in this article.
Research on Data Quality Control in Electronic Resource Management:Taking the Practice of Tsinghua University Library Based on ALMA System as an Example

武丽娜,窦天芳,周虹,刘阳

2023-01-01

Abstract:Purpose/Significance This paper puts forward the experience of Tsinghua University Library in electronic resource management and quality control based on ALMA system, which can provide reference for the application practice of peer libraries in the next generation library service platform and the method of electronic resource data quality control. Method/Process The necessity of data quality control of electronic resources was proposed through literature research; This paper adopted the method of questionnaire to investigate the electronic resource management mode and predicament of peer libraries, and extracted common problems. Based on the data model, workflow and management mode of electronic resource management in ALMA system, this paper put forward corresponding data quality control methods from the electronic resource library and single volume level, bibliographic level, discovery system and central discovery index level, providing reference for data quality control in the process of electronic resource management. Result/Conclusion Electronic resource management is a complex and multi-platform system project. The library should develop multi-level and three-dimensional data quality control scheme, and improve the electronic resource management and service level.
A review on the study of digital library evaluation

WANG Hui,CHEN Ya

DOI: https://doi.org/10.3969/j.issn.1006-1525.2007.03.030

2007-01-01

Abstract:This paper analyzes the study on digital library evaluation from 1997 to 2005,and summarizes the status quo and the existing problems of digital library evaluation at present.The author of this article aspires to make some suggestions and gives some enlargement to the people concerned who are going to make further studies on the digital library evaluation.

Research of ETL Technology and Application on Digital Library

A Scalable, Adaptive, Self-management and Fault-Tolerant Architecture for Digital Library

Digital Meets Literature: Development of the China Foreign Literature Studies Index (CFLSI) Database

Digitization on Demand and Digital Library Service

An Enterprise-Wide Digital Archive Management System Infrastructure

Research on the application of information technology of Big Data in Chinese digital library

Research of ETL on University Data Exchange Platform

Research on the Architectures of Digital Libraries

Design of Digital Library Data Search Engine Based on Cloud Computing in Big Data Era

Extraction Transformation and Loading (ETL) of Data Using ETL Tools

The Developmental Trends of the Service of Digital Libraries

Discussion on the Construction of the Digital Library in Establishment Units

Development Trends of Next Generation Digital Library Architectures

A Study And Development Of Thadl Digital Library

A Study on Architecture of Massive Information Management for Digital Library

Report on the Digital Reference of the Academic Library in China

Library Service during the Transformation Period-From Traditional Library to Digital Library

Research and Exploration of Metadata in Artificial Intelligence Digital Library

Study of Data Extraction Based on XML

Research on Data Quality Control in Electronic Resource Management:Taking the Practice of Tsinghua University Library Based on ALMA System as an Example

A review on the study of digital library evaluation