Research on Remote Database Migration

ZHANG Xiao,ZHANG Yu

DOI: https://doi.org/10.3969/j.issn.1001-3695.2005.04.036

2005-01-01

Abstract:Database migration technology comes from distribution database. In broadband networks, appropriate use of database migration can drastically shorten the average transaction processing time of a distributed database system. In this paper, the key technologies in database migration in WAN backbones are discussed.

What problem does this paper attempt to address?

Migrating Traditional Database-Based Systems onto Semantic Layer

Yixi Chen,Xiaohu Yang,Keting Yin,Ho Angela F.

DOI: https://doi.org/10.1109/CSSE.2008.322

2008-01-01

Abstract:Across various domains, the ontologies are learned from relational models of databases for the purpose of integrating data to a semantic layer. Through mappings among ontologies, new semantic applications can visit these integrated data with semantic query language like SPARQL. However, the traditional systems are still running on databases with SQL. In this paper we analyze the translations from basic relational algebra operations to SPARQL queries under an ontology learning approach. The result shows that SPARQL is relational completeness in the scenario. So the database-based application could be migrated from relational database onto semantic layer by replacing SQLs with SPARQL queries.
Netslab-based remote hybrid testing in current hierarchical network environment

Yurong Guo,Yan Xiao,Qing Hu

2006-01-01

Abstract:Remote hybrid testing concept is very promising in conducting large-scale testing for complex structural systems under strong earthquake excitation, in which many components may exhibit severe non-linear behavior. The current Internet is based on hierarchical network infrastructure and ubiquitous deployment of "middleboxes" can be seen on the Internet. So handy and robust data exchange in various network environments is still a challenging task for remote hybrid testing. This paper presents the development of a network communication platform, named NetSLab (Networked Structural Laboratories). The socket-based NetSLab is capable of transferring control and feedback data among remote structural testing laboratories or computers connected by Internet. To keep its simplicity for understanding, developing and maintenance, two new concepts, Dynamic Unified Data Packet (DUDP) and Generalized Data Communication Agency (GDCA), were introduced into NetSLab. A simple method was adopted in NetSLab to provide across firewall/proxy communication, which may greatly facilitate researchers to carry out remote hybrid testing in the current hierarchical network environments. Using NetSLab, a remote hybrid testing application has been developed and trial and actual testes were carried out at the Hunan University. Communication speed tests were performed over various network environments. The results showed that NetSLab was efficient and robust for data exchange in remote hybrid testing.
Distributed VOD system

Hao-ze YU,Shan-ping LI

DOI: https://doi.org/10.3969/j.issn.1000-7024.2005.05.085

2005-01-01

Abstract:It's easy to build a centralized VOD server in a LAN, which is easy to manage but is difficult to extend. But in the WAN, VOD is not yet widely implemented. The biggest obstacle is the lack of server bandwidth that can handle the large amounts of video data. A distributed VOD server is brought forward that is easy to extend so as to serve more concurrent customers and provide more programs, and the expansibility in these aspects is discussed: the architecture, communication based on CORBA, load balance and storage tech- nology. Experiments show that the VOD server is suitable for use both in LAN and WAN.
Architecture Design of Wide-area Distributed Real-time Database in Grid Dispatching Control System

Wang Zhihua,Liu Jin,Su Fan,Sun Mingyang,Fan Jing,Zhuang Weijin

DOI: https://doi.org/10.2991/iccte-16.2016.159

2016-01-01

Abstract:Power grid in future will develop into an extra-large interconnected grid with larger transmission capacity and more complex running characteristics. The trend of grid dispatching control system must be global wide-area and dynamic integrated necessarily. In this situation, it makes higher demand for real-time data to support grid supervisory and analysis. However, the existing real-time database with a centralized architecture commonly had the limits of scalability and performance, and it could hardly support a large number of concurrent data access. This paper proposed an architecture design of wide-area distributed real-time database (WDRTDB). WDRTDB divided all the real-time data into parts, and stored them on several servers. In addition, WDRTDB introduced a novel kind of data dictionary to index all data to provide a unified data access service for whole grid. Through experiments, we proved that WDRTDB had a better performance in real-time data processing than existing real-time database system.
Research on distributed relational database based on MySQL

Kai Wang,Man Li,Jiangang Tong,Hongming Qiao,Yiquan Jiang,Lanying Shi

DOI: https://doi.org/10.1117/12.2681360

2023-05-23

Abstract:With the rapid development of big data, cloud computing, artificial intelligence and other technologies, the expansion of database application requirements and the change of computer hardware environment, especially the rapid development of computer network and digital communication technology, satellite communications, cellular communications, computer local area networks, wide area networks, and the proliferation of Intranet and Internet have been widely used, resulting in the emergence of distributed database systems. Especially for basic industries such as telecommunications, databases often carry thousands of business systems, and millions of queries and tens of millions of bills are carried out every day. In the face of such massive scale, high concurrency, data security, real-time analysis and other multi scenario problems, the processing capacity of traditional centralized databases is far from meeting the needs. For this reason, this paper proposes a distributed database based on MySQL transformation. Through research and implementation, it can solve the above problems, meet the requirements of distributed transaction processing, ensure data backup, high availability and high performance, and improve efficiency. This paper will also describe its modeling model and sharding algorithm in detail.

Computer Science,Engineering
Network Performance-Aware Virtual Machine Migration in Data Centers

Jun Chen,Weidong Liu,Jiaxing Song

2012-01-01

Abstract:Virtual machine (VM) consolidation and migration technology in data centers greatly improve the utilization of the server resource. While the previous work focuses on how to use VM migration to balance physical host utilization or optimize energy consumption, little attention has been given to network performance factors, such as link traffic load and inter-traffic between VMs in data centers. In this paper, we present MWLAN (Migration With Link And Node load consideration), a novel automatic data center VM migration system that can detect hotspots (e.g., network congestion and physical host over-loaded) and dynamically remap VMs to improve the network performance. The VM migration approach proposed in MWLAN can efficiently balance the network link load and relieve the local data center network congestion as well as considering physical host constraints. Moreover, experimental evaluations indicate that the proposed approach reduces the packet loss by up to 50% and improves the average application TCP transfer rate by up to 24% compared to the other approaches when the data center network overloaded.
A Dynamic Data Information Management Algorithm For Multi-Database System Under Wan

H Xu,Y Zhang,Jm Hu,Jy Song

DOI: https://doi.org/10.1109/IVS.2005.1505160

2005-01-01

Abstract:In Intelligent Transportation System (ITS), it is of great significance to share data among distributed and heterogeneous databases to realized system goal. In this paper a strategy of managing dynamic data information for multi-databases system in ITS under wide-area network (WAN) is proposed. Data directory is introduced to record data information of every database system, and is periodically updated by using alphabetical link for database structure set. Updating message is transferred peer-to-peer to avoid bottle neck at one system. Finally, the paper discusses how to detect the login and logout systems. A demo system based on the presented method is introduced to prove its validity.
Delay guaranteed live migration of Virtual Machines

Jiao Zhang,Fengyuan Ren,Chuang Lin

DOI: https://doi.org/10.1109/INFOCOM.2014.6847982

2014-01-01

Abstract:The proliferation of cloud services makes virtualization technology more important. One important feature of virtualization is live Virtual Machine (VM) migration, which can be employed to facilitate load balancing, fault management and server maintenance etc. Two main metrics of evaluating a live VM migration mechanism are total migration time and downtime. The existing literature on live VM migration mainly focus on designing migration mechanisms to shorten these two metrics or making a tradeoff between them. Few of them can be applied to the applications with delay requirements, such as, delay-sensitive web services or a VM backup process that needs to be done in a specific time. This will not only negatively impact the user experiences, but also reduce the profit of cloud service providers. Besides, the frequently varied bandwidth required by the widely used pre-copy mechanism is difficult to be provided by current network technologies. In this work, we theoretically analyze how much bandwidth is required to guarantee the total migration time and downtime of a live VM migration. We first propose a deterministic-based model as a simple example, then assume that the dirtying frequency of each page obeys the bernoulli distribution. At last, we analyze the statistic features of the typical workload running in a VM and build a reciprocal-based workload model, and theoretically give the required bandwidth value to satisfy the performance metrics of a live VM migration. The experimental results demonstrate that the bandwidth obtained from the reciprocal-based model can guarantee the expected total migration time and downtime.
Distributed Cache Memory Data Migration Strategy Based on Cloud Computing

Wang Dongsheng,Huang Chuanhe

DOI: https://doi.org/10.1002/cpe.4828

2018-01-01

Abstract:SummaryIn view of the huge scale of cloud computing, cloud computing systems face many problems in terms of scalability and high availability. In view of the distributed data storage in the cloud computing environment, a recursion based N boundary network model is constructed. A data management model is given on the basis of the data center network structure. A replica distribution strategy and a copy selection strategy are designed to improve the data availability and load balance. On the premise of guaranteeing data availability, a data migration algorithm based on coverage set is proposed, which uses node selection strategy to reduce the migration cost as much as possible. Data migration makes more machines dormant and reduces energy consumption. By comparing and analyzing the experimental data, the correctness and effectiveness of the proposed network topology, data management model, and data migration technology are verified. In the edge cloud computing architecture, in order to ensure the response time of the cloud computing service and minimize the data redundancy in the system, this paper proposes and analyzes the data migration strategy and the pre stored data migration strategy for the network transmission, and gives the suitable application scene. On this basis, in order to control the balance of access network transmission and storage flexibly, a data migration strategy based on network performance is proposed, which ensures the real‐time response of the service.
Live Migration of Multiple Virtual Machines with Resource Reservation in Cloud Computing Environments

Kejiang Ye,Xiaohong Jiang,Dawei Huang,Jianhai Chen,Bei Wang

DOI: https://doi.org/10.1109/cloud.2011.69

2011-01-01

Abstract:Virtualization technology is currently becoming increasingly popular and valuable in cloud computing environments due to the benefits of server consolidation, live migration, and resource isolation. Live migration of virtual machines can be used to implement energy saving and load balancing in cloud data center. However, to our knowledge, most of the previous work concentrated on the implementation of migration technology itself while didn't consider the impact of resource reservation strategy on migration efficiency. This paper focuses on the live migration strategy of multiple virtual machines with different resource reservation methods. We first describe the live migration framework of multiple virtual machines with resource reservation technology. Then we perform a series of experiments to investigate the impacts of different resource reservation methods on the performance of live migration in both source machine and target machine. Additionally, we analyze the efficiency of parallel migration strategy and workload-aware migration strategy. The metrics such as downtime, total migration time, and workload performance overheads are measured. Experiments reveal some new discovery of live migration of multiple virtual machines. Based on the observed results, we present corresponding optimization methods to improve the migration efficiency.
Research on Disaster Recovery System Based on Migration of Virtual Machine

LIU Qi-cheng,ZHENG Wei-min,CHEN Kang

2010-01-01

Abstract:The grading and evaluation of disaster recovery system is described,the implementation and architecture of virtualization technology is discussed,the application of real-time migration based on virtualization technology in disaster recovery system,and the method to achieve real-time virtual machine migration using VMware VMotion technology is studied.
Guaranteeing Delay of Live Virtual Machine Migration by Determining and Provisioning Appropriate Bandwidth.

Jiao Zhang,Fengyuan Ren,Ran Shu,Tao Huang,Yunjie Liu

DOI: https://doi.org/10.1109/TC.2015.2500560

2016-01-01

Abstract:The proliferation of cloud services makes virtualization technology more important. One important feature of virtualization is live Virtual Machine (VM) migration. Two main metrics of evaluating a live VM migration mechanism are total migration time and downtime. Most existing literature on live VM migration focus on designing migration mechanisms to shorten the two metrics or making a tradeoff between them. Few of them can be applied to applications with delay requirements, such as a VM backup process that needs to be done in a specific time. This will negatively impact the user experiences and reduce the profit of cloud service providers. Besides, the frequently varied bandwidth required by the widely used pre-copy mechanism is difficult to be provided by current network technologies. In this work, we theoretically analyze how much bandwidth is required to guarantee the total migration time and downtime of a live VM migration, and then propose a novel transport control mechanism to guarantee the computed bandwidth. The experimental results demonstrate that the bandwidth obtained from the proposed reciprocal-based model guarantees the expected total migration time and downtime, and the proposed transport control mechanism ensures that the live VM migration flow obtains the expected bandwidth even if there are background flows.
Highly Efficient Data Migration and Backup for Big Data Applications in Elastic Optical Inter-Data-center Networks

Ping Lu,Liang Zhang,Xiahe Liu,Jingjing Yao,Zuqing Zhu

DOI: https://doi.org/10.1109/mnet.2015.7293303

IF: 10.294

2015-01-01

IEEE Network

Abstract:This article discusses the technologies for realizing highly efficient data migration and backup for big data applications in elastic optical inter-data-center (inter-DC) networks. We first describe the impacts of big data applications on underlying network infrastructure and introduce the concept of flexible-grid elastic optical inter-DC networks. Then we model the data migration in such networks as dynamic anycast and propose several efficient algorithms. Joint resource defragmentation is also discussed to further improve network performance. For efficient data backup, we leverage a mutual backup model and investigate how to avoid the prolonged negative impacts on DCs' normal operation by minimizing the DC backup window.
Process Migration for the Network of Workstations

PEI Dan,WANG Dong-sheng,SHEN Mei-ming

DOI: https://doi.org/10.13328/j.cnki.jos.1999.10.004

1999-01-01

Journal of Software

Abstract:Process migration is an important tool on NOWs (network of workstations) for load-balancing andhigh availability. In this paper, the authors present a log-based approach to provide process migration for parallelapplications. Because this approach is implemented on top of PVM (parallel virtual machine), it is transparent tousers and portable. This approach has been used in the ChaRM (checkpointing-based rollback recovery andprocess migration system) system. The experiments show that the overhead is low.
Online User Distribution-Aware Virtual Machine Re-Deployment and Live Migration in SDN-Based Data Centers.

Jin Qin,Yizhen Wu,Yutong Chen,Kaiping Xue,David S. L. Wei

DOI: https://doi.org/10.1109/ACCESS.2019.2891115

IF: 3.9

2019-01-01

IEEE Access

Abstract:Virtual machine (VM) re-deployment and migration has been proven to be a key technique for cloud data centers to implement resource optimization and load balance. Also, live VM migration aims to guarantee the continuity of the existing data flows. Though VM management has been well studied, it has so far mostly focused on optimizing resource utilization, while the important issue of users' quality of experience has been ignored. In mobile cloud computing, user distribution changes dynamically over time and it can significantly affect both the service latency and network resource utilization. In the traditional network, VM migration may cause a flash crowd of flow changing and a long service downtime due to VM's IP address changing. Software-defined networking is an emerging paradigm to logically centralize the network control plane and automate the configuration of individual network elements, which can be ubiquitously deployed in data centers and serve as an effective means for flow handling. In this paper, we design a user distribution-aware virtual machine re-deployment mechanism and propose a traffic-redirection virtual machine migration scheme to keep the active flows from being interrupted. We further provide simulations to show the effectiveness and superiority of the proposed approaches over existing schemes.
A Survey on Resource Scheduling for Data Transfers in Inter-Datacenter WANs

Jessie Hui Wang,Jilong Wang,Changqing An,Qianli Zhang

DOI: https://doi.org/10.1016/j.comnet.2019.06.011

IF: 5.493

2019-01-01

Computer Networks

Abstract:Today, datacenter providers spend a lot of money on inter-datacenter WANs to transmit traffic flows between geographically distributed datacenter sites. It is very important for datacenter providers to design resource scheduling schemes to schedule inter-datacenter networking resources to satisfy data transfer requests and achieve maximum performance or economic benefits. In this article, we conduct a review study on research efforts being conducted on the inter-datacenter networking resource scheduling problem. Our survey study is presented in three parts. The first part focuses on formulating the problem theoretically, including the definition and features of a data transfer, network models of inter-DC WANs, scheduling objectives, and scheduling dimensions. We also summarize a conceptual implementation architecture of scheduling systems. Second, we classify existing schemes according to their objectives and scheduling dimensions and then explain how they formulate and solve their own problems. In the third part, we examine practical challenges in developing scheduling systems and also point out some future directions. Since we do not see any survey focusing on the scheduling problem of inter-DC WANs, we believe this article can provide some help for research developments in this important field by organizing logically the recent research efforts from industry and academia.
Distributed Cloud Computing Environment Enhanced with Capabilities for Wide-Area Migration and Replication of Virtual Machines

Young-Chul Shim

DOI: https://doi.org/10.48550/arXiv.1401.1903

2014-01-09

Abstract:When a network application is implmented as a virtual machine on a cloud and is used by a large number of users, the location of the virtual machine should be selected carefully so that the response time experienced by users is minimized. As the user population moves and/or increases, the virtual machine may need to be migrated to a new location or replicated on many locations over a wide-area network. Virtual machine migration and replication have been studied extensively but in most cases are limited within a subnetwork to be able to maintain service continuity. In this paper we introduce a distributed cloud computing environment which facilitates the migration and replication of a virtual machine over a wide area network. The mechanism is provided by an overlay network of smart routers, each of which connects a cooperating data center to the Internet. The proposed approach is analyzed and compared with related works

Distributed, Parallel, and Cluster Computing
VM Migration Across Subnets in Future Internet Architecture—xia

MENG Hong-wei,CHEN Zhong,MENG Zi-qian,SONG Chuck

DOI: https://doi.org/10.11959/j.issn.1000-436x.2016058

2016-01-01

Abstract:When a VM migrates among hosts residing in two IP subnets,the network attachment point of VM changed,which causes the IP mobility problem.It was meaningful to design and evaluate VM migration performance under the future internet architecture.XIA (expressive Internet architecture)was focused,a novel future internet architecture,sup-port for VM live migration.Motivated by the natural f res of ID/location decoupling,versatile routing with DAG (di-rected acyclic graphs) in XIA,The design and implementation of rendezvous agent based migration (RABM) approach was given.In demonstrate that XIA supported VM migration can achieve fast network re-connection between VM and correspondent node,while keeping the network control plane simplicity and data plane efficiency.
Data Migration Model and Algorithm Between Heterogeneous Databases Based on Web Service

Guowei Wang,Zongpu Jia,Manjun Xue

DOI: https://doi.org/10.4304/jnw.9.11.3127-3134

1969-01-01

Journal of Networks

Abstract:To solve the problems of data conversion between heterogeneous databases that arising from the progress of data migration, the paper presents an improved model of data migration and a data conversion algorithm based on the research on data synchronization via web service. The data migration model is divided into legacy data tier, middle tier and target data tier, which respectively provides data extracting, data converting and data loading functions. By establishing the corresponding relationships of different data fields between heterogeneous legacy database and target database, the data conversion algorithm converts data formats of legacy database into required data formats of target database according to the relationships, then writes the converted XML document to target database to achieve data migration. Experiments show that the model and algorithm can effectively realize data migration
Quasi-asynchronous Migration

Pei Dan,Wang Dongsheng,Zhang Youhui,Shen Meiming

DOI: https://doi.org/10.1145/311094.311100

1999-01-01

ACM SIGOPS Operating Systems Review

Abstract:Process migration is a desirable and useful facility for the Network of Workstations (NOW). This paper presents a novel migration protocol called quasi-asynchronous migration for PVM tasks, which allows non-migrating tasks to execute during most of the time of migration. Message flushing and message delaying are the key mechanisms used in quasi-asynchronous migration. Because the protocol is implemented on top of PVM and at user-level, it is both transparent to users and portable. Both the analysis of the migration protocol and the experimental results show that quasi-asynchronous migration has lower overhead than other migration protocols.

Research on Remote Database Migration

Migrating Traditional Database-Based Systems onto Semantic Layer

Netslab-based remote hybrid testing in current hierarchical network environment

Distributed VOD system

Architecture Design of Wide-area Distributed Real-time Database in Grid Dispatching Control System

Research on distributed relational database based on MySQL

Network Performance-Aware Virtual Machine Migration in Data Centers

A Dynamic Data Information Management Algorithm For Multi-Database System Under Wan

Delay guaranteed live migration of Virtual Machines

Distributed Cache Memory Data Migration Strategy Based on Cloud Computing

Live Migration of Multiple Virtual Machines with Resource Reservation in Cloud Computing Environments

Research on Disaster Recovery System Based on Migration of Virtual Machine

Guaranteeing Delay of Live Virtual Machine Migration by Determining and Provisioning Appropriate Bandwidth.

Highly Efficient Data Migration and Backup for Big Data Applications in Elastic Optical Inter-Data-center Networks

Process Migration for the Network of Workstations

Online User Distribution-Aware Virtual Machine Re-Deployment and Live Migration in SDN-Based Data Centers.

A Survey on Resource Scheduling for Data Transfers in Inter-Datacenter WANs

Distributed Cloud Computing Environment Enhanced with Capabilities for Wide-Area Migration and Replication of Virtual Machines

VM Migration Across Subnets in Future Internet Architecture—xia

Data Migration Model and Algorithm Between Heterogeneous Databases Based on Web Service

Quasi-asynchronous Migration