The Data Replication Scheme of Wide Web System

WANG Xiaofeng,Li Wanzhou

DOI: https://doi.org/10.3969/j.issn.1000-3428.2001.04.045

2001-01-01

Abstract:Based on the comparison and contrast of several popular data replication techniques, a more flexible, more economical scheme is proposed, which is the combination of replication server technique and the file-transport method.

What problem does this paper attempt to address?

Grid Replication Coherence Protocol.

Yuzhong Sun,Zhiwei Xu

DOI: https://doi.org/10.1109/ipdps.2004.1303278

2004-01-01

Abstract:Summary form only given. Here we present two efficient coherence protocols for data grid applications. The data intensive grid applications often adopt the replica strategy to solve the data access bottleneck. It is important to keep coherence among all replicas of a copy of large amount of data. The first strategy for coherence is called lazy copy coherence protocol and the second aggressive copy coherence. Meanwhile, we consider in which situation we should make a replica for a copy of large amount of data.
Research on Data Replica Distribution Pattern for Web Server Clusters

Hai-Hua Shen,Shi-Min Chen,Mei-Ming Shen,Wei-Min Zheng

DOI: https://doi.org/10.1109/HPC.2000.843581

2000-01-01

Abstract:Today more and more WWW applications ask for basically non-stop services around the clock. Finding a good highly available scheme for a cluster web server becomes very important. Web server clusters with different data replica distribution pattern have different data availability level. Therefore our research focuses on data replica distribution pattern. After making theoretical analysis on data replica distribution patterns, an optimized one is put forward in this paper.
A Web Application Server Replication Scheme for Complex Transaction Patterns

Lijun Zuo,Shaohua Liu,Yong Feng,Jun Wei,Yang Li,Liang Zuo,Shing‐Hwa Liu,Wei Jiang

2008-01-01

Journal of Software

Abstract:The support of reliability as adopted in conventional replication or transaction processing techniques is not enough due to their distinct objectives: Replication guarantees the liveness of computational operations by using forward error recovery, while transaction processing guarantees the safety of application data by using backward error recovery. Combining the two mechanisms for stronger reliability is a challenging task. Current solutions, however, are typically on the assumption of simple transaction pattern where only a server transaction exists at the middle-tier application server, and seldom think about some complex patterns, such as client transaction or nested transaction. To address this problem, four typical transaction patterns in J2EE application are recognized first. Then a Web application server replication scheme based state synchronization point concept, RSCTP (replication scheme for complex transaction pattern), is presented to uniformly provide exactly-once semantic reliability support for these complex transaction patterns. In this scheme, EJB components are replicated to endow business logics with high availability. In addition, by replicating transaction coordinator, the blocking problem of 2PC protocol during distributed transactions processing is eliminated. Different transaction scenarios are also discussed to illustrate the effectivity of this scheme. This scheme has been implemented, and it has been integrated into J2EE compatible application server, OnceAS, and the performance evaluation shows that its overhead is acceptable.
An Excogitation for Efficient Replication of Distributed Databases

王延青,殷丽华,方滨兴

DOI: https://doi.org/10.3321/j.issn:0367-6234.2004.08.009

2004-01-01

Abstract:To solve some problems in the replication process of distributed databases such as mass data transfer, low efficiency and difficulty to keep data integrity, a replication excogitation named Pull and push is presented. In this method, the information control center collects log data from each subzone, merges it and then distributes it to each subzone again. The method is based on log and only changed data will be transferred, so it can be applied even in a narrowband network like dialup. Also, simulated transaction makes the replication more tolerant to fault. Moreover, the usage of dynamic remote stored procedure enhances the efficiency and reliability of replication. This method has been applied to a MIS project successfully, which proved that this excogitation is simple, highly efficient and practical.
(Invited) Popularity-Based Content Replication Scheme for Wireless Mesh Network.

Chenkai Yang,Liusheng Huang,Xinglong Wang,Hongli Xu,Bing Leng

DOI: https://doi.org/10.1109/wcsp.2015.7340998

2015-01-01

Abstract:Wireless Mesh Network (WMN) is now being extensively used as a cost-effective means for coverage extension and backhaul relaying. One of the key challenges it suffers from is data access efficiency arising from resource constraints of wireless communications. Therefore, many content replication schemes based on the popularity of objects have been proposed for WMNs. However, most of the existing works on object replication schemes in WMNs ignore the restricted service rate of the replica servers. In this paper, we investigate the techniques of popularity-based content replication in WMNs to optimize the overall performance of average latency. We define the popularity of objects and model the replica server as simple M/M/1 queuing systems. Then, a formal definition and formalization of the popularity-based replication problem will be given. We show this problem is NP-complete and propose a distributed scheme composed of two-phase. We conduct abundant simulation experiments to evaluate the performance of our proposed scheme. The simulation results show that the proposed scheme gains much lower average latency without increasing the network load.
Rer: A Replica Efficiency Based Replication Strategy

Feng Guofu,Zhang Jincheng,Lu Sanglu,Chen Guihai,Chen Daoxu

IF: 1.019

2008-01-01

Chinese Journal of Electronics

Abstract:The technology of replication is often used in the unstructured Peer-to-peer (P2P) systems to allocate more replicas for the hot spots in order for a higher search performance. But the questions that what is the optimal number of copies for each file and what is the practicable approach to the optimal number are seldom answered in the related works. In terms of success rate, this paper firstly investigates the optimal allocation of copies for each file according to query rate with the routing algorithm of random walks. Then a practicable method is proposed to approach the optimal allocation in the unstructured P2P systems. Our results offer a new understanding of replication and our work contributes much to the content distribution in the Internet environment.
An Efficient Distributed Load Balancing Scheme Based on Replicable Resource

WANG Zheng,LIU Xin-song,LI Mei-an

DOI: https://doi.org/10.3321/j.issn:0372-2112.2006.08.019

2006-01-01

Abstract:In order to deal with the shortcomings of traditional schemes,a novel efficient distributed load-balancing scheme based on replicable resource was proposed.Instead of those traditional schemes,the paper proposed a novel scheme to classify the resource load of a system as exterior load,interior load and transmission load to be processed respectively.In addition,the paper presented a new conception of load directivity and utilized it in load balancing scheme.At last,scheme analysis and simulation results show that the scheme can efficiently balance load,decrease interior communication flux and restrain system load threshing.
Quality Driven Web Services Replication Using Directed Acyclic Graph Coding

An Liu,Qing Li,Liusheng Huang

DOI: https://doi.org/10.1007/978-3-642-24434-6_28

2011-01-01

Abstract:Web services cannot be always available as they are typically deployed in a dynamic environment. As an effective approach to improving Web services availability, replication has received much attention recently. How to design an optimal replication scheme with the best QoS, however, remains an open problem due to its inherent computational hardness. In this paper, we propose an efficient approach to designing a near-optimal replication scheme. We adopt directed acyclic graph (DAG) as the modeling tool for replication scheme and then utilize DAG coding for performance optimization. Simulation results show our approach can generate a near-optimal replication scheme with acceptable computation overheads.
An Optimal Replication Strategy for Data Grid Systems

Jiang Jianjin,Yang Guangwen

DOI: https://doi.org/10.1007/s11704-007-0033-0

2007-01-01

Frontiers of Computer Science in China

Abstract:Data access latency is an important metric of system performance in data grid. By means of efficient replication strategy, the amount of data transferred in a wide area network will decrease, and the average access latency of data will decrease ultimately. The motivation of our research is to solve the optimized replica distribution problem in a data grid; that is, the system should utilize many replicas for every data with storage constraints to minimize the average access latency of data. This paper proposes a model of replication strategy in federated data grid and gives the optimized solution. The analysis results and simulation results show that the optimized replication strategy proposed in this paper is superior to LRU caching strategy, uniform replication strategy, proportional replication strategy and square root replication strategy in terms of wide area network bandwidth requirement and in the average access latency of data.
A dynamic optimal replication strategy in data grid environment

Wuqing Zhao,Xianbin Xu,Zhuowei Wang,Yuping Zhang,Shuibing He

DOI: https://doi.org/10.1109/ITAPP.2010.5566469

2010-01-01

Abstract:The data grid technology, which uses the scale of the Internet to provide storage capability for the mass data, has become one of the hot research topics. The high latency of the network is the bottleneck in accessing the files in data grid systems. The replication strategy can shorten the time of fetching the files by creating many replicas stored in appropriate locations. Due to the limited storage capacity of each node, it is important to have an efficient replication strategy to make sure of the overall performance. In order to solve the problem, we propose a dynamic optimal replication strategy (DORS) in this paper. First, we empirically infer a threshold from some former work to decide whether one file is needed to be copied to other nodes. Then, a measure is devised to get the importance of each file, which relies on the inner and external features of the file. Finally, the algorithm can decide which replica to replace based on the importance value. Results from the simulation show the better performance of our algorithm than other former work. ©2010 IEEE.
A Kind of Data-Synchronous Software of Database under Internet Environment

刘风略,饶若楠

DOI: https://doi.org/10.3969/j.issn.1007-757X.2007.06.017

2007-01-01

Abstract:SQL Server replication can synchronize data to various servers by back - end configuration, but it has somelimitations and can not meet specific demands of enterprises. In this thesis, a series of improvements were proposed based onSQL server's replication, including that building middle layer to reduce the workloads of the source and destination database,serializing data before transfer to improve efficiency, and setting record status control for higher accuracy. With the aboveimprovements, our data synchronization method has higher flexibility, better safety and more accuracy compared to SQLserver's replication.
GReplica: A Web-based Data Grid Replica Management System

Bing Han,Shoubao Yang,Xiang Yu

DOI: https://doi.org/10.1109/SKG.2005.78

2005-01-01

Abstract:In wide-area distributed computing systems, it is often desirable to create remote copies (replicas) of files. File replication can be used to reduce access latency, improve data locality, and/or increase robustness, scalability and performance for distributed applications. In this paper, we describe a Web-based data grid replica management system (we call it GReplica) developed in Globus Toolkit.
Based on the Correlation of the File Dynamic Replication Strategy in Multi-Tier Data Grid

Zhongqiang Cui,Decheng Zuo,Zhan Zhang

DOI: https://doi.org/10.14257/ijdta.2015.8.1.09

2015-01-01

International Journal of Database Theory and Application

Abstract:The data grid is one of the infrastructures for data and storage resource management. Data replication can improve data access performance, fault tolerance, and reduce network transmission bandwidth. As the site storage space is limited in the grid, how to effectively use grid resources become an important challenge. This paper introduces a dynamic grid replication algorithm based on popularity support and confidence (BPSC). Through the algorithm, data and its associated copy can be placed on a suitable site, with reduced access latency. Through Optorsim, simulation results show that the algorithm can provide better performance compared with other algorithms Grid computing is an important branch of distributed computing. Grid computing constructs a virtual computer system through using a different location of the large number of heterogeneous resources (CPU and storage), provides the model to solve the problem of large scale computing and storage. The data grid is mainly the grid for data storage management. The data grid is defined as an effective combination of data and computing resources of distributed systems by Data Grid Group. The large-scale data- intensive applications, such as bioinformatics, high energy physics, space information generated vast amounts of data, these data may be TB scale, even up to the scale of PB. It is not practical to maintain large scale data at each site, and provide computing resources for visitors. At the same time, it will lead to increased access latency through a centralized way to storing and accessing these data from each site. Data replication technology is an effective method to reduce access latency in the data grid system. Data replication is one of the basic methods of distributed systems to improve the efficiency of system access, maintenance, system high availability. Data replication is to store data in the appropriate site for users to effective access to massive data. Data replication can reduce data access latency, reduce network bandwidth consumption, avoid congestion, adjust the load balancing in server-side, improve system reliability. Many data replication algorithm can reduce data access latency, improve system reliability, but which data will be copied, when the data will be copied at, where the data will be copied are the basic means of determining data replication algorithm. In this paper, we introduced a real-time dynamic data replication algorithm. The algorithm is based on the popularity of file dynamic to replicate data, and consider the storage space limitations of the site. Through optorsim simulation verified the algorithm. This paper is organized as follows: Section 2 is about related works on replication in data grids. In Section 3, system model and component in system are presented. The file
Research on Lazy Replication

郑增威,林怀忠,王苏仪

DOI: https://doi.org/10.3969/j.issn.1007-130x.2003.05.028

2003-01-01

Abstract:To improve data availability and system performance, data replication methods are widely adopted in distributed databases and data warehouses. Due to the massive communication overhead and operation delay, classical eager replication may bring about unacceptable number of failed or blocked transactions, which has made it inapplicable. Lazy replication, which adopts an optimistic approach in handling data conflicts, is suggested to resolve the problem in recent years. In this paper, To explore the laws lain in the method, lazy replication is classified and studied intensively.
Web-Based Distributed Data Communication Systems

Jingming Huang,Yi Zhang,Junhua Xu

DOI: https://doi.org/10.3321/j.issn:1002-8331.2001.10.016

2001-01-01

Abstract:Although Web-based Management Information Systems are accepted by more and more users and system developers,their usages are still restricted by the poor network conditions in many internal companies. According to this situation,this paper introduces a new resolution to the data communication and describes the system architecture and its implementation. The paper also fingers out the suitable conditions and advantages of the system and provides a practical example at last.
A General Packet Replication Scheme for Multicasting in Interconnection Networks

SC Liew

DOI: https://doi.org/10.1109/infcom.1995.515900

IF: 6.166

1996-01-01

IEEE Transactions on Communications

Abstract:Multicasting in broadband packet switches and metropolitan networks can be achieved by first replicating the packets and then routing them to their destinations. This paper studies a very simple but general replication scheme that can be applied to arbitrary interconnection-network topologies. The replication process of a packet adapts itself according to the network topology and the traffic condition. Hot spots of replication activities are diffused by this scheme which automatically moves part of the replication efforts to less active network regions. The scheme can potentially be used in networks (e.g., the Manhattan-street network) in which multicasting were thought to be inherently difficult. Fundamental issues and critical problem areas are laid out, and solutions addressing them are proposed. The performance of the replication algorithm and its implementation (logic diagram level) in the shuffle-exchange copy network are investigated in detail. It is found that the performance of the algorithm improves with the increase of network dimensions.
Efficient and Adaptive Web Replication Using Content Clustering

Y Chen,LL Qiu,WY Chen,L Nguyen,RH Katz

DOI: https://doi.org/10.1109/jsac.2003.814608

IF: 16.4

2003-01-01

IEEE Journal on Selected Areas in Communications

Abstract:Recently, there has been an increasing deployment of content distribution networks (CDNs) that offer hosting services to Web content providers. In this paper, we first compare the uncooperative pulling of Web contents used by commercial CDNs with the cooperative pushing. Our results show that the latter can achieve comparable users' perceived performance with only 4%-5% of replication and update traffic compared with the former scheme. Therefore, we explore how to efficiently push content to CDN nodes. Using trace-driven simulation, we show that replicating content in units of URLs can yield 60%-70% reduction in clients' latency, compared with replicating in units of Websites. However, it is very expensive to perform such a fine-grained replication. To address this issue, we propose to replicate content in units of clusters, each containing objects which are likely to be requested by clients that are topologically close. To this end, we describe three clustering techniques and use various topologies and several large Web server traces to evaluate their performance. Our results show that the cluster-based replication achieves performance close to that of the URL-based scheme, but only at 1%-2% of computation and management cost. In addition, by adjusting the number of clusters, we can smoothly trade off management and computation cost for better client performance. To adapt to changes in users' access patterns, we also explore incremental clustering that adaptively adds new documents to the existing content clusters. We examine both offline and online incremental clustering, where the former assumes access history is available while the latter predicts access pattern based on the hyperlink structure. Our results show that the offline clustering yields performance close to that of the complete re-clustering at much lower overhead. The online incremental clustering and replication cut down the retrieval cost by 4.6 times compared with random and by 8 times compared with no replication. Therefore it is especially useful to improve document availability during flash crowds.
The research of web-based data warehouse using XML

Li Xiu,Wang Xuerui,Liu Wenhuang,Liao Lin

DOI: https://doi.org/10.1109/ICII.2001.983492

2001-01-01

Abstract:The traditional data warehouse systems based on client/server configuration meet many challenges when more and more people need to share the data. In this paper, the architecture of web-based warehouse using XML is presented as a solution. And the design of the application server is explained specifically. The architecture is promising because of its prominent advantages.
Dynamic Data Replication in Distributed Systems

Yixiu Huang

1995-01-01

Abstract:We are presently moving towards a distributed, wholly interconnected information environment, in which data items will be accessed from many locations that may be geographically distributed world-wide. In such an environment, data items are usually replicated, i.e., stored in local databases of multiple processors, for data access availability and its performance. Improper management of the replicated data may result in heavy network traffic, and lead to severe performance problems. Such a problem is especially significant in the mobile computing environments, in which the aerial bandwidth is limited, and wireless communication is much more costly than the cable wired network communication. In this thesis, several mathematical models for evaluating the network traffic involved with the replicated objects are presented. Convergence is introduced for evaluating the replicated data management algorithms of regular network traffic. Competitiveness is introduced for the worst case analysis. A stochastic method is introduced for the expected-case study. Meanwhile, I will present a couple of dynamic data replication algorithms, each of which is for different network architecture. I will compare the proposed algorithms with the traditional static management algorithm for the replicated data, analytically and experimentally. The analytical comparison is based on the above proposed measurements, and the experimental comparison is based on our simulation results.
A Dynamic and Static Combined Replication Management Mechanism Based on Frequency Adaptive.

Zhenli He,Hua Zhou,Long Hu,Junhui Liu,Lei Su

DOI: https://doi.org/10.1007/978-3-319-16050-4_11

2014-01-01

Abstract:In recent years, academia vigorous a research campaign about cloud computing since its rise, where replication management mechanism is one of its hotspot issue. More and more scholars pay attention to the redundant replica policy of cloud computing. That whether the replication management mechanism is good or not decides the experience of user, the expand ability of the system and the efficiency issue directly. In this paper, a series of static and dynamic replication management mechanism that have exist are discussed. In addition, on this basis a dynamic and static combined replication management mechanism based on frequency adaptive is proposed.

The Data Replication Scheme of Wide Web System

Grid Replication Coherence Protocol.

Research on Data Replica Distribution Pattern for Web Server Clusters

A Web Application Server Replication Scheme for Complex Transaction Patterns

An Excogitation for Efficient Replication of Distributed Databases

(Invited) Popularity-Based Content Replication Scheme for Wireless Mesh Network.

Rer: A Replica Efficiency Based Replication Strategy

An Efficient Distributed Load Balancing Scheme Based on Replicable Resource

Quality Driven Web Services Replication Using Directed Acyclic Graph Coding

An Optimal Replication Strategy for Data Grid Systems

A dynamic optimal replication strategy in data grid environment

A Kind of Data-Synchronous Software of Database under Internet Environment

GReplica: A Web-based Data Grid Replica Management System

Based on the Correlation of the File Dynamic Replication Strategy in Multi-Tier Data Grid

Research on Lazy Replication

Web-Based Distributed Data Communication Systems

A General Packet Replication Scheme for Multicasting in Interconnection Networks

Efficient and Adaptive Web Replication Using Content Clustering

The research of web-based data warehouse using XML

Dynamic Data Replication in Distributed Systems

A Dynamic and Static Combined Replication Management Mechanism Based on Frequency Adaptive.