Abstract:Big Data has brought great challenges to traditional DBMS. Nearly all the Big Data management systems choose to handle Big Data by partitioning it according to some specific attributes and distributing the partitioned data in cluster. However, when data relationships and query requirements are exceedingly complex, it is difficult to decide which attributes should be chosen to partition data, because a data table can only be partitioned in exactly one specific way while different query requirements may need different partition plans which are in conflicts with each other. In the same time, replication is a common approach to obtain high fault tolerance. Consequently, it is a reasonable way to improve system performance by using multiple replicas to resolve partition conflicts.; AB@In this paper we analyzed the reasons of contradictions and presented a method to identify and resolve them. Our method first classifies queries into different categories by their requirements, and then uses partition algorithm to search the optimal partition plan for each query category. By introducing a two-tier server architecture, we could make more effective use of these replicas. TPC-E and TPC-H are chosen to evaluate our method, the evaluation results demonstrate that our method could improve system performance by up to 4x over single partition plan method.

Design and Implementation of Multiple Database Disaster Tolerance System

Realization of disaster backup of infectious disease net reporting system in Chinese Center for Disease Control and Prevention

Design and Implementation of China CDC Data Disaster Tolerance System

Design and Realization of University Database Emergency Response System

Architecture Design of Wide-area Distributed Real-time Database in Grid Dispatching Control System

Discussion on Construction Mode of Distributed and Autonomous Region-County Integration Dispatching Automation System

A Method of Real-Time Data Acquisition and Exchange in Adaptation to Integrated Dispatching Automation System

IMPLEMENT DATA SHARING OVER NETWORK HETEROGENEOUS DATABASES BY DATA DIMENSION REDUCTION METHOD

Design of Asynchronous Remote Volume Replication System for Disaster-Recovery

Study on Virtualization-based Backup System Model for Disaster Recovery

Multi-database Middleware System Based on SEDA

Heterogeneous Data Backup Against Early Warning Disasters in Geo-Distributed Data Center Networks

Structure-independent Disaster Recovery： Concept, Architecture and Implementations

Backup and Disaster Recovery System for HDFS

Research on Fault Tolerance in Hybrid P2P-based Collaborative Systems

Design and Implementation of XML-based GUI for Cross Platform Backup System

Coexistence of Multiple Partition Plan Based Physical Database Design.

A Practical Cross-Datacenter Fault-Tolerance Algorithm in the Cloud Storage System.

To Realize Data Exchange Among Multiple Systems

Online Incremental Backup in OSCAR Engineering DBMS

Construction of Remote Disaster Recovery System with Virtualized Storage