Abstract:Nowadays, replication technique is widely used in data center storage systems for large scale Cyber-physical Systems (CPS) to prevent data loss. However, side-effect of replication is mainly the overhead of extra network and I/O traffics, which inevitably downgrades the overall I/O performance of the cluster. To effectively balance the trade-off between I/O performance and fault tolerance, in this paper, we propose a complete solution called “AutoReplica” — a replica manager in distributed caching and data processing systems with SSD-HDD tier storages. In detail, AutoReplica utilizes the remote SSDs (connected by high speed fibers) to replicate local SSD caches to protect data. In order to conduct load balancing among nodes and reduce the network overhead, we propose three approaches (i.e., ring, network, and multiple-SLA network) to automatically setup the cross-node replica structure with the consideration of network traffic, I/O speed and SLAs. To improve the performance during migrations triggered by load balance and failure recovery, we propose the a migrate-on-write technique called “fusion cache” to seamlessly migrate and prefetch among local and remote replicas without pausing the subsystem. Moreover, AutoReplica can also recover from different failure scenarios, while limits the performance downgrading degree. Lastly, AutoReplica supports parallel prefetching from multiple nodes with a new dynamic optimizing streaming technique to improve I/O performance. We are currently in the process of implementing AutoReplica to be easily plugged into commonly used distributed caching systems, and solidifying our design and implementation details.

Synchronous replication of remote storage

Construction of High-Performance SAN-Based Storage Network

Storage Virtualization Based Asynchronous Remote Mirror.

An Implementation of Storage-Based Synchronous Remote Mirroring for SANs

Distributed Storage Cluster Design for Remote Mirroring Based on Storage Area Network.

Design and implementation of a synchronous and asynchronous-based data replication technique in cloud computing

Using Co-Operative Iscsi Virtualization Managers For Remote Mirroring

Design of Asynchronous Remote Volume Replication System for Disaster-Recovery

AutoReplica: Automatic Data Replica Manager in Distributed Caching and Data Processing Systems

ReNIC: Architectural extension to SR-IOV I/O virtualization for efficient replication

Paratus: Instantaneous Failover Via Virtual Machine Replication

TH-VSS: an asymmetric storage virtualization system for the SAN environment

An IP Based Remote Data Sync Method

A Disaster Recovery Solution Based on Heterogeneous Storage

Design and Implementation of a Storage Virtualization System Based on SCSI Target Simulator in SAN

Asymmetric Virtual Machine Replication for Low Latency and High Available Service

MagicStore: a new out-of-band virtualization system in SAN environments

High Availability Through Output Continuity

Research on Storage Virtualization Technologies and Comparison

Optimizing Virtual Machine Live Storage Migration in Heterogeneous Storage Environment

A Mopso-Based Data Replication Strategy For Disaster Recovery