Abstract:Simultaneously incorporating deduplication as well as erasure coding is preferred for modern storage systems for the enhanced storage efficiency and economical data reliability. However, simple incorporation suffers from the "read imbalance problem", in which parallel data accesses are curbed by throttled storage nodes. This problem is due to the uneven data placement in the system, which is unaware of the employment of both deduplication and erasure coding, each of whom alters the order of data if unattended. This paper proposes a systematic design and implementation of a Dual-Aware(DA) placement in a combined storage system to achieve both deduplication-awareness and erasure-coding-awareness at the same time. DA not only records the node number of each unique data to allow for quick references with ease, but also dynamically tracks used nodes for each writes request. In this way, deduplication awareness is formed to skip inconvenient placement locations. Besides, DA serializes the placement of parity blocks with a stripe and across stripes. Such realization of erasure coding awareness ensures the separation of data and parity, as well as maintains data sequentiality at bordering stripes. Additionally, DA manages to extend with further load-balancing through an innovative use of the deduplication level, which intuitively predicts future accesses of a piece of data. In short, DA manages to boost system performance with little memory or computation cost. Extensive experiments using both real-world traces and synthesized workloads, prove DA achieves a better read performance. For example, DA respectively leads an average latency margin of 30.86% and 29.63%, over the baseline rolling placement(BA) and random placement(RA) under CAFTL traces over a default cluster of 12 nodes with RS(8,4).

RADPA Reliability-Aware Data Placement Algorithm for Large-Scale Network Storage Systems

An Optimized Learning-Based Directory Placement Policy with Two-Rounds Selection in Distributed File Systems

Explore Data Placement Algorithm for Balanced Recovery Load Distribution.

A Data Placement Scheme with Time-Related Model for P2P Storages

Design and implementation of a random data-placement system with high scalability, reliability and performance

Data Placement Algorithm for Improving I/O Load Balance Without Using Popularity Information

DA Placement: A Dual-Aware Data Placement in a Deduplicated and Erasure-Coded Storage System

An Efficient Hierarchical Data Placement Algorithm for Massive Spatial Data Storage Systems

Reliability Design for Large Scale Storage Systems

Even Data Placement For Load Balance In Reliable Distributed Deduplication Storage Systems

Probabilistic Region Failure-Aware Data Center Network and Content Placement.

Capability-aware Data Placement for Heterogeneous Active Storage Systems

Optimized Storage Placement over Large Scale Sensor Networks

An Adaptive Data Placement Architecture in Multicloud Environments.

Improving the data placement algorithm of randomization in SAN

Random Versus Copyset Placement: Data-Loss Models for Proactive-Tolerance Replica-Based Data Storage

Approach to Allocate Storage Space Dynamically in Network Storage System

A Study on Data Placement of Extensible Parallel Storage System

Evaluating Data Redistribution in PaRSEC

Reliability-Aware VNF Placement Using a Probability-Based Approach.

An Efficient File Assignment Strategy for Hybrid Parallel Storage System with Energy & Reliability Constraints