Abstract:AbstractRound-robin striping, due to its uniform distribution and low-complexity computation, is widely used by applications which demand high bandwidth and massive storage. Because many systems are nonstoppable when their storage capacity and I/O bandwidth need increasing, an efficient and online mechanism to add more disks to striped volumes is very important. In this article, it is presented and proved that during data redistribution caused by scaling a round-robin striped volume, there is always a reordering window where data consistency can be maintained while changing the order of data movements. Furthermore, by exploiting the reordering window characteristic, SLAS is proposed to scale round-robin striped volumes, which reduces the cost of data redistribution effectively. First, SLAS applies a new mapping management solution based on a sliding window to support data redistribution without loss of scalability; second, it uses lazy updates of mapping metadata to decrease the number of metadata writes required by data redistribution; third, it changes the order of data chunk movements to aggregate reads/writes of data chunks. Our results from detailed simulations using real-system workloads show that, compared with the traditional approach, SLAS can reduce redistribution duration by up to 40.79% with similar maximum response time of foreground I/Os. Finally, our discussion indicates that the SLAS approach works for both disk addition and disk removal to/from striped volumes.

A New File-Specific Stripe Size Selection Method for Highly Concurrent Data Access

A Study on Data Placement of Extensible Parallel Storage System

Evaluating Dynamic File Striping For Lustre

An Efficient File Assignment Strategy for Hybrid Parallel Storage System with Energy & Reliability Constraints

SLAS: An efficient approach to scaling round-robin striped volumes

STFS: a novel file system for efficient small writes

A cost-aware region-level data placement scheme for hybrid parallel I/O systems

A2FL: Autonomous and Adaptive File Layout in HPC through Real-time Access Pattern Analysis

Efficient File Accessing Techniques on Hadoop Distributed File Systems.

Towards Efficient Concurrent Scans on Flash Disks.

Mitigating Synchronous I/O Overhead in File Systems on Open-Channel SSDs

Toward Comprehensive and Accurate Simulation Performance Prediction of Parallel File Systems

A Highly Efficient FC-SAN Based on Load Stream

Improving Performance of Parallel I/O Systems Through Selective and Layout-Aware SSD Cache

Efficient Scheduling with Intensive In-Memory File Accesses Considering Bandwidth Constraint on Memory Bus.

File System Implementation Method to Improve the Network Storage Performance

Design and Implementation of an Asymmetric Block-Based Parallel File System

A Connectivity Reduction Based Optimization Method for Task Level Parallel File System

Imfssc: An In-Memory Distributed File System Framework For Super Computing

Design and Evaluation of a New Approach to RAID-0 Scaling

Optimizing File Systems on Heterogeneous Memory by Integrating DRAM Cache with Virtual Memory Management.