Abstract:Block storage provides virtual disks that can be mounted by virtual machines (VMs). Although erasure coding (EC) has been widely used in many cloud storage systems for its high efficiency and durability, current EC schemes cannot provide high-performance block storage for the cloud. This is because they introduce significant overhead to small write operations (which perform partial write to an entire EC group), whereas cloud-oblivious applications running on VMs are often small-write-intensive. We identify the root cause for the poor performance of partial writes in state-of-the-art EC schemes: for each partial write, they have to perform a time-consuming write-after-read operation that reads the current value of the data and then computes and writes the parity delta, which will be used to “patch” the parity in journal replay. In this article, we present a speculative partial write scheme (called PARIX) that supports fast small writes in erasure-coded storage systems. We transform the original formula of parity calculation to use the data deltas (between the current/original data values), instead of the parity deltas, to calculate the parities in journal replay. For each partial write, this allows PARIX to speculatively log only the new value of the data without reading its original value. For a series of n partial writes to the same data, PARIX performs pure write (instead of write-after-read) for the last n-1 ones while only introducing a small penalty of an extra network round-trip time to the first one. Based on PARIX, we design and implement PARIX Block Storage (PBS), an efficient block storage system that provides high-performance virtual disk service for VMs running cloud-oblivious applications. PBS not only supports fast partial writes but also realizes efficient full writes, background journal replay, and fast failure recovery with strong consistency guarantees. Both microbenchmarks and trace-driven evaluation show that PBS provides efficient block storage and outperforms state-of-the-art EC-based systems by orders of magnitude.

Burstable Cloud Block Storage with Data Processing Units.

Qos-Aware Indiscriminate Volume Storage Cloud

BM-Store: A Transparent and High-performance Local Storage Architecture for Bare-metal Clouds Enabling Large-scale Deployment

An In-Depth Comparative Analysis of Cloud Block Storage Workloads: Findings and Implications

On Optimizing Traffic Imbalance in Large-scale Block-based Cloud Storage: Trace Analysis and Algorithm Design

A Practical Cross-Datacenter Fault-Tolerance Algorithm in the Cloud Storage System.

A New Approach to Double I/O Performance for Ceph Distributed File System in Cloud Computing

BufferBank Storage: an Economic, Scalable and Universally Usable In-Network Storage Model for Streaming Data Applications

A Globally Shared Resource Paradigm for Encoded Storage Systems in the Public Cloud

PBS: An Efficient Erasure-Coded Block Storage System Based on Speculative Partial Writes

Dynamic Block-level Cache Management for Cloud Computing Systems

Atlas: Baidu's key-value storage system for cloud data

A New Block-Based Data Distribution Mechanism in Cloud Computing

Efficient SSD Cache for Cloud Block Storage via Leveraging Block Reuse Distances

Efficient Block Storage in the Cloud

MOBBS: A Multi-tiered Block Storage System for Virtual Machines Using Object-Based Storage

When Cloud Storage Meets RDMA.

Hybrid Block Storage for Efficient Cloud Volume Service

Performance Analysis of Mobile Cloud Computing With Bursty Demand: A Tandem Queue Model

A Moveable Beast: Partitioning Data and Compute for Computational Storage

CBPCS: A Cache-block-based Service Process Caching Strategy to Accelerate the Execution of Service Processes