Abstract:The semantics of HPC storage systems are defined by the consistency models to which they abide. Storage consistency models have been less studied than their counterparts in memory systems, with the exception of the POSIX standard and its strict consistency model. The use of POSIX consistency imposes a performance penalty that becomes more significant as the scale of parallel file systems increases and the access time to storage devices, such as node-local solid storage devices, decreases. While some efforts have been made to adopt relaxed storage consistency models, these models are often defined informally and ambiguously as by-products of a particular implementation. In this work, we establish a connection between memory consistency models and storage consistency models and revisit the key design choices of storage consistency models from a high-level perspective. Further, we propose a formal and unified framework for defining storage consistency models and a layered implementation that can be used to easily evaluate their relative performance for different I/O workloads. Finally, we conduct a comprehensive performance comparison of two relaxed consistency models on a range of commonly seen parallel I/O workloads, such as checkpoint/restart of scientific applications and random reads of deep learning applications. We demonstrate that for certain I/O scenarios, a weaker consistency model can significantly improve the I/O performance. For instance, in small random reads that are typically found in deep learning applications, session consistency achieved a 5x improvement in I/O bandwidth compared to commit consistency, even at small scales.

PROAR: A Weak Consistency Model for Ceph.

ASSER: an Efficient, Reliable, and Cost-Effective Storage Scheme for Object-Based Cloud Storage Systems

Probabilistically-Atomic 2-Atomicity: Enabling Almost Strong Consistency in Distributed Storage Systems

New Replica Consistency Management Algorithm in Structured P2P Systems

Almost Strong Consistency: "Good Enough" in Distributed Storage Systems

TC-Release++: an Efficient Timestamp-Based Coherence Protocol for Many-Core Architectures.

Formal Definitions and Performance Comparison of Consistency Models for Parallel File Systems

Analysis for REPERA

A novel replication consistency maintenance strategy in cloud storage system

An Adaptive Replication Algorithm in Overlay Networking

Achieving Probabilistic Atomicity with Well-Bounded Staleness and Low Read Latency in Distributed Datastores

Acb-R: An Adaptive Clustering-Based Data Replication Algorithm On A P2p Data-Store

Consistent Hash Based Flexible Redundant Data Partition Strategy

How Hard is Asynchronous Weight Reassignment? (Extended Version)

ICCG: low-cost and efficient consistency with adaptive synchronization for metadata replication

Adaptive replica consistency mechanism for cloud storage

Harmonia: Near-Linear Scalability for Replicated Storage with In-Network Conflict Detection

An Application-Based Adaptive Replica Consistency for Cloud Storage

ARP: an Adaptive Replication Policy in Tiled Chip Multiprocessor

Exploiting Commutativity For Practical Fast Replication