Abstract:Currently, HPC storage systems still use hard disk drive (HDD) as their dominant storage device. Solid state drive (SSD) is widely deployed as the buffer to HDDs. Burst buffer has also been proposed to manage the SSD buffering of bursty write requests. Although burst buffer can improve I/O performance in many cases, we find that it has some limitations such as requiring large SSD capacity and harmonious overlapping between computation phase and data flushing phase. In this article, we propose a scheme, called SSDUP+.1 SSDUP+ aims to improve the burst buffer by addressing the above limitations. First, to reduce the demand for the SSD capacity, we develop a novel method to detect and quantify the data randomness in the write traffic. Further, an adaptive algorithm is proposed to classify the random writes dynamically. By doing so, much less SSD capacity is required to achieve the similar performance as other burst buffer schemes. Next, to overcome the difficulty of perfectly overlapping the computation phase and the flushing phase, we propose a pipeline mechanism for the SSD buffer, in which data buffering and flushing are performed in pipeline. In addition, to improve the I/O throughput, we adopt a traffic-aware flushing strategy to reduce the I/O interference in HDD. Finally, to further improve the performance of buffering random writes in SSD, SSDUP+ transforms the random writes to sequential writes in SSD by storing the data with a log structure. Further, SSDUP+ uses the AVL tree structure to store the sequence information of the data. We have implemented a prototype of SSDUP+ based on OrangeFS and conducted extensive experiments. The experimental results show that our proposed SSDUP+ can save an average of 50% SSD space while delivering almost the same performance as other common burst buffer schemes. In addition, SSDUP+ can save about 20% SSD space compared with the previous version of this work, SSDUP, while achieving 20–30% higher I/O throughput than SSDUP.

SSDUP: a traffic-aware ssd burst buffer for HPC systems.

Optimizing the SSD Burst Buffer by Traffic Detection

SSDUP: an Efficient SSD Write Buffer Using Pipeline

A Popularity-Aware Buffer Management to Improve Buffer Hit Ratio and Write Sequentiality for Solid-State Drive

Prober: Exploiting Sequential Characteristics in Buffer for Improving SSDs Write Performance

Exploration and Exploitation for Buffer-Controlled HDD-Writes for SSD-HDD Hybrid Storage Server

HB-Storage: Optimizing SSDs with a HDD Write Buffer

CBM: A Cooperative Buffer Management for SSD

Reorder Write Sequence by Hetero-Buffer to Extend SSD's Lifespan.

Efficient Buffer Management for Tree Indexes on Solid State Drives

Pab: Parallelism-Aware Buffer Management Scheme for Nand-Based Ssds

RS-Wrapper: random write optimization for solid state drive.

h-Buffer: an adaptive buffer management scheme for flash-based storage devices

ConeSSD: A Novel Policy to Optimize the Performance of HDFS Heterogeneous Storage.

An Approach to Buffering Data Efficiently in Distributed Storage Systems

BPCLC: an Efficient Write Buffer Management Scheme for Flash-Based Solid State Disks.

Improving the SSD Performance by Exploiting Request Characteristics and Internal Parallelism

Access Characteristic Guided Partition for Nand Flash-Based High-Density SSDs

HAT: an Efficient Buffer Management Method for Flash-Based Hybrid Storage Systems

Hotness-aware Buffer Management for Flash-Based Hybrid Storage Systems.

DRC:A Dynamic-replacement-cost-based Algorithm For SSD/HDD Storage System