Abstract:Flash-based Solid State Drive (SSD) is widely used in the virtualization environment, usually as the cache of the hard disk drive-based Virtual Machine (VM) storage, to improve the IO performance. Existing SSD caching schemes are mainly driven by VM-centric metrics. They treat the VMs as independent units and focus on critical low-level performance metrics of individual VMs, such as the working set, the IO latency, or the throughput. However, for elastic Hadoop applications consisting of multiple VMs, the workload is rapidly changing, and the importance of differnet VMs may be different even if they have the same low-level IO pattern. In this situation, the VM-centric SSD caching schemes may not lead to the best performance, i.e., the shortest job completion time. Considering the importance of VMs and relationships among VMs inside the application may potentially better improve the performance, which we regard as the application-centric metrics. We propose the Application-Centric SSD caching for Hadoop applications (ACSSD), which reduces the job completion time from the application level. AC-SSD uses the genetic algorithm based approach to calculate the nearly optimal weights of virtual machines for allocating SSD cache space and controlling the I/O Operations Per Second (IOPS) based on the importance of the VMs. Moreover, AC-SSD introduces the closed-loop adaptation to face the rapidly changing workload. The evaluation shows that AC-SSD reduces the job completion time by up to 39% for IO sensitive workloads, and up to 29% for rapidly changing workloads.

Adaptive Data Reduction Scheme for SSD-based Host-side Caches in VDI Storage

PLC-cache: Endurable SSD Cache for Deduplication-Based Primary Storage

Endurable SSD-Based Read Cache for Improving the Performance of Selective Restore from Deduplication Systems

A Duplication-Aware SSD-Based Cache Architecture for Primary Storage in Virtualization Environment

Fusion-Cache: A Refactored Content-Aware Host-Side SSD Cache.

DASH: A duplication-aware flash cache architecture in virtualization environment

A Delayed Container Organization Approach to Improve Restore Speed for Deduplication Systems.

Reinforcement Learning Based Data Compression for Energy-Efficient Non-volatile Caches.

Flash Saver: Save the Flash-Based Solid State Drives Through Deduplication and Delta-encoding.

ETD-Cache

Cache eviction for SSD-HDD hybrid storage based on sequential packing

AMC: an Adaptive Multi‐level Cache Algorithm in Hybrid Storage Systems

Efficient and Consistent NVMM Cache for SSD-Based File System

Active Ssd Design For Energy-Efficiency Improvement Of Web-Scale Data Analysis

IMPROVING INTERACTIVE PERFORMANCE FOR DESKTOP VIRTUAL MACHINES BASED ON SOLID-STATE DISK CACHE

Application-centric SSD Cache Allocation for Hadoop Applications.

An Approach to Buffering Data Efficiently in Distributed Storage Systems

SSDC: A Split Data Cache Design for Sequential Access Intensive Applications

IO Dependent SSD Cache Allocation for Elastic Hadoop Applications

Small File Read Performance Optimization Based on Redis Cache in Distributed Storage System

S4D-Cache: Smart Selective SSD Cache for Parallel I/O Systems