Abstract:As the data volume continues to grow exponentially, there is an increasing demand for large storage system capacity. Data compression techniques effectively reduce the volume of written data, enhancing space efficiency. As a result, many modern SSDs have already incorporated data compression capabilities. However, data compression introduces additional processing overhead in critical I/O paths, potentially affecting system performance. Currently, most compression solutions in flash-based storage systems employ fixed compression algorithms for all incoming data without leveraging differences among various data access patterns. This leads to sub-optimal compression efficiency. This paper proposes a data-type-aware Flash Translation Layer (DAFTL) scheme to maximize space efficiency without compromising system performance. First, we propose an I/O behavior prediction method to forecast future access on specific data. Then, DAFTL matches data types with distinct I/O behaviors to compression algorithms of varying intensities, achieving an optimal balance between performance and space efficiency. Specifically, it employs higher-intensity compression algorithms for less frequently accessed data to maximize space efficiency. For frequently accessed data, it utilizes lower-intensity but faster compression algorithms to maintain system performance. Finally, an improved compact compression method is proposed to effectively eliminate page fragmentation and further enhance space efficiency. Extensive evaluations using a variety of real-world workloads, as well as the workloads with real data we collected on our platforms, demonstrate that DAFTL achieves more data reductions than other approaches. When compared to the state-of-the-art compression schemes, DAFTL reduces the total number of pages written to the SSD by an average of 8%, 21.3%, and 25.6% for data with high, medium, and low compressibility, respectively. In the case of workloads with real data, DAFTL achieves an average reduction of 10.4% in the total number of pages written to SSD. Furthermore, DAFTL exhibits comparable or even improved read and write performance compared to other solutions.

Towards Higher Efficiency in a Distributed Memory Storage System Using Data Compression

Improving the I/O Throughput for Data-Intensive Scientific Applications with Efficient Compression Mechanisms

Data Acquisiton and Storage S ystem Based on Online Compression

Extremely-Compressed SSDs with I/O Behavior Prediction

A self-aware data compression system on FPGA in Hadoop

Integrating Online Compression to Accelerate Large-Scale Data Analytics Applications

CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases

IC-Data: Improving Compressed Data Processing in Hadoop.

A Versatile Compression Method for Floating-Point Data Stream

EDC: Improving the Performance and Space Efficiency of Flash-Based Storage Systems with Elastic Data Compression

Compressed Data Direct Computing for Databases

Performance Optimization of In-Memory File System in Distributed Storage System

Improving In-Memory File System Reading Performance by Fine-Grained User-Space Cache Mechanisms

Improving I/O Throughput of Scientific Applications Using Transparent Parallel Compression

Practical Data Compression for Modern Memory Hierarchies

Memory-Based High-Performance Optimization for High Concurrent Data-Intensive Problems

ZipCache: A DRAM/SSD Cache with Built-in Transparent Compression

DEC: An Efficient Deduplication-Enhanced Compression Approach

Virtual chunks: On supporting random accesses to scientific data in compressible storage systems

Evaluating Memory Compression and Deduplication

Leveraging Page-Level Compression In Mysql -A Practice At Baidu