Abstract:To bridge the increasing processor-disk performance gap, buffer caches are used in both storage clients (e.g. database systems) and storage servers to reduce the number of slow disk accesses. These buffer caches need to be managed effectively to deliver the performance commensurate to the aggregate buffer cache size. To address this problem, two paradigms have been proposed recently to collaboratively manage these buffer caches together: the hierarchy-aware caching maintains the same I/O interface and is fully transparent to the storage client software, and the aggressively-collaborative caching trades off transparency for performance and requires changes to both the interface and the storage client software. Before storage industry starts to implement collaborative caching in real systems, it is crucial to find out whether sacrificing transparency is really worthwhile, i.e., how much can we gain by using the aggressively-collaborative caching instead of the hierarchy-aware caching? To accurately answer this question, it is required to consider all possible combinations of recently proposed local replacement algorithms and optimization techniques in both collaboration paradigms.Our study provides an empirical evaluation to address the above questions. Particularly, we have compared three aggressively-collaborative approaches with two hierarchy-aware approaches for four different types of database/file I/O workloads using traces collected from real commercial systems such as IBM DB2. More importantly, we separate the effects of collaborative caching from local replacement algorithms and optimizations, and uniformly apply several recently proposed local replacement algorithms and optimizations to all five collaboration approaches.When appropriate local optimizations and replacement algorithms are uniformly applied to both hierarchy-aware and aggressively-collaborative caching, the results indicate that hierarchy-aware caching can deliver similar performance as aggressively-collaborative caching. The results show that the aggressively-collaborative caching only provides less than 2.5% performance improvement on average in simulation and 1.0% in real system experiments over the hierarchy-aware caching for most workloads and cache configurations. Our sensitivity study indicates that the performance gain of aggressively-collaborative caching is also very small for various storage networks and different cache configurations. Therefore, considering its simplicity and generality, hierarchy-aware caching is more feasible than aggressively-collaborative caching.

Buffer management of high performance storage system

MG-Buffer - A Read/Write-Optimized Multi-Grained Buffer Management Scheme for Database Systems.

h-Buffer: an adaptive buffer management scheme for flash-based storage devices

An Approach to Buffering Data Efficiently in Distributed Storage Systems

Buffer Allocation Algorithms for Embedded Real-Time Streaming File System

A Cost-aware Buffer Management Policy for Flash-based Storage Devices

HFB: A page-block hybrid buffer manager for flash memory

Access-Pattern-Aware Personalized Buffer Management for Database Systems

Tl: A High Performance Buffer Replacement Strategy For Read-Write Splitting Web Applications

Study of database buffer management approaches: Towards the development of a data mining based strategy

Hotness-aware Buffer Management for Flash-Based Hybrid Storage Systems.

HAT: an Efficient Buffer Management Method for Flash-Based Hybrid Storage Systems

Evaluation and Performance Modeling of a Burst Buffer Solution

A Self-adaptive and Prediction-based I/O Performance Optimization Method

BufferBank Storage: an Economic, Scalable and Universally Usable In-Network Storage Model for Streaming Data Applications

Multi-Tier Buffer Management and Storage System Design for Non-Volatile Memory

Improving the Effective IO Throughput by Adaptive Read-Ahead Strategy for Private Cloud Storage Service

Buffer Strategy of Accessing Large Object Based on Stream Data

Amphisbaena: A Novel Persistent Buffer Management Strategy to Improve SMR Disk Performance

Empirical Evaluation of Multi-Level Buffer Cache Collaboration for Storage Systems

Cooperating Virtual Memory and Write Buffer Management for Flash-Based Storage Systems