Loc-K: A Spatial Locality-Based Memory Deduplication Scheme with Prediction on K-Step Locations

Shuaijie Jia,Chentao Wu,Jie Li

DOI: https://doi.org/10.1109/icpads.2017.00049

2017-01-01

Abstract:Memory deduplication is a technique to eliminate redundant data, save memory space and improve the performance of the whole system. There are several effective deduplication algorithms, which identify replicated data via comparing the content of different pages. However, although a few literatures utilize spatial locality to improve the efficiency of memory deduplication [1][2], they still have several limitations, such as low ratio of continuous distribution and high failure rate of prediction under unstable environments. To address these problems, in this paper, we design a new memory deduplication algorithm called “Loc-K”. On one hand, it utilizes logical addresses of different pages to ensure better continuity, which can gain better spatial locality. On the other hand, Loc-K predicts K potential duplication locations as the targets for page scanning, which improves the prediction hit ratio. Furthermore, Loc-K merges the duplicated pages directly to avoid regular searching routines. To demonstrate the effectiveness of our algorithm, we conduct several experimentations via implementation in Linux Kernel. The results show that, compared to the state-of-the-art memory deduplication algorithms, Loc-K increases the predictable opportunity by up to 97.8%, increases the prediction hit ratio by up to 96.5%, and reduces the duplication identification time by at least 34.3% respectively.