Abstract:In today's data centers, memory-based key-value systems, such as Memcached and Redis, play an indispensable role in providing high-speed data services. The rapidly growing capacity and quickly falling price of DRAM memory in the past years have enabled us to create a large memory-based key-value store, which is able to serve hundreds of Gigabytes to even Terabytes of key-value data all in memory. Unfortunately, CPU cache in modern processors has not seen a similar growth in capacity, still remaining at the level of a few dozens of Megabytes. Such an extremely low cache-to-memory ratio (less than 0.1%) poses a significant new challenge---the limited CPU cache is becoming a severe performance bottleneck that hinders us from fully exploiting the great potential of high-speed memory-based key-value stores. To address this critical challenge, we propose a highly cache-efficient scheme, called Cavast , to optimize the cache utilization of large-capacity in-memory key-value stores. Our goal is to maximize cache efficiency and system performance without any hardware changes. We first present two light-weight, software-only mechanisms to enable user to indirectly control the cache content at application level. Then we propose a set of optimization policies to address several critical design issues that impair cache's efficacy in the current key-value store systems. By carefully reorganizing the data layout in memory, redesigning the hash indexing structure, and offloading garbage collection, we can effectively improve the utilization of the limited cache space. We have developed a module in Linux as a kernel-level support, and implemented two prototypes based on Memcached and Redis with the proposed Cavast scheme. Our experimental studies show promising results. On a 6-core Intel Xeon processor with only 15-MB cache, we can raise the cache hit ratio up to 82.7% with a very small cache-to-memory ratio (0.023%), and significantly increase the key-value system throughput by a factor of up to 4.2.

Minimizing Energy Consumption for Embedded Multicore Systems Using Cache Configuration and Task Mapping

Task Mapping with Cache Reconfiguration and Partitioning for Energy Minimization on Real-Time Multicores

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Worst-case Energy Consumption Minimization Based on Interference Analysis and Bank Mapping in Multicore Systems

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

A Cache-Coloring Based Technique for Saving Leakage Energy In Multitasking Systems

Tasks mapping in multi-core based system: hybrid ACO&GA approach

Energy-Oriented Dynamic SPM Allocation Based on Time-Slotted Cache Conflict Graph

Co-Optimizing Cache Partitioning and Multi-Core Task Scheduling: Exploit Cache Sensitivity or Not?

Study on the Low Power Cache Design Technique

Analysis of Energy Consumption Optimization for Shared Cache Conflicts

Multi-objective optimization of energy consumption and execution time in a single level cache memory for embedded systems

Access Adaptive and Thread-Aware Cache Partitioning in Multicore Systems

Put an Elephant into a Fridge

WCET-Aware Task Assignment and Cache Partitioning for WCRT Minimization on Multi-core Systems

A Way Memoization Technique for Reducing Power Consumption of Caches in Application Specific Integrated Processors

THE DESIGN OF A LOW POWER DYNAMICALLY RECONFIGURABLE CACHE

A Novel Energy-Aware Multi-Task Dynamic Mapping Heuristic of NoC-based MPSoCs

Energy Optimization of Memory Intensive Parallel workloads

Shared cache aware task mapping for WCRT minimization

Cache Hierarchy Optimization