Abstract:In today's data centers, memory-based key-value systems, such as Memcached and Redis, play an indispensable role in providing high-speed data services. The rapidly growing capacity and quickly falling price of DRAM memory in the past years have enabled us to create a large memory-based key-value store, which is able to serve hundreds of Gigabytes to even Terabytes of key-value data all in memory. Unfortunately, CPU cache in modern processors has not seen a similar growth in capacity, still remaining at the level of a few dozens of Megabytes. Such an extremely low cache-to-memory ratio (less than 0.1%) poses a significant new challenge---the limited CPU cache is becoming a severe performance bottleneck that hinders us from fully exploiting the great potential of high-speed memory-based key-value stores. To address this critical challenge, we propose a highly cache-efficient scheme, called Cavast , to optimize the cache utilization of large-capacity in-memory key-value stores. Our goal is to maximize cache efficiency and system performance without any hardware changes. We first present two light-weight, software-only mechanisms to enable user to indirectly control the cache content at application level. Then we propose a set of optimization policies to address several critical design issues that impair cache's efficacy in the current key-value store systems. By carefully reorganizing the data layout in memory, redesigning the hash indexing structure, and offloading garbage collection, we can effectively improve the utilization of the limited cache space. We have developed a module in Linux as a kernel-level support, and implemented two prototypes based on Memcached and Redis with the proposed Cavast scheme. Our experimental studies show promising results. On a 6-core Intel Xeon processor with only 15-MB cache, we can raise the cache hit ratio up to 82.7% with a very small cache-to-memory ratio (0.023%), and significantly increase the key-value system throughput by a factor of up to 4.2.

A Lightweight Memory Encryption Cache Design and Implementation for Embedded Processor

Encryption scheme design and implementation of embedded processor off-chip memory access

Put an Elephant into a Fridge

Low-latency DAE: A Configurable Lightweight Hybrid Data and Address Encryption Engine for IoT Real-time NVM Protection

Low power cache architecture with security mechanism

A Reconfigurable Permutation Based Address Encryption Architecture for Memory Security

MIPE: a Practical Memory Integrity Protection Method in a Trusted Execution Environment.

Protecting In-memory Data Cache with Secure Enclaves in Untrusted Cloud.

Efficient In-Memory AES Encryption Implementation Using a General Memristive Logic: Surmounting the Data Movement Bottleneck.

Architecture Support for Memory Confidentiality and Integrity in Embedded Systems

An efficient run-time encryption scheme for non-volatile main memory

A Low-Cost Cryptographic Processor for Security Embedded System

Embedding Security into Ferroelectric FET Array via In-Situ Memory Operation

Cryptographie Coprocessor Design for IoT Sensor Nodes.

Low-Latency PAE: Permutation-Based Address Encryption Hardware Engine for IoT Real-Time Memory Protection

Impact of Memory Hierarchy on Memory Encryption Performance

Embedding security into ferroelectric FET array via in situ memory operation

FEDTIC: A Security Design for Embedded Systems with Insecure External Memory

Dynamic encryption key design and management for memory data encryption in embedded systems

High-Efficiency Parallel Cryptographic Accelerator for Real-Time Guaranteeing Dynamic Data Security in Embedded Systems

High performance and energy-efficient in-memory computing architecture based on SOT-MRAM