Abstract:High-performance flash-based key-value stores in data-centers utilize large amounts of DRAM to cache hot data. However, motivated by the high cost and power consumption of DRAM, server designs with lower DRAM-per-compute ratio are becoming popular. These low-cost servers enable scale-out services by reducing server workload densities. This results in improvements to overall service reliability, leading to a decrease in the total cost of ownership (TCO) for scalable workloads. Nevertheless, for key-value stores with large memory footprints, these reduced DRAM servers degrade performance due to an increase in both IO utilization and data access latency. In this scenario, a standard practice to improve performance for sharded databases is to reduce the number of shards per machine, which degrades the TCO benefits of reduced DRAM low-cost servers. In this work, we explore a practical solution to improve performance and reduce the costs and power consumption of key-value stores running on DRAM-constrained servers by using Storage Class Memories (SCM). SCMs in a DIMM form factor, although slower than DRAM, are sufficiently faster than flash when serving as a large extension to DRAM. With new technologies like Compute Express Link, we can expand the memory capacity of servers with high bandwidth and low latency connectivity with SCM. In this article, we use Intel Optane PMem 100 Series SCMs (DCPMM) in AppDirect mode to extend the available memory of our existing single-socket platform deployment of RocksDB (one of the largest key-value stores at Meta). We first designed a hybrid cache in RocksDB to harness both DRAM and SCM hierarchically. We then characterized the performance of the hybrid cache for three of the largest RocksDB use cases at Meta (ChatApp, BLOB Metadata, and Hive Cache). Our results demonstrate that we can achieve up to 80% improvement in throughput and 20% improvement in P95 latency over the existing small DRAM single-socket platform, while maintaining a 43–48% cost improvement over our large DRAM dual-socket platform. To the best of our knowledge, this is the first study of the DCPMM platform in a commercial data center.

Optimizing the Cray Graph Engine for performant analytics on cluster, SuperDome Flex, Shasta systems and cloud deployment

Running Alchemist on Cray XC and CS Series Supercomputers: Dask and PySpark Interfaces, Deployment Options, and Data Transfer Times

Grapher: A Reconfigurable Graph Computing Accelerator with Optimized Processing Elements

Effective use of the PGAS Paradigm: Driving Transformations and Self-Adaptive Behavior in DASH-Applications

Power-optimized Deployment of Key-value Stores Using Storage Class Memory

Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs

Efficient Distributed Memory Management with RDMA and Caching

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor

Towards a Scalable and Efficient PGAS-based Distributed OpenMP

GRE: A Graph Runtime Engine for Large-Scale Distributed Graph-Parallel Applications.

Optimizing Multi-Grid Preconditioned Conjugate Gradient Method on Multi-Cores

Improving Performance of Flash Based Key-Value Stores Using Storage Class Memory As a Volatile Memory Extension

TEGRA -- Scaling Up Terascale Graph Processing with Disaggregated Computing

A Coarse-Grained Reconfigurable Architecture for Compute-Intensive MapReduce Acceleration

Exploiting the Performance Benefits of Storage Class Memory for HPC and HPDA Workflows

An Architecture-Agnostic Dataflow Mapping Framework on CGRA

Exploiting Inter-Operation Data Reuse in Scientific Applications using GOGETA

Taming the Zoo: The Unified GraphIt Compiler Framework for Novel Architectures

Flip: Data-Centric Edge CGRA Accelerator

Automated Design Space Exploration of CGRA Processing Element Architectures using Frequent Subgraph Analysis

Proxy-Guided Load Balancing of Graph Processing Workloads on Heterogeneous Clusters