Abstract:Disaggregated memory is a promising approach that addresses the limitations of traditional memory architectures by enabling memory to be decoupled from compute nodes and shared across a data center. Cloud platforms have deployed such systems to improve overall system memory utilization, but performance can vary across workloads. High-performance computing (HPC) is crucial in scientific and engineering applications, where HPC machines also face the issue of underutilized memory. As a result, improving system memory utilization while understanding workload performance is essential for HPC operators. Therefore, learning the potential of a disaggregated memory system before deployment is a critical step. This paper proposes a methodology for exploring the design space of a disaggregated memory system. It incorporates key metrics that affect performance on disaggregated memory systems: memory capacity, local and remote memory access ratio, injection bandwidth, and bisection bandwidth, providing an intuitive approach to guide machine configurations based on technology trends and workload characteristics. We apply our methodology to analyze thirteen diverse workloads, including AI training, data analysis, genomics, protein, fusion, atomic nuclei, and traditional HPC bookends. Our methodology demonstrates the ability to comprehend the potential and pitfalls of a disaggregated memory system and provides motivation for machine configurations. Our results show that eleven of our thirteen applications can leverage injection bandwidth disaggregated memory without affecting performance, while one pays a rack bisection bandwidth penalty and two pay the system-wide bisection bandwidth penalty. In addition, we also show that intra-rack memory disaggregation would meet the application's memory requirement and provide enough remote memory bandwidth.

Shared Memory Based Embedded Cluster Model with High Scalability

Evaluation and Design Trade-Offs Between Symmetric Shared-Memory and Distributed Shared-Memory

An Efficient Shared Memory Based Virtual Communication System for Embedded SMP Cluster

A Way to Improve the Performance of Integrated Real-Time Monitoring System in Power Grid by Distributed Shared Memory Technology

SEMMA: Secure Efficient Memory Management Approach in Virtual Environment.

Implementation and Evaluation of MPI+OpenMP Programming Model on Dawning3000.

Energy-Efficient Hardware-Accelerated Synchronization for Shared-L1-Memory Multiprocessor Clusters

Network caching for Chip Multiprocessors

A Study on Cache Mechanism in Heterogeneous Memory System

Partial Failure Resilient Memory Management System for (Cxl-Based) Distributed Shared Memory

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors

Direct Distributed Memory Access for CMPs

A Scalable Memory Management Service Based on Microkernel OS in Multicore Environment

Efficient Distributed Memory Management with RDMA and Caching

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

An 800mhz 320mw 16-Core Processor with Message-Passing and Shared-Memory Inter-Core Communication Mechanisms

JArena: Partitioned Shared Memory for NUMA-awareness in Multi-threaded Scientific Applications

Distributed Memory Management Units Architecture for NoC-based CMPs

An Energy-Efficient Heterogeneous Memory Architecture for Future Dark Silicon Embedded Chip-Multiprocessors