Abstract:Disaggregated memory is a promising approach that addresses the limitations of traditional memory architectures by enabling memory to be decoupled from compute nodes and shared across a data center. Cloud platforms have deployed such systems to improve overall system memory utilization, but performance can vary across workloads. High-performance computing (HPC) is crucial in scientific and engineering applications, where HPC machines also face the issue of underutilized memory. As a result, improving system memory utilization while understanding workload performance is essential for HPC operators. Therefore, learning the potential of a disaggregated memory system before deployment is a critical step. This paper proposes a methodology for exploring the design space of a disaggregated memory system. It incorporates key metrics that affect performance on disaggregated memory systems: memory capacity, local and remote memory access ratio, injection bandwidth, and bisection bandwidth, providing an intuitive approach to guide machine configurations based on technology trends and workload characteristics. We apply our methodology to analyze thirteen diverse workloads, including AI training, data analysis, genomics, protein, fusion, atomic nuclei, and traditional HPC bookends. Our methodology demonstrates the ability to comprehend the potential and pitfalls of a disaggregated memory system and provides motivation for machine configurations. Our results show that eleven of our thirteen applications can leverage injection bandwidth disaggregated memory without affecting performance, while one pays a rack bisection bandwidth penalty and two pay the system-wide bisection bandwidth penalty. In addition, we also show that intra-rack memory disaggregation would meet the application's memory requirement and provide enough remote memory bandwidth.

MONet: heterogeneous Memory over Optical Network for large-scale data center resource disaggregation

Demonstration of Optically Connected Disaggregated Memory with Hitless Wavelength-Selective Switch

A Physical-Aware Framework for Memory Network Design Space Exploration

MIND: In-Network Memory Management for Disaggregated Data Centers

Design and Evaluation of a Rack-Scale Disaggregated Memory Architecture For Data Centers

DaeMon: Architectural Support for Efficient Data Movement in Disaggregated Systems

Disaggregated Memory with SmartNIC Offloading: a Case Study on Graph Processing

CXL over Ethernet: A Novel FPGA-based Memory Disaggregation Design in Data Centers

MMTD Net -A Novel Optical Circuit Switch Architecture for Data Center Networks

Megalloc: Fast Distributed Memory Allocator for NVM-Based Cluster

Network-aware compute and memory allocation in optically composable data centers with deep reinforcement learning and graph neural networks

High-Throughput Optoelectronic Interconnect for Holographic Memory Devices

SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

LumosCore: Highly Scalable LLM Clusters with Optical Interconnect

Disaggregated Memory at the Edge

Ohm-GPU: Integrating New Optical Network and Heterogeneous Memory into GPU Multi-Processors

EDM: An Ultra-Low Latency Ethernet Fabric for Memory Disaggregation

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

NOM: Network-On-Memory for Inter-Bank Data Transfer in Highly-Banked Memories

Monarch: A Durable Polymorphic Memory For Data Intensive Applications

Memory Sharing for Handling Memory Overload on Physical Machines in Cloud Data Centers.