Abstract:Disaggregated memory is a promising approach that addresses the limitations of traditional memory architectures by enabling memory to be decoupled from compute nodes and shared across a data center. Cloud platforms have deployed such systems to improve overall system memory utilization, but performance can vary across workloads. High-performance computing (HPC) is crucial in scientific and engineering applications, where HPC machines also face the issue of underutilized memory. As a result, improving system memory utilization while understanding workload performance is essential for HPC operators. Therefore, learning the potential of a disaggregated memory system before deployment is a critical step. This paper proposes a methodology for exploring the design space of a disaggregated memory system. It incorporates key metrics that affect performance on disaggregated memory systems: memory capacity, local and remote memory access ratio, injection bandwidth, and bisection bandwidth, providing an intuitive approach to guide machine configurations based on technology trends and workload characteristics. We apply our methodology to analyze thirteen diverse workloads, including AI training, data analysis, genomics, protein, fusion, atomic nuclei, and traditional HPC bookends. Our methodology demonstrates the ability to comprehend the potential and pitfalls of a disaggregated memory system and provides motivation for machine configurations. Our results show that eleven of our thirteen applications can leverage injection bandwidth disaggregated memory without affecting performance, while one pays a rack bisection bandwidth penalty and two pay the system-wide bisection bandwidth penalty. In addition, we also show that intra-rack memory disaggregation would meet the application's memory requirement and provide enough remote memory bandwidth.

HPCC: a Memory Access Model Oriented Benchmark--a Potential Test Method to Replace HPL in TOP500

AHPCC: A High Performance Computer System Evaluation Model Based on HPCC and Analytic Hierarchy Process

P F ] 1 3 A ug 2 01 9 HPC AI 500 : A Benchmark Suite for HPC AI Systems

HPC AI500: A Benchmark Suite for HPC AI Systems

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Shuhai: A Tool for Benchmarking High Bandwidth Memory on FPGAs

Optimization of Computation-Intensive Applications in cc-NUMA Architecture

Understanding HPC Benchmark Performance on Intel Broadwell and Cascade Lake Processors

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

Exploring Application Performance on Emerging Hybrid-Memory Supercomputers

Analyzing & modeling the performance in Xen-based virtual cluster environment

Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory

Exploring the Performance Benefit of Hybrid Memory System on HPC Environments

HAM: Hotspot-Aware Manager for Improving Communications With 3D-Stacked Memory

An Analysis on Communication Mechanisms for HPC

First Experiences in Performance Benchmarking with the New SPEChpc 2021 Suites

PHPC:a spreading kind of high performance computer

HPIS3: towards a high-performance simulator for hybrid parallel I/O and storage systems

Conceptual and Technical Challenges for High Performance Computing

Test of the MPCore cache bandwidthand considerations for efficient software execution