Abstract:Disaggregated memory is a promising approach that addresses the limitations of traditional memory architectures by enabling memory to be decoupled from compute nodes and shared across a data center. Cloud platforms have deployed such systems to improve overall system memory utilization, but performance can vary across workloads. High-performance computing (HPC) is crucial in scientific and engineering applications, where HPC machines also face the issue of underutilized memory. As a result, improving system memory utilization while understanding workload performance is essential for HPC operators. Therefore, learning the potential of a disaggregated memory system before deployment is a critical step. This paper proposes a methodology for exploring the design space of a disaggregated memory system. It incorporates key metrics that affect performance on disaggregated memory systems: memory capacity, local and remote memory access ratio, injection bandwidth, and bisection bandwidth, providing an intuitive approach to guide machine configurations based on technology trends and workload characteristics. We apply our methodology to analyze thirteen diverse workloads, including AI training, data analysis, genomics, protein, fusion, atomic nuclei, and traditional HPC bookends. Our methodology demonstrates the ability to comprehend the potential and pitfalls of a disaggregated memory system and provides motivation for machine configurations. Our results show that eleven of our thirteen applications can leverage injection bandwidth disaggregated memory without affecting performance, while one pays a rack bisection bandwidth penalty and two pay the system-wide bisection bandwidth penalty. In addition, we also show that intra-rack memory disaggregation would meet the application's memory requirement and provide enough remote memory bandwidth.

Using BOINC Desktop Grid for High Performance Memory Detection

A parallel computing method for irregular work

HyGrid: A CPU-GPU Hybrid Convolution-Based Gridding Algorithm in Radio Astronomy.

A Way to Improve the Performance of Integrated Real-Time Monitoring System in Power Grid by Distributed Shared Memory Technology

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Multi-discipline computations and collaborative visualization on the campus grid

A Public Grid Computing Framework Based on a Hierarchical Combination of Middleware

A Memory Service Based Memory Sharing Grid System

A distributed paging RAM grid system for wide-area memory sharing.

In-memory Grid Files on Graphics Processors

Parallel Network RAM: Effectively Utilizing Global Cluster Memory for Large Data-Intensive Parallel Programs

Effectively Utilizing Global Cluster Memory for Large Data-Intensive Parallel Programs

Exploring Application Performance on Emerging Hybrid-Memory Supercomputers

Research on In-memory Computing Based on 2.5D Integrated System

Graph Neural Networks Based Memory Inefficiency Detection Using Selective Sampling

Using the High-Level Based Program Interface to Facilitate the Large Scale Scientific Computing

Exploring the Performance Benefit of Hybrid Memory System on HPC Environments

Distributed Md4 Password Hashing With Grid Computing Package Boinc

Evaluating the Potential of Disaggregated Memory Systems for HPC applications

In-memory Computing to Break the Memory Wall

Research On Performance Tool In Hpc And Grid Computing