Abstract:On multicore systems contention for shared resources occurs when memory-intensive threads are co-scheduled on cores that share parts of the memory hierarchy, such as lastlevel caches and memory controllers. Previous work investigated how contention could be addressed via scheduling. A contention-aware scheduler separates competing threads onto separate memory hierarchy domains to eliminate resource sharing and, as a consequence, mitigate contention. However, all previous work on contention-aware scheduling assumed that the underlying system is UMA (uniform memory access latencies, single memory controller). Modern multicore systems, however, are NUMA, which means that they feature non-uniform memory access latencies and multiple memory controllers. We discovered that contention management is a lot more difficult on NUMA systems, because the scheduler must not only consider the placement of threads, but also the placement of their memory. This is mostly required to eliminate contention for memory controllers contrary to the popular belief that remote access latency is the dominant concern. In this work we quantify the effects on performance imposed by resource contention and remote access latency. This analysis inspires the design of a contention-aware scheduling algorithm for NUMA systems. This algorithm significantly outperforms a NUMA-unaware algorithm proposed before as well as the default Linux scheduler. We also investigate memory migration strategies, which are the necessary part of the NUMA contention-aware scheduling algorithm. Finally, we propose and evaluate a new contention management algorithm that is priority-aware.

JArena: Partitioned Shared Memory for NUMA-awareness in Multi-threaded Scientific Applications

PseudoNUMA for Reducing Memory Interference in Multi-Core Systems.

Scaling out NUMA-Aware Applications with RDMA-Based Distributed Shared Memory

A Data-Centric Tool to Improve the Performance of Multithreaded Program on NUMA.

HiNUMA: NUMA-Aware Data Placement and Migration in Hybrid Memory Systems

Memory Affinity: Balancing Performance, Power, Thermal and Fairness for Multi-core Systems

A Memory Allocation Policy for the Balance of Access Latency Among Multiple Memory Nodes in NUMA Architecture

PUMA: from Simultaneous to Parallel for Shared Memory System in Multi-core

Performance Optimization for In-Memory File Systems on NUMA Machines

High Performance Memory Management for a Multi-core Architecture.

A Case for NUMA-aware Contention Management on Multicore Systems

Enhancing the Performance and Fairness of Shared DRAM Systems with Sharing-Aware Scheduling

Energy Optimization for Data Allocation with Hybrid SRAM+NVM SPM

Parallel Network RAM: Effectively Utilizing Global Cluster Memory for Large Data-Intensive Parallel Programs

SymS: a symmetrical scheduler to improve multi‐threaded program performance on NUMA systems

A novel enhancing technique for parallel FDTD method using processor affinity and NUMA policy

Efficient Data Distribution Algorithm on NUMA Shared Memory Multiprocessors

HydraFS: an Efficient NUMA-aware In-Memory File System

CMLB: a Communication-aware and Memory Load Balance Mapping Optimization for Modern NUMA Systems

A Scalable Lock on NUMA Multicore.

Pseudo Share: Bring Shared to Exclusive for Main Memory in Multi-core Systems