Abstract:Mainstream chip multiprocessors already include a significant number of cores that make straightforward snooping-based cache coherence less appropriate. Further increase in core count will almost certainly require more sophisticated tracking of data sharing to minimize unnecessary messages and cache snooping. Directory-based coherence has been the standard solution for large-scale shared-memory multiprocessors and is a clear candidate for on-chip coherence maintenance. A vanilla directory design, however, suffers from inefficient use of storage to keep coherence metadata. The result is a high storage overhead for larger scales. Reducing this overhead leads to saving of resources that can be redeployed for other purposes. In this paper, we exploit familiar characteristics of coherence metadata, but with novel angles and propose two practical techniques to increase the expressiveness of directory entries, particularly for chip-multiprocessors. First, it is well known that the vast majority of cache lines have a small number of sharers. We exploit a related fact with a subtle but important difference: that a significant portion of directory entries only need to track one node. We can thus use a hybrid representation of sharers list for the directory. Second, contiguous memory regions often share the same coherence characteristics and can be tracked by a single entry. We propose an adaptive multi-granular mechanism that does not rely on any profiling, compiler, or operating system support to identify such regions. Moreover, it allows co-existence of line and region entries in the same locations, thus making regions more applicable. We show that both techniques improve the expressiveness of directory entries, and, when combined, can reduce directory storage by more than an order of magnitude with negligible loss of precision.

KLNK: Expanding Page Boundaries in a Distributed Shared Memory System

Building Expressive and Area-Efficient Directories with Hybrid Representation and Adaptive Multi-Granular Tracking

A Physical-Aware Framework for Memory Network Design Space Exploration

Zweilous: A Decoupled and Flexible Memory Management Framework.

SelectDirectory: a Selective Directory for Cache Coherence in Many-Core Architectures.

SEMMA: Secure Efficient Memory Management Approach in Virtual Environment.

Online Shared Memory Dependence Reduction Via Bisectional Coordination

Partial Failure Resilient Memory Management System for (Cxl-Based) Distributed Shared Memory

An Exploration of Page Replication for NoC-Based On-Chip Distributed Memory Systems

Concordia: Distributed Shared Memory with In-Network Cache Coherence.

Breaking Down Memory Walls: Adaptive Memory Management in LSM-based Storage Systems (Extended Version)

TC-Release++: an Efficient Timestamp-Based Coherence Protocol for Many-Core Architectures.

DRust: Language-Guided Distributed Shared Memory with Fine Granularity, Full Transparency, and Ultra Efficiency

JArena: Partitioned Shared Memory for NUMA-awareness in Multi-threaded Scientific Applications

A Non-blocking Buddy System for Scalable Memory Allocation on Multi-core Machines

Software-Based Lightweight Multithreading to Overlap Memory-Access Latencies of Commodity Processors

Optimizing LSM-based indexes for disaggregated memory

Exploiting Single-Threaded Model in Multi-Core In-Memory Systems.

Memory Affinity: Balancing Performance, Power, Thermal and Fairness for Multi-core Systems

Supporting Flexible Data Distribution in Software DSMs

Synchronization Coherence: A Transparent Hardware Mechanism For Cache Coherence And Fine-Grained Synchronization