Abstract:Address translation is a performance bottleneck in data-intensive workloads due to large datasets and irregular access patterns that lead to frequent high-latency page table walks (PTWs). PTWs can be reduced by using (i) large hardware TLBs or (ii) large software-managed TLBs. Unfortunately, both solutions have significant drawbacks: increased access latency, power and area (for hardware TLBs), and costly memory accesses, the need for large contiguous memory blocks, and complex OS modifications (for software-managed TLBs). We present Victima, a new software-transparent mechanism that drastically increases the translation reach of the processor by leveraging the underutilized resources of the cache hierarchy. The key idea of Victima is to repurpose L2 cache blocks to store clusters of TLB entries, thereby providing an additional low-latency and high-capacity component that backs up the last-level TLB and thus reduces PTWs. Victima has two main components. First, a PTW cost predictor (PTW-CP) identifies costly-to-translate addresses based on the frequency and cost of the PTWs they lead to. Second, a TLB-aware cache replacement policy prioritizes keeping TLB entries in the cache hierarchy by considering (i) the translation pressure (e.g., last-level TLB miss rate) and (ii) the reuse characteristics of the TLB entries. Our evaluation results show that in native (virtualized) execution environments Victima improves average end-to-end application performance by 7.4% (28.7%) over the baseline four-level radix-tree-based page table design and by 6.2% (20.1%) over a state-of-the-art software-managed TLB, across 11 diverse data-intensive workloads. Victima (i) is effective in both native and virtualized environments, (ii) is completely transparent to application and system software, and (iii) incurs very small area and power overheads on a modern high-end CPU.

An Improved Scheme of Victim Replication in Tiled Chip Multiprocessors

High Performance Cache Block Replication Using Re-Reference Probability in CMPs

Dynamic Reusability-Based Replication with Network Address Mapping in CMPs.

ARP: an Adaptive Replication Policy in Tiled Chip Multiprocessor

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors

Replicating Tag Entries for Reliability Enhancement in Cache Tag Arrays

Victima: Drastically Increasing Address Translation Reach by Leveraging Underutilized Cache Resources

Lowering Latency of Embedded Memory by Exploiting In-Cell Victim Cache Hierarchy Based on Emerging Multi-Level Memory Devices

An Exploration of Page Replication for NoC-Based On-Chip Distributed Memory Systems

TRB: Tag Replication Buffer for Enhancing the Reliability of the Cache Tag Array

CWFP: Novel Collective Writeback and Fill Policy for Last-Level DRAM Cache.

A Duplication-Aware SSD-Based Cache Architecture for Primary Storage in Virtualization Environment

Exploit Imbalanced Cell Writes to Mitigate Write Disturbance in Dense Phase Change Memory

Adaptive Placement and Migration Policy for an STT-RAM-based Hybrid Cache

Scalable Proximity-Aware Cache Replication in Chip Multiprocessors

Word- and Partition-LevelWrite Variation Reduction for Improving Non-Volatile Cache Lifetime

Cooperatively Managing Dynamic Writeback and Insertion Policies in a Last-Level DRAM Cache.

A Two-Layered Replica Management Method

Network caching for Chip Multiprocessors

Enhanced Adaptive Insertion Policy for Shared Caches.

Victor: A Variation-resilient Approach Using Cell-Clustered Charge-domain computing for High-density High-throughput MLC CiM