Abstract:As the volume of data processed by applications has increased, considerable attention has been paid to data address translation overheads, leading to the widespread use of larger page sizes (“superpages”) and multi-level translation lookaside buffers (TLBs). However, far less attention has been paid to instruction address translation and its relation to TLB and pipeline structure. In prior work, we quantified the impact of using code superpages on a variety of widely used applications, ranging from compilers to web user-interface frameworks, and the impact of sharing page table pages for executables and shared libraries. Within this paper, we augment those results by first uncovering the effects that microarchitectural differences between Intel Skylake and AMD Zen+, particularly, their different TLB organizations, have on instruction address translation overhead. This analysis provides some key insights into the microarchitectural design decisions that impact the cost of instruction address translation. First, a lower-level (L2) TLB that has both instruction and data mappings competing for space within the same structure allows better overall performance and utilization when using code superpages. Code superpages not only reduce instruction address translation overhead, but also indirectly reduce data address translation overhead. In fact, for a few applications, the use of just a few code superpages has a larger impact on overall performance than the use of a much larger number of data superpages. Second, a level 1 (L1) TLB with separate structures for different page sizes may require careful tuning of the superpage promotion policy for code, and a correspondingly suboptimal utilization of the L2 TLB. In particular, increasing the number of superpages when the size of the L1 superpage structure is small, may result in more L1 TLB misses for some applications. Moreover, on some microarchitectures, the cost of these misses can be highly variable, because replacement is delayed until all of the in-flight instructions mapped by the victim entry are retired. Hence, more superpage promotions can result in a performance regression. Finally, our findings also make a case for first-class OS support for superpages on ordinary files containing executables and shared libraries, as well as a more aggressive superpage policy for code.

Coalesced TLB to Exploit Diverse Contiguity of Memory Mapping.

Translation lookaside buffer design based on dynamic memory page merging

Translation look-aside buffer with consecutive page merging and recycling

Building Expressive and Area-Efficient Directories with Hybrid Representation and Adaptive Multi-Granular Tracking

FlexPointer: Fast Address Translation Based on Range TLB and Tagged Pointers

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

CCFTL: A novel continuity compressed page-level flash address mapping method for SSDs

Victima: Drastically Increasing Address Translation Reach by Leveraging Underutilized Cache Resources

TC-Release++: an Efficient Timestamp-Based Coherence Protocol for Many-Core Architectures.

Hzmem: New Huge Page Allocator with Main Memory Compression.

Contiguitas: The Pursuit of Physical Memory Contiguity in Data Centers

Selective Hardware/software Memory Virtualization

A Low-Power Dtlb Design Based on Memory Region Encoding

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

Optimized Address Translation Method for Flash Memory

S-FTL: An efficient address translation for flash memory by exploiting spatial locality

Mosaic Pages: Big TLB Reach With Small Pages

Fast and Low Power TLB Access Mechanism with Prediction Buffer

STLAC: A Spatial and Temporal Locality-Aware Cache and Network-on-chip Codesign for Tiled Many-Core Systems.

The Impact of Page Size and Microarchitecture on Instruction Address Translation Overhead

TriZone: A Design of MLC STT-RAM Cache for Combined Performance, Energy, and Reliability Optimizations