Abstract:The increasing demand for computing power and the emergence of heterogeneous computing architectures have driven the exploration of innovative techniques to address current limitations in both the compute and memory subsystems. One such solution is the use of Accelerated Processing Units (APUs), processors that incorporate both a central processing unit (CPU) and an integrated graphics processing unit (iGPU). However, the performance of both APU and CPU systems can be significantly hampered by address translation overhead, leading to a decline in overall performance, especially for cache-resident workloads. To address this issue, we propose the introduction of a new intermediate address space (IAS) in both APU and CPU systems. IAS serves as a bridge between virtual address (VA) spaces and physical address (PA) spaces, optimizing the address translation process. In the case of APU systems, our research indicates that the iGPU suffers from significant translation look-aside buffer (TLB) misses in certain workload situations. Using an IAS, we can divide the initial address translation into front- and back-end phases, effectively shifting the bottleneck in address translation from the cache side to the memory controller side, a technique that proves to be effective for cache-resident workloads. Our simulations demonstrate that implementing IAS in the CPU system can boost performance by up to 40% compared to conventional CPU systems. Furthermore, we evaluate the effectiveness of APU systems, comparing the performance of IAS-based systems with traditional systems, showing up to a 185% improvement in APU system performance with our proposed IAS implementation. Furthermore, our analysis indicates that over 90% of TLB misses can be filtered by the cache, and employing a larger cache within the system could potentially result in even greater improvements. The proposed IAS offers a promising and practical solution to enhance the performance of both APU and CPU systems, contributing to state-of-the-art research in the field of computer architecture.

Utopia: Fast and Efficient Address Translation via Hybrid Restrictive & Flexible Virtual-to-Physical Address Mappings

PVM: A Memory Management under Vertical Architecture

Unified-TP: A Unified TLB and Page Table Cache Structure for Efficient Address Translation

Victima: Drastically Increasing Address Translation Reach by Leveraging Underutilized Cache Resources

Contiguitas: The Pursuit of Physical Memory Contiguity in Data Centers

UMap: Enabling Application-driven Optimizations for Page Management

SPARTA: A Divide and Conquer Approach to Address Translation for Accelerators

MEGATRON: Software-Managed Device TLB for Shared-Memory FPGA Virtualization

Accelerating Address Translation for Virtualization by Leveraging Hardware Mode

Hardware Support for Address Mapping in PGAS Languages; a UPC Case Study

Utopia: A load sharing facility for large, heterogeneous distributed computer systems

Intermediate Address Space: virtual memory optimization of heterogeneous architectures for cache-resident workloads

Dynamically Reconfigurable Memory Address Mapping for General-Purpose Graphics Processing Unit.

Optimized Address Translation Method for Flash Memory

NeuMMU: Architectural Support for Efficient Address Translations in Neural Processing Units

The Virtual Block Interface: A Flexible Alternative to the Conventional Virtual Memory Framework

CONTRA: Area-Constrained Technology Mapping Framework For Memristive Memory Processing Unit

CrossMapping: Harmonizing Memory Consistency in Cross-ISA Binary Translation.

Fast Map-Addressing For Content Addressable Memories Using Register Reconfiguration

(No)Compromis: paging virtualization is not a fatality

Data remapping for design space optimization of embedded memory systems