Abstract:The increasing demand for computing power and the emergence of heterogeneous computing architectures have driven the exploration of innovative techniques to address current limitations in both the compute and memory subsystems. One such solution is the use of Accelerated Processing Units (APUs), processors that incorporate both a central processing unit (CPU) and an integrated graphics processing unit (iGPU). However, the performance of both APU and CPU systems can be significantly hampered by address translation overhead, leading to a decline in overall performance, especially for cache-resident workloads. To address this issue, we propose the introduction of a new intermediate address space (IAS) in both APU and CPU systems. IAS serves as a bridge between virtual address (VA) spaces and physical address (PA) spaces, optimizing the address translation process. In the case of APU systems, our research indicates that the iGPU suffers from significant translation look-aside buffer (TLB) misses in certain workload situations. Using an IAS, we can divide the initial address translation into front- and back-end phases, effectively shifting the bottleneck in address translation from the cache side to the memory controller side, a technique that proves to be effective for cache-resident workloads. Our simulations demonstrate that implementing IAS in the CPU system can boost performance by up to 40% compared to conventional CPU systems. Furthermore, we evaluate the effectiveness of APU systems, comparing the performance of IAS-based systems with traditional systems, showing up to a 185% improvement in APU system performance with our proposed IAS implementation. Furthermore, our analysis indicates that over 90% of TLB misses can be filtered by the cache, and employing a larger cache within the system could potentially result in even greater improvements. The proposed IAS offers a promising and practical solution to enhance the performance of both APU and CPU systems, contributing to state-of-the-art research in the field of computer architecture.

On the Impact of ISA Extension on Energy Consumption of I-Cache in Extensible Processors

Power-driven Real-time System Design with Energy Efficiency via ISA Customization

Minimizing Energy Consumption for Embedded Multicore Systems Using Cache Configuration and Task Mapping

Design Space Exploration to Find the Optimum Cache and Register File Size for Embedded Applications

A Feasibility Study on Programmer Specific Instruction Set Processors (PSISPs)

Energy-efficient instruction compression with programmable dictionaries

Study on the Low Power Cache Design Technique

Application Specific Cache Simulation Analysis for Application Specific Instruction set Processor

An Energy-Efficient Combining Way Selective Technique for the Instruction Cache in Superscalar Microprocessors

Intermediate Address Space: virtual memory optimization of heterogeneous architectures for cache-resident workloads

Performance Study of Partitioned Caches in Asymmetric Multi-Core Processors

CASA: A New IFU Architecture for Power-Efficient Instruction Cache and TLB Designs

THE DESIGN OF A LOW POWER DYNAMICALLY RECONFIGURABLE CACHE

I-Cache Tag Reduction for Low Power Chip Multiprocessor.

Instruction-set Selection for Multi-application based ASIP Design: An Instruction-level Study

On the Value and Limits of Multi-level Energy Consumption Static Analysis for Deeply Embedded Single and Multi-threaded Programs

Energy Efficient United L2 Cache Design with Instruction/Data Filter Scheme

Energy Optimization of Memory Intensive Parallel workloads

Read-Tuned STT-RAM and eDRAM Cache Hierarchies for Throughput and Energy Enhancement

A Way Memoization Technique for Reducing Power Consumption of Caches in Application Specific Integrated Processors

ISOS: Space Overlapping Based on Iteration Access Patterns for Dynamic Scratch-pad Memory Management in Embedded Systems