Abstract:Hardware prefetching plays an important role in modern processors for hiding memory access latency. Delta prefetchers show great potential at the L1D cache level, as they can impose small storage overhead by recording deltas. Furthermore, local delta prefetchers, such as Berti, have been shown to achieve high L1D accuracy. However, there is still room for improving the L1D coverage of existing delta prefetchers. Our goal is to develop a delta prefetcher capable of achieving both high L1D coverage and accuracy. We explore delta prefetchers trained on various types of contextual information, ranging from coarse-grained to fine-grained, and analyze their L1D coverage and accuracy. Our findings indicate that training deltas based on the access histories of both PCs and memory pages for individual PCs and memory pages can lead to increased L1D coverage alongside high accuracy. Therefore, we introduce Hyperion, a highly efficient Page and PC-based delta prefetcher. In terms of the vital component of recording access histories, we implement three different structures and engage in a detailed discussion about them. Furthermore, Hyperion utilizes micro-architecture information (e.g., L1D hits or misses, PQ occupancy) and real-time L1D accuracy to dynamically adjust its issuing mechanism, further enhancing performance and L1D accuracy. Our results show that Hyperion achieves an L1D accuracy of 92.4% and an L1D coverage of 51.9%, along with an L2C coverage of 63.0% and an LLC coverage of 67.5% across a diverse range of applications, including SPEC CPU2006, SPEC CPU2017, GAP, and PARSEC, with a baseline of no prefetching. Regarding performance, Hyperion achieves a 50.1% performance gain, outperforming the state-of-the-art delta prefetcher Berti by 5.0% over baseline across all memory-intensive traces from the four benchmark suites.

Hyperion: A Highly Effective Page and PC Based Delta Prefetcher

Chimera: Leveraging Hybrid Offsets for Efficient Data Prefetching

CHAM: Improving Prefetch Efficiency Using a Composite Hierarchy-Aware Method

BTIP: Branch Triggered Instruction Prefetcher Ensuring Timeliness

Helper Without Threads: Customized Prefetching for Delinquent Irregular Loads

Differential-Matching Prefetcher for Indirect Memory Access

Tyche: An Efficient and General Prefetcher for Indirect Memory Accesses

A Prefetch-Adaptive Intelligent Cache Replacement Policy Based on Machine Learning

Triangel: A High-Performance, Accurate, Timely On-Chip Temporal Prefetcher

Memory system prefetching for multi-core and Multi-Threading architecture

Performance Comparison of Data Prefetching for Pointer-Chasing Applications

Estimating Effective Prefetch Distance in Threaded Prefetching for Linked Data Structures

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Puppeteer: A Random Forest-based Manager for Hardware Prefetchers across the Memory Hierarchy

Multi-core Helper Thread Prefetching for Irregular Data Intensive Applications

Software Prefetching for Indirect Memory Accesses

An Efficient Hardware Prefetcher Exploiting the Prefetch Potential of Long-Stride Access Pattern on Virtual Address

Applying Deep Learning to the Cache Replacement Problem

Data Cache Prefetching with Perceptron Learning

An Approach to Data Prefetching Using 2-Dimensional Selection Criteria

Global Prefetcher Aggressiveness Control for Chip-Multiprocessor