Abstract:Cache prefetcher greatly eliminates compulsory cache misses, by fetching data from slower memory to faster cache before it is actually required by processors. Sophisticated prefetchers predict next use cache line by repeating program's historical spatial and temporal memory access pattern. However, they are error prone and the mis-predictions lead to cache pollution and exert extra pressure on memory subsystem. In this paper, a novel scheme of data cache prefetching with perceptron learning is proposed. The key idea is a two-level prefetching mechanism. A primary decision is made by utilizing previous table-based prefetching mechanism, e.g. stride prefetching or Markov prefetching, and then, a neural network, perceptron is taken to detect and trace program memory access patterns, to help reject those unnecessary prefetching decisions. The perceptron can learn from both local and global history in time and space, and can be easily implemented by hardware. This mechanism boost execution performance by ideally mitigating cache pollution and eliminating redundant memory request issued by prefetcher. Detailed evaluation and analysis were conducted based on SPEC CPU 2006 benchmarks. The simulation results show that generally the proposed scheme yields a geometric mean of 60.64%-83.84% decrease in prefetching memory requests without loss in instruction per cycle(IPC)(floating between -2.22% and 2.55%) and cache hit rate(floating between -1.67% and 2.46%). Though it is possible that perceptron may refuse useful blocks and thus cause minor raise in cache miss rate, lower memory request count can decrease average memory access latency, which compensate for the loss, and in the meantime, enhance overall performance in multi-programmed workloads.

Prefetching Policy Using Miss Queue Information

Performance Comparison of Data Prefetching for Pointer-Chasing Applications

Memory system prefetching for multi-core and Multi-Threading architecture

Instruction Prefetch for Improving GPGPU Performance

A New Hardware Prefetch Method and Its Effect on System Performance

The On-chip Prefetch Memory System for Digital Signal Stream Processor

A Prefetch-Adaptive Intelligent Cache Replacement Policy Based on Machine Learning

A New Technology of Multi-core Prefetching

A memory bandwidth effective cache store miss policy

Stride and Pointer Based Prefetching in Chip Multiprocessor

Energy-Efficient Hardware Data Prefetching

Dynamic Data Prefetching in Home-Based Software DSMs

Data Cache Prefetching with Perceptron Learning

A novel hardware prefetching scheme exploiting 2-D spatial locality in multimedia applications

Performance Analysis and Optimization of Prefetching Thread on CMPs

Pre-Execution Directed Prefetching for In-Order Processors

Software Prefetching for Indirect Memory Accesses

Improved Hardware Prefetching Technology for CMP

Memory Centric Hardware Prefetching in Multi-core Processors

Aap And Aapm: Improved Prefetching Structures Of The L2 Cache

New Prefetch Technique Design for L2 Cache