Abstract:In CPU microarchitecture, caches store frequently accessed instructions and data by exploiting their locality, reducing memory access latency and improving application performance. However, contemporary applications with large code footprints often experience frequent Icache misses, which significantly degrade performance. Although Fetch-Directed Instruction Prefetching (FDIP) has been widely adopted in commercial processors to reduce Icache misses, our analysis reveals that FDIP still suffers from Icache misses caused by branch mispredictions and late prefetch, leaving considerable opportunity for performance optimization. Priority-Directed Instruction Prefetching (PDIP) has been proposed to reduce Icache misses caused by branch mispredictions in FDIP. However, it neglects Icache misses due to late prefetch and suffers from high storage overhead. In this paper, we proposed a branch-triggered instruction prefetcher (BTIP), which aims to prefetch Icache lines that FDIP cannot efficiently handle, including the Icache misses due to branch misprediction and late prefetch. We also introduce a novel Branch Target Buffer (BTB) organization, BTIP BTB, which stores prefetch metadata and reuses information from existing BTB entries, effectively reducing storage overhead. We implemented BTIP on the Champsim simulator and evaluated BTIP in detail using traces from the 1st Instruction Prefetching Championship (IPC-1). Our evaluation shows that BTIP outperforms both FDIP and PDIP. Specifically, BTIP reduces Icache misses by 38.0% and improves performance by 5.1% compared to FDIP. Additionally, BTIP outperforms PDIP by 1.6% while using only 41.9% of the storage space required by PDIP.

An Adaptive and Selective Instruction Active Push Mechanism for Multi-core Architecture

Cache Miss Reduction Through Hardware-Assisted Loop Optimization

CSDA: an Adaptive Data Storage Strategy for Predictive Branch Path on Multi-Core Architecture

Optimization method for multi-core last level Cache considering the memory access modes

Memory system prefetching for multi-core and Multi-Threading architecture

An Energy-Efficient Executing Ahead Mechanism for Improving the Performance of Single-Issue In-Order Microprocessors

The Non-Sequential Instruction Prefetching Based on Basic Blocks

Aap And Aapm: Improved Prefetching Structures Of The L2 Cache

BTIP: Branch Triggered Instruction Prefetcher Ensuring Timeliness

Prefetch Structure of L2 Cache for Multi-Core Multi-Thread Pocessor

Hybrid Instruction Prefetch Based on Control Flow

Low power instruction cache based on adjacent line linking access

An Energy-Efficient Combining Way Selective Technique for the Instruction Cache in Superscalar Microprocessors

A modified instruction fetch control mechanism for SMT architecture

Navigating Core Assisted Helper Threaded Prefetching

Design of L2 CACHE Replacement Arithmetic for Chip Multiprocessor Architecture

Low-power consumption strategy for instruction cache based on way-access track

Pre-Execution Directed Prefetching for In-Order Processors

Global Prefetcher Aggressiveness Control for Chip-Multiprocessor

Convergence path instruction-level reuse high performance optimization mechanism

Instruction Prefetch for Improving GPGPU Performance