Abstract:In CPU microarchitecture, caches store frequently accessed instructions and data by exploiting their locality, reducing memory access latency and improving application performance. However, contemporary applications with large code footprints often experience frequent Icache misses, which significantly degrade performance. Although Fetch-Directed Instruction Prefetching (FDIP) has been widely adopted in commercial processors to reduce Icache misses, our analysis reveals that FDIP still suffers from Icache misses caused by branch mispredictions and late prefetch, leaving considerable opportunity for performance optimization. Priority-Directed Instruction Prefetching (PDIP) has been proposed to reduce Icache misses caused by branch mispredictions in FDIP. However, it neglects Icache misses due to late prefetch and suffers from high storage overhead. In this paper, we proposed a branch-triggered instruction prefetcher (BTIP), which aims to prefetch Icache lines that FDIP cannot efficiently handle, including the Icache misses due to branch misprediction and late prefetch. We also introduce a novel Branch Target Buffer (BTB) organization, BTIP BTB, which stores prefetch metadata and reuses information from existing BTB entries, effectively reducing storage overhead. We implemented BTIP on the Champsim simulator and evaluated BTIP in detail using traces from the 1st Instruction Prefetching Championship (IPC-1). Our evaluation shows that BTIP outperforms both FDIP and PDIP. Specifically, BTIP reduces Icache misses by 38.0% and improves performance by 5.1% compared to FDIP. Additionally, BTIP outperforms PDIP by 1.6% while using only 41.9% of the storage space required by PDIP.

Instruction Recycling Based Low Power Branch Folding

A Low-power Design for gshare Branch Predictor

Low Power Branch Target Buffer Based on Loop Access Filtering

Low power instruction cache based on adjacent line linking access

Enhancing Power Efficiency in Branch Target Buffer Design with a Two-Level Prediction Mechanism

Branch penalty reduction on IBM cell SPUs via software branch hinting

Integrated I-cache Way Predictor and Branch Target Buffer to Reduce Energy Consumption

Variable Instruction Fetch Rate to Reduce Control Dependent Penalties

Simultaneous Way footprint Prediction and Branch Prediction for Energy Savings in Set associative Instruction Caches

Ultralow Power Processor Employing Block Instruction for ECG Applications

A General Low-Cost Indirect Branch Prediction Using Target Address Pointers

Branch scheduling optimization on VLIW processors

An Energy-Efficient Branch Prediction Technique Via Global-History Noise Reduction

Linking history based low-power instruction cache

Exploring Branch Target Buffer Access Filtering for Low-Energy and High-Performance Microarchitectures

The Non-Sequential Instruction Prefetching Based on Basic Blocks

BTB Access Filtering: A Low Energy and High Performance Design

Low-power consumption strategy for instruction cache based on way-access track

An Energy-Efficient Executing Ahead Mechanism for Improving the Performance of Single-Issue In-Order Microprocessors

Software Power Optimization for Embedded Systems Based on Instruction Clustering and Instruction Rescheduling

BTIP: Branch Triggered Instruction Prefetcher Ensuring Timeliness