Abstract:Modern processors implement a decoupled front-end in the form of Fetch Directed Instruction Prefetching (FDIP) to avoid front-end stalls. FDIP is driven by the Branch Prediction Unit (BPU), relying on the BPU's accuracy and branch target tracking structures to speculatively fetch instructions into the Instruction Cache (L1I). As data center applications become more complex, their code footprints also grow, resulting in an increase in Branch Target Buffer (BTB) misses. FDIP can alleviate L1I cache misses, but when it encounters a BTB miss, the BPU may not identify the current instruction as a branch to FDIP. This can prevent FDIP from prefetching or cause it to speculate down the wrong path, further polluting the L1I cache. We observe that the vast majority, 75%, of BTB-missing, unidentified branches are actually present in instruction cache lines that FDIP has previously fetched but, these missing branches have not yet been decoded and inserted into the BTB. This is because the instruction line is decoded from an entry point (which is the target of the previous taken branch) till an exit point (the taken branch). Branch instructions present in the ignored portion of the cache line we call them "Shadow Branches". Here we present Skeia, a novel shadow branch decoding technique that identifies and decodes unused bytes in cache lines fetched by FDIP, inserting them into a Shadow Branch Buffer (SBB). The SBB is accessed in parallel with the BTB, allowing FDIP to speculate despite a BTB miss. With a minimal storage state of 12.25KB, Skeia delivers a geomean speedup of ~5.7% over an 8K-entry BTB (78KB) and ~2% versus adding an equal amount of state to the BTB across 16 front-end bound applications. Since many branches stored in the SBB are unique compared to those in a similarly sized BTB, we consistently observe greater performance gains with Skeia across all examined sizes until saturation.

Simultaneous Way footprint Prediction and Branch Prediction for Energy Savings in Set associative Instruction Caches

Integrated I-cache Way Predictor and Branch Target Buffer to Reduce Energy Consumption

A Low-power Design for gshare Branch Predictor

Instruction Cache Power-Performance Optimization Via Run-Time Prediction

Loop Based Trace Way Prediction for Instruction Cache

A General Low-Cost Indirect Branch Prediction Using Target Address Pointers

Low power instruction cache based on adjacent line linking access

Low-power consumption strategy for instruction cache based on way-access track

An Energy-Efficient Combining Way Selective Technique for the Instruction Cache in Superscalar Microprocessors

CSDA: an Adaptive Data Storage Strategy for Predictive Branch Path on Multi-Core Architecture

Enhancing Power Efficiency in Branch Target Buffer Design with a Two-Level Prediction Mechanism

Exposing Shadow Branches

Effective Optimization Of Branch Predictors Through Lightweight Simulation

Dynamic Time Tuning For Way Prediction Cache In Low Power Embedded Processors

An Accurate and Energy Efficient Fetch Direction Orientation Mechanism for Trace Cache

SWIP Prediction: Complexity-Effective Indirect-Branch Prediction Using Pointers

Way Selecting Cache Architecture for Low Power Consumption

Variable Instruction Fetch Rate to Reduce Control Dependent Penalties

TAP prediction: Reusing conditional branch predictor for indirect branches with Target Address Pointers

WHOLE: A Low Energy I-Cache with Separate Way History

An Energy-Efficient Branch Prediction Technique Via Global-History Noise Reduction