Abstract:Modern processors implement a decoupled front-end in the form of Fetch Directed Instruction Prefetching (FDIP) to avoid front-end stalls. FDIP is driven by the Branch Prediction Unit (BPU), relying on the BPU's accuracy and branch target tracking structures to speculatively fetch instructions into the Instruction Cache (L1I). As data center applications become more complex, their code footprints also grow, resulting in an increase in Branch Target Buffer (BTB) misses. FDIP can alleviate L1I cache misses, but when it encounters a BTB miss, the BPU may not identify the current instruction as a branch to FDIP. This can prevent FDIP from prefetching or cause it to speculate down the wrong path, further polluting the L1I cache. We observe that the vast majority, 75%, of BTB-missing, unidentified branches are actually present in instruction cache lines that FDIP has previously fetched but, these missing branches have not yet been decoded and inserted into the BTB. This is because the instruction line is decoded from an entry point (which is the target of the previous taken branch) till an exit point (the taken branch). Branch instructions present in the ignored portion of the cache line we call them "Shadow Branches". Here we present Skeia, a novel shadow branch decoding technique that identifies and decodes unused bytes in cache lines fetched by FDIP, inserting them into a Shadow Branch Buffer (SBB). The SBB is accessed in parallel with the BTB, allowing FDIP to speculate despite a BTB miss. With a minimal storage state of 12.25KB, Skeia delivers a geomean speedup of ~5.7% over an 8K-entry BTB (78KB) and ~2% versus adding an equal amount of state to the BTB across 16 front-end bound applications. Since many branches stored in the SBB are unique compared to those in a similarly sized BTB, we consistently observe greater performance gains with Skeia across all examined sizes until saturation.

SPC-Indexed Indirect Branch Hardware Cache Redirecting Technique in Binary Translation

A Hardware Non-Invasive Mapping Method for Condition Bits in Binary Translation

Spire: Improving Dynamic Binary Translation Through Spc-Indexed Indirect Branch Redirecting

Exploiting SIMD Asymmetry in ARM-to-x86 Dynamic Binary Translation

Using Pcache to Speedup Interpretation in Dynamic Binary Translation.

Level Based Binary Translation System Back-end Instruction Indexing Strategy

FPGA based hardware-software co-designed dynamic binary translation system

A Light-weight Code Cache Design for Dynamic Binary Translation

Condition code optimization in dynamic binary translation

Performance Improvements via Peephole Optimization in Dynamic Binary Translation

Variable Instruction Fetch Rate to Reduce Control Dependent Penalties

SPARTA: A Divide and Conquer Approach to Address Translation for Accelerators

A General Low-Cost Indirect Branch Prediction Using Target Address Pointers

Exposing Shadow Branches

CrossMapping: Harmonizing Memory Consistency in Cross-ISA Binary Translation.

A Novel Chaining Approach To Indirect Control Transfer Instructions

SPTU: Improving Dynamic Binary Translation through Software Prediction with Target Updating

Compiler-Assisted Value Correlation for Indirect Branch Prediction

Efficient Binary Translation System with Low Hardware Cost

Branch penalty reduction on IBM cell SPUs via software branch hinting

A Hardware Approach for Reducing Interpretation Overhead