Abstract:Although some instructions hurt performance more than others, current processors typically apply scheduling and speculation as if each instruction was equally costly. Instruction cost can be naturally expressed through the critical path : if we could predict it at run-time, egalitarian policies could be replaced with cost-sensitive strategies that will grow increasingly effective as processors become more parallel. This paper introduces a hardware predictor of instruction criticality and uses it to improve performance. The predictor is both effective and simple in its hardware implementation. The effectiveness at improving performance stems from using a dependence-graph model of the microarchitectural critical path that identifies execution bottlenecks by incorporating both data and machine-specific dependences. The simplicity stems from a token-passing algorithm that computes the critical path without actually building the dependence graph. By focusing processor policies on critical instructions, our predictor enables a large class of optimizations. It can (i) give priority to critical instructions for scarce resources (functional units, ports, predictor entries); and (ii) suppress speculation on non-critical instructions, thus reducing “useless” misspeculations. We present two case studies that illustrate the potential of the two types of optimization, we show that (i) critical-path-based dynamic instruction scheduling and steering in a clustered architecture improves performance by as much as 21% (10% on average); and (ii) focusing value prediction only on critical instructions improves performance by as much as 5%, due to removing nearly half of the misspeculations.

Micro Fix: Exploiting Path-Grained Timing Adaptability For Improving Power-Performance Efficiency

Power Reduction Through Measurement and Modeling of Users and CPUs: Summary

User- and Process-Driven Dynamic Voltage and Frequency Scaling.

Noise-aware DVFS Transition Sequence Optimization for Battery-Powered IoT Devices.

User-Driven Frequency Scaling

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

Eliminating Timing Errors Through Collaborative Design to Maximize the Throughput

Negative Design Margin Realization through Deep Path Activity Detection Combined with Dynamic Voltage Scaling in a 55 nm Near-Threshold 32-Bit Microcontroller

Predict; Do not React for Enabling Efficient Fine Grain DVFS in GPUs

A power-aware system combining static compiling and DVFS

Performance-Aware Power Management in Embedded Controllers with Multiple-Voltage Processors

Margin Elimination in a 55 nm Near-Threshold Microcontroller with Adaptive Prediction Capability and Voltage Scaling

An Energy-Efficient Microprocessor Using Multilevel Error Correction For Timing Error Tolerance

Focusing processor policies via critical-path prediction

Extending Performance-Energy Trade-offs Via Dynamic Core Scaling

Runtime Slack Creation for Processor Performance Variability using System Scenarios

Learning-Directed Dynamic Voltage and Frequency Scaling Scheme with Adjustable Performance for Single-Core and Multi-Core Embedded and Mobile Systems

Expected Energy Optimization for Real-Time Multiprocessor SoCs Running Periodic Tasks with Uncertain Execution Time.

Statistical Timing and Power Optimization of Architecture and Device for FPGAs

A New Dynamic Frequency Scaling Algorithm For Power-Aware And Real Time System

Exploiting Power-Area Tradeoffs In High-Level Synthesis Through Dynamic Functional Unit Allocation