Abstract:Modern GPGPUs have employed multi-threading to hide the long off-chip memory access latency caused by frequent cache misses. However, the limited cache capacity shared by thousands of concurrently running warps will introduce serious cache contention problem, which results in high cache miss rates to hurt the overall GPGPU performance. To address this problem, this paper proposes a novel cache technology (Re-Cache) by exploiting locality characteristics and reconfiguring the memory hierarchy including the unused shared memory space and the idle registers of pending warps without extra storage overhead for GPGPUs. To further improve the utilization efficiency of the Re-Cache space, this paper proposes a dynamic and reconfigurable cache organization for Re-Cache that explores the spatial and temporal locality differences and changes among the running applications. Re-Cache dynamically reconfigures the cache organization as the adaptive prefetch region and victim region according to the differences and changes of the spatial and temporal locality by catching the locality characteristics for each load instruction. For the high-locality load instructions, the prefetch region stores the subsequent data blocks to exploit the spatial locality of the running threads among all streaming multiprocessors and warps, while the victim region collects the evicted data blocks from the upper memory hierarchy to exploit the temporal locality. Experimental results demonstrate that the proposed Re-Cache reduces up to 34.82% and 31.62% cache misses, while improving about 47.17% and 14.96% IPC performance compared with the state-of-the-art designs for cache-sensitive kernels and benchmarks, respectively.

Improving the Performance of Adaptive Cache in Reconfigurable VLIW Processor.

Feedback Cache Mechanism for Dynamically Reconfigurable VLIW Processors

Reconfiguration Algorithm of Low-Power Reconfigurable Cache

Dynamical reconfigurable cache architecture with low-power

The Design of Reconfigurable Cache Scheme in Multi-core Processor

Study and Design of Dynamically Reconfigurable Cache Architecture

Reconfigurable cache for real-time MPSoCs: Scheduling and implementation

Dynamically Reconfigurable Cache for Low-Power Embedded System

Energy-Oriented Adaptive Reconfigurable Instruction Cache

THE DESIGN OF A LOW POWER DYNAMICALLY RECONFIGURABLE CACHE

A novel configuration context cache structure of reconfigurable systems

A Data Cache Optimization Approach for Coarse Grain Reconfigurable Architecture for Multimedia Applications

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

CRP: Context-directed Replacement Policy to Improve Cache Performance for Coarse-Grained Reconfigurable Arrays

A Design of Online Configurable and Low Power Cache for Embedded Processor

Improving Performance of Partial Reconfiguration Using Strategy of Virtual Deletion

Achieving Versatile and Simultaneous Cache Optimizations with Nonvolatile SRAM

Coarse-grained Reconfigurable Architecture with Hierarchical Context Cache Structure and Management Approach.

An Utilization-Efficient Context Memory Design for Reconfigurable Processing Array with Locally Shared Strategy

Decision Tree-Based Adaptive Reconfigurable Cache Scheme

A Software Method Of Reconfigurable Technology On Soc Cache