Abstract:The last-level cache (LLC) shared by heterogeneous processors such as CPU and general-purpose graphics processing unit (GPGPU) brings new opportunities to optimize data sharing among them. Previous work introduces the LLC buffer, which uses part of the LLC storage as a FIFO buffer to enable data sharing between CPU and GPGPU with negligible management overhead. However, the baseline LLC buffer’s capacity is limited and can lead to deadlock when the buffer is full. It also relies on inefficient CPU kernel relaunch and high overhead atomic operations on GPGPU for global synchronization. These limitations motivate us to enable back memory and global synchronization on the baseline LLC buffer and make it more practical. The back memory divides the buffer storage into two levels. While they are managed as a single queue, the data storage in each level is managed as individual circular buffer. The data are redirected to the memory level when the LLC level is full, and are loaded back to the LLC level when it has free space. The case study of n-queen shows that the back memory has a comparative performance with a LLC buffer of infinite LLC level. On the contrary, LLC buffer without back memory exhibits 10% performance degradation incurred by buffer space contention. The global synchronization is enabled by peeking the data about to be read from the buffer. Any request to read the data in LLC buffer after the global barrier is allowed only when all the threads reach the barrier. We adopt breadth-first search (BFS) as a case study and compare the LLC buffer with an optimized implementation of BFS on GPGPU. The results show the LLC buffer has speedup of 1.70 on average. The global synchronization time on GPGPU and CPU is decreased to 38 and 60–5%, respectively.

Set variation-aware shared LLC management for CPU-GPU heterogeneous architecture

SRAM- and STT-RAM-based Hybrid, Shared Last-Level Cache for On-Chip CPU–GPU Heterogeneous Architectures

LLC Buffer for Arbitrary Data Sharing in Heterogeneous Systems.

Research on Cache Partitioning and Adaptive Replacement Policy for CPU-GPU Heterogeneous Processors

Miss-aware LLC Buffer Management Strategy Based on Heterogeneous Multi-Core

LLC Buffer Management Strategy Based on Heterogeneous Multi-core

Exploring Time-Predictable and High-Performance Last-Level Caches for Hard Real-Time Integrated CPU-GPU Processors.

Last Level Cache Layout Remapping for Heterogeneous Systems

Improving the Performance of Heterogeneous Multi-Core Processors by Modifying the Cache Coherence Protocol

Analyzing Memory Access on CPU-GPGPU Shared LLC Architecture

Management Policies Analysis for Multi-core Shared Caches

WAP: the Warp Feature Aware Prefetching Method for LLC on CPU-GPU Heterogeneous Architecture

Buffer on Last Level Cache for CPU and GPGPU Data Sharing

Improving CPU and GPU Performance Through Sample-Based Dynamic LLC Bypassing

Performance Optimization by Dynamically Altering Cache Replacement Algorithm in CPU-GPU Heterogeneous Multi-Core Architecture.

A Heterogeneity-Aware Replacement Policy for the Partitioned Cache on Asymmetric Multi-Core Architectures

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

DIPP—An LLC Replacement Policy for On-chip Dynamic Heterogeneous Multi-core Architecture

Performance evaluation and optimization of cache on fused CPU-GPU architecture

Enable Back Memory and Global Synchronization on LLC Buffer

Shared Last-Level Cache Management for GPGPUs with Hybrid Main Memory