Abstract:Image processing and machine learning applications benefit tremendously from hardware acceleration. Existing compilers target either FPGAs, which sacrifice power and performance for programmability, or ASICs, which become obsolete as applications change. Programmable domain-specific accelerators, such as coarse-grained reconfigurable arrays (CGRAs), have emerged as a promising middle-ground, but they have traditionally been difficult compiler targets since they use a different memory abstraction. In contrast to CPUs and GPUs, the memory hierarchies of domain-specific accelerators use push memories : memories that send input data streams to computation kernels or to higher or lower levels in the memory hierarchy and store the resulting output data streams. To address the compilation challenge caused by push memories, we propose that the representation of these memories in the compiler be altered to directly represent them by combining storage with address generation and control logic in a single structure—a unified buffer. The unified buffer abstraction enables the compiler to separate generic push memory optimizations from the mapping to specific memory implementations in the backend. This separation allows our compiler to map high-level Halide applications to different CGRA memory designs, including some with a ready-valid interface. The separation also opens the opportunity for optimizing push memory elements on reconfigurable arrays. Our optimized memory implementation, the Physical Unified Buffer, uses a wide-fetch, single-port SRAM macro with built-in address generation logic to implement a buffer with two read and two write ports. It is 18% smaller and consumes 31% less energy than a physical buffer implementation using a dual-port memory that only supports two ports. Finally, our system evaluation shows that enabling a compiler to support CGRAs leads to performance and energy benefits. Over a wide range of image processing and machine learning applications, our CGRA achieves 4.7× better runtime and 3.5× better energy-efficiency compared to an FPGA.

Buffer Filter: A Last-Level Cache Management Policy for CPU-GPGPU Heterogeneous System

Buffer on Last Level Cache for CPU and GPGPU Data Sharing

LLC Buffer for Arbitrary Data Sharing in Heterogeneous Systems.

Enable Back Memory and Global Synchronization on LLC Buffer

Analyzing Memory Access on CPU-GPGPU Shared LLC Architecture

Orchestrating Cache Management and Memory Scheduling for GPGPU Applications.

POSTER: BACM: Barrier-Aware Cache Management for Irregular Memory-Intensive GPGPU Workloads

Fine-grained Policy-driven I/O Sharing for Burst Buffers

Exploring Time-Predictable and High-Performance Last-Level Caches for Hard Real-Time Integrated CPU-GPU Processors.

A perceptual and predictive batch-processing memory scheduling strategy for a CPU-GPU heterogeneous system

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

Unified Buffer: Compiling Image Processing and Machine Learning Applications to Push-Memory Accelerators

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

SLRF: A High-efficiency Shared Less Reused Filter in Chip Multiprocessors

A Comprehensive Memory Management Framework for CPU-FPGA Heterogenous SoCs

WAP: the Warp Feature Aware Prefetching Method for LLC on CPU-GPU Heterogeneous Architecture

Last Level Cache Layout Remapping for Heterogeneous Systems

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

LA-LLC: Inter-Core Locality-Aware Last-Level Cache to Exploit Many-to-Many Traffic in GPGPUs

BufferBank: A Distributed Cache Infrastructure for Peer-to-peer Application

Hydrogen: Contention-Aware Hybrid Memory for Heterogeneous CPU-GPU Architectures