Abstract:Image processing and machine learning applications benefit tremendously from hardware acceleration. Existing compilers target either FPGAs, which sacrifice power and performance for programmability, or ASICs, which become obsolete as applications change. Programmable domain-specific accelerators, such as coarse-grained reconfigurable arrays (CGRAs), have emerged as a promising middle-ground, but they have traditionally been difficult compiler targets since they use a different memory abstraction. In contrast to CPUs and GPUs, the memory hierarchies of domain-specific accelerators use push memories : memories that send input data streams to computation kernels or to higher or lower levels in the memory hierarchy and store the resulting output data streams. To address the compilation challenge caused by push memories, we propose that the representation of these memories in the compiler be altered to directly represent them by combining storage with address generation and control logic in a single structure—a unified buffer. The unified buffer abstraction enables the compiler to separate generic push memory optimizations from the mapping to specific memory implementations in the backend. This separation allows our compiler to map high-level Halide applications to different CGRA memory designs, including some with a ready-valid interface. The separation also opens the opportunity for optimizing push memory elements on reconfigurable arrays. Our optimized memory implementation, the Physical Unified Buffer, uses a wide-fetch, single-port SRAM macro with built-in address generation logic to implement a buffer with two read and two write ports. It is 18% smaller and consumes 31% less energy than a physical buffer implementation using a dual-port memory that only supports two ports. Finally, our system evaluation shows that enabling a compiler to support CGRAs leads to performance and energy benefits. Over a wide range of image processing and machine learning applications, our CGRA achieves 4.7× better runtime and 3.5× better energy-efficiency compared to an FPGA.

Compiler Infrastructure for Specializing Domain-Specific Memory Templates

Compiling Halide Programs to Push-Memory Accelerators

A design framework for processing-in-memory accelerator

A Survey on Domain-Specific Memory Architectures

CIM-MLC: A Multi-level Compilation Stack for Computing-In-Memory Accelerators

Unified Buffer: Compiling Image Processing and Machine Learning Applications to Push-Memory Accelerators

OCC: An Automated End-to-End Machine Learning Optimizing Compiler for Computing-In-Memory

ImaGen: A General Framework for Generating Memory- and Power-Efficient Image Processing Accelerators

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Building a domain-specific compiler for emerging processors with a reusable approach

Polyhedral-Based Compilation Framework for In-Memory Neural Network Accelerators

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

A Parameterized ParaIIeIism Memory TempIate for Affine Array Subscript AppIication

ARCTIC: Agile and Robust Compute-In-Memory Compiler with Parameterized INT/FP Precision and Built-In Self Test

LLM-Aided Compilation for Tensor Accelerators

A Hardware-Software Blueprint for Flexible Deep Learning Specialization

PowerFusion: A Tensor Compiler with Explicit Data Movement Description and Instruction-level Graph IR

Design and Implementation of the MTP Compiler

Weave: Abstraction and Integration Flow for Accelerators of Generated Modules

Memory Safe Computations with XLA Compiler