Abstract:We live in a new Cambrian Explosion of hardware devices. The end of conventional processor scaling has driven research and industry practice to explore a new generation of approaches. The old DNA of architecture design, including vectors, threads, shared or private memories, coherence or message passing, dataflow or von Neumann execution, are hybridized together in new and exciting ways. Each new architecture exposes a unique hardware-level API. Performance and energy efficiency are critically dependent on how well programs can use these APIs. One approach is to implement custom libraries for each new hardware architecture and application domain. A more scalable approach is to utilize a portable compiler infrastructure tailored to the application domain that makes it easy to generate efficient code for a diverse set of architectures with minimal porting effort. We propose the Unified GraphIt Compiler framework (UGC), which does exactly this for graph applications. UGC achieves portability with reasonable effort by decoupling the architecture-independent algorithm from the architecture-specific schedules and backends. We introduce a new domain-specific intermediate representation, GraphIR, that is key to this decoupling. GraphIR encodes high-level algorithm and optimization information needed for hardware-specific code generation, making it easy to develop different backends (GraphVMs) for diverse architectures, including CPUs, GPUs, and next-generation hardware such as Swarm and the HammerBlade manycore. We also build scheduling language extensions that make it easy to expose optimization decisions like load balancing strategies, blocking for locality, and other data structure choices. We evaluate UGC on five algorithms and 10 input graphs on these 4 distinct architectures and show that UGC enables implementing optimizations that can provide up to 53X speedup over programmer-generated straightforward implementations.

GenCoG: A DSL-Based Approach to Generating Computation Graphs for TVM Testing.

NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers

On the usage and development of deep learning compilers: an empirical study on TVM

CompCodeVet: A Compiler-guided Validation and Enhancement Approach for Code Dataset

CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testing

CodeCoT: Tackling Code Syntax Errors in CoT Reasoning for Code Generation

CodeV: Empowering LLMs for Verilog Generation through Multi-Level Summarization

TVM: An Automated End-to-End Optimizing Compiler for Deep Learning

COCO: Testing Code Generation Systems via Concretized Instructions

GenCO: Generating Diverse Designs with Combinatorial Constraints

CodeGraph: Enhancing Graph Reasoning of LLMs with Code

Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedback

Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation

CodeT: Code Generation with Generated Tests

Chain-of-Thought in Neural Code Generation: From and For Lightweight Language Models

FuncEvalGMN: Evaluating Functional Correctness of SQL via Graph Matching Network

Fuzzing Deep Learning Compilers with HirGen

CogDL: A Comprehensive Library for Graph Deep Learning

Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS

Taming the Zoo: The Unified GraphIt Compiler Framework for Novel Architectures

CodeGen-Test: An Automatic Code Generation Model Integrating Program Test Information