Abstract:Domain-Specific Languages (DSLs) provide the optimum balance between generalization and specialization that is crucial to getting the best performance for a particular domain. DSLs like Halide and GraphIt and their rich scheduling languages allow users to generate an implementation best suited for the algorithm and input. DSLs also provide the right abstraction for generating code for diverse architectures like GPUs, CPUs, and hardware accelerators. DSL compilers are massive, typically spanning tens of thousands of lines of code and need a frontend, some analysis and transformation passes, and target-specific code generation. These implementations usually require a great deal of compiler knowledge and domain experts cannot prototype DSLs without getting compiler experts involved. Using multi-stage programming in a high-level language like Scala, OCaml, or C++, is a great solution because it provides easy-to-use frontend and automatic code generation abilities. The DSL writers typically implement their abstraction as a library in the multi-stage programming language and use it to generate specialized code by providing partial inputs. This solves the problem only partially because DSLs like GraphIt have shown that several domain-specific analyses and transformations need to be performed to get the best performance. Special care has to be taken when targeting massively parallel architectures like GPUs where factors like load balancing, warp divergence, coalesced memory accesses play a critical role. In this paper, we demonstrate how to build an end-to-end DSL compiler framework and a graph DSL using multi-stage programming in C++. We show how the staged types can be extended to perform domain-specific data flow and control flow analyses and transformations. We also show how our generated CUDA code matches the performance of the code generated from the state-of-the-art graph DSL, GraphIt. We achieve all this in a very small fraction (8.4%) of the code size required to implement the traditional DSL compiler.

Automatic compiler/interpreter generation from programs for Domain-Specific Languages: Code bloat problem and performance improvement

Should AI Optimize Your Code? A Comparative Study of Current Large Language Models Versus Classical Optimizing Compilers

AI Powered Compiler Techniques for DL Code Optimization

Verified Code Transpilation with LLMs

GraphIt to CUDA Compiler in 2021 LOC: A Case for High-Performance DSL Implementation via Staging with BuilDSL

On the Effectiveness of Large Language Models in Domain-Specific Code Generation

Improving Parallel Program Performance Through DSL-Driven Code Generation with LLM Optimizers

A Compiler-Compiler for DSL Embedding

A Comparative Study of DSL Code Generation: Fine-Tuning vs. Optimized Retrieval Augmentation

AI Coders Are Among Us: Rethinking Programming Language Grammar Towards Efficient Code Generation

Building-Blocks for Performance Oriented DSLs

No Man is an Island: Towards Fully Automatic Programming by Code Search, Code Generation and Program Repair

From a Natural to a Formal Language with DSL Assistant

Assessing Code Generation with Intermediate Languages

DeepDSL: A Compilation-based Domain-Specific Language for Deep Learning

ProgAI: Enhancing Code Generation with LLMs For Real World Challenges

CompCodeVet: A Compiler-guided Validation and Enhancement Approach for Code Dataset

Automatic Generation of Frontend Code from Design Interface

AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents

Code-Optimise: Self-Generated Preference Data for Correctness and Efficiency

AutoDSL: Automated domain-specific language design for structural representation of procedures with constraints