Abstract:High-level synthesis (HLS) allows hardware designers to create hardware designs with high-level programming languages like C/C++/OpenCL, which greatly improves hardware design productivity. However, existing HLS flows require programmers' hardware design expertise and rely on programmers' manual code transformations and directive annotations to guide compiler optimizations. Optimizing HLS designs requires non-trivial HLS expertise and tedious iterative process in HLS code optimization. Automating HLS code optimizations has become a burning need. Recently, large language models (LLMs) trained on massive code and programming tasks have demonstrated remarkable proficiency in comprehending code, showing the ability to handle domain-specific programming queries directly without labor-intensive fine-tuning. In this work, we propose a novel retrieval-augmented LLM-based approach to effectively optimize high-level synthesis (HLS) programs. Our proposed method leverages few-shot learning, enabling large language models to adopt domain-specific knowledge through natural language prompts. We propose a unique framework, Retrieve Augmented Large Language Model Aided Design (RALAD), designed to enhance LLMs' performance in HLS code optimization tasks. RALAD employs advanced embedding techniques and top-\emph{k} search algorithms to dynamically source relevant knowledge from extensive databases, thereby providing contextually appropriate responses to complex programming queries. Our implementation of RALAD on two specialized domains, utilizing comparatively smaller language models, achieves an impressive 80\% success rate in compilation tasks and outperforms general LLMs by 3.7 -- 19$\times$ in latency improvement.

Too Big to Fail? Active Few-Shot Learning Guided Logic Synthesis

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

Logic Synthesis Optimization Sequence tuning using RL-based LSTM and Graph Isomorphism Network

MTLSO: A Multi-Task Learning Approach for Logic Synthesis Optimization

HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis

Large Language Models Synergize with Automated Machine Learning

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization

Towards Neural-Guided Program Synthesis for Linear Temporal Logic Specifications

Does Few-Shot Learning Help LLM Performance in Code Synthesis?

OpenLS-DGF: An Adaptive Open-Source Dataset Generation Framework for Machine Learning Tasks in Logic Synthesis

Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models

Guiding Enumerative Program Synthesis with Large Language Models

AISYN: AI-driven Reinforcement Learning-Based Logic Synthesis Framework

COOL: Efficient and Reliable Chain-Oriented Objective Logic with Neural Networks Feedback Control for Program Synthesis

Towards Mixed Optimization for Reinforcement Learning with Program Synthesis

Optimizing High-Level Synthesis Designs with Retrieval-Augmented Large Language Models

Program synthesis using conflict-driven learning

An Efficient Reinforcement Learning Based Framework for Exploring Logic Synthesis

Fe b 20 18 Learning to Synthesize