Abstract:High-level synthesis (HLS) is an automated design process that transforms high-level code into hardware designs, enabling the rapid development of hardware accelerators. HLS relies on pragmas, which are directives inserted into the source code to guide the synthesis process, and pragmas have various settings and values that significantly impact the resulting hardware design. State-of-the-art ML-based HLS methods, such as HARP, first train a deep learning model, typically based on graph neural networks (GNNs) applied to graph-based representations of the source code and pragmas. They then perform design space exploration (DSE) to explore the pragma design space, rank candidate designs using the model, and return the top designs. However, traditional DSE methods face challenges due to the highly nonlinear relationship between pragma settings and performance metrics, along with complex interactions between pragmas that affect performance in non-obvious ways. To address these challenges, we propose compareXplore, a novel approach that learns to compare hardware designs for effective HLS optimization. CompareXplore introduces a hybrid loss function that combines pairwise preference learning with pointwise performance prediction, enabling the model to capture both relative preferences and absolute performance. Moreover, we introduce a novel node difference attention module that focuses on the most informative differences between designs, enabling the model to identify critical pragmas impacting performance. CompareXplore adopts a two-stage DSE, where a pointwise prediction model is used for the initial design pruning, followed by a pairwise comparison stage for precise performance verification. In extensive experiments, compareXplore achieves significant improvements in ranking metrics and generates high-quality HLS results for the selected designs, outperforming the existing SOTA method.

Optimizing High-Level Synthesis Designs with Retrieval-Augmented Large Language Models

HLSPilot: LLM-based High-Level Synthesis

Are LLMs Any Good for High-Level Synthesis?

Advanced Large Language Model (LLM)-Driven Verilog Development: Enhancing Power, Performance, and Area Optimization in Code Synthesis

C2HLSC: Leveraging Large Language Models to Bridge the Software-to-Hardware Design Gap

Automated C/C++ Program Repair for High-Level Synthesis via Large Language Models

Evaluating Large Language Models for Automatic Register Transfer Logic Generation via High-Level Synthesis

C2HLSC: Can LLMs Bridge the Software-to-Hardware Design Gap?

Large Language Models Synergize with Automated Machine Learning

Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS

New Solutions on LLM Acceleration, Optimization, and Application

Learning to Compare Hardware Designs for High-Level Synthesis

Cross-Modality Program Representation Learning for Electronic Design Automation with High-Level Synthesis

Benchmarking Large Language Models for Automated Verilog RTL Code Generation

Machine-Learning driven Auto-Tuning of High-Level Synthesis for FPGAs (Abstract Only)

High-level synthesis: productivity, performance, and software constraints

RTLRewriter: Methodologies for Large Models aided RTL Code Optimization

ReaLHF: Optimized RLHF Training for Large Language Models through Parameter Reallocation

Fully Autonomous Programming with Large Language Models

HDLdebugger: Streamlining HDL debugging with Large Language Models

Data is all you need: Finetuning LLMs for Chip Design via an Automated design-data augmentation framework