Abstract:Large language models (LLMs) have catalyzed an upsurge in automatic code generation, garnering significant attention for register transfer level (RTL) code generation. Despite the potential of RTL code generation with natural language, it remains error-prone and limited to relatively small modules because of the substantial semantic gap between natural language expressions and hardware design intent. In response to the limitations, we propose a methodology that reduces the semantic gaps by utilizing C/C++ for generating hardware designs via High-Level Synthesis (HLS) tools. Basically, we build a set of C-to-HLS optimization strategies catering to various code patterns, such as nested loops and local arrays. Then, we apply these strategies to sequential C/C++ code through in-context learning, which provides the LLMs with exemplary C/C++ to HLS prompts. With this approach, HLS designs can be generated effectively. Since LLMs still face problems in determining the optimized pragma parameters precisely, we have a design space exploration (DSE) tool integrated for pragma parameter tuning. Furthermore, we also employ profiling tools to pinpoint the performance bottlenecks within a program and selectively convert bottleneck components to HLS code for hardware acceleration. By combining the LLM-based profiling, C/C++ to HLS translation, and DSE, we have established HLSPilot, the first LLM-enabled high-level synthesis framework, which can fully automate the high-level application acceleration on hybrid CPU-FPGA architectures. According to our experiments on real-world application benchmarks, HLSPilot achieve comparable performance in general and can even outperform manually crafted counterparts, thereby underscoring the substantial promise of LLM-assisted hardware designs.

A High-level Language and Its Compiler System for a Media Processor

Design of VxWorks-based High-performance Embedded Control Platform

Design of a Media-Enhanced and Reconfigurable RISC ,Microprocessor

Architecture Design of Media SoC Based on Microprocessor Core

VLSI Implementation of an Embeded VLIW Application Specific Processor for Speech Compression

Design of a Programmable Application Specific Processor for Speech Compression

An advanced compiler designed for a VLIW DSP for sensors-based systems.

Design of H.264/AVC Video Coder Based on Mixed Architecture

OS-Level IPC Implementation in Complementary Multi-processor Systems

ASIP Approach for Multimedia Applications Based on a Scalable VLIW DSP Architecture

HLSPilot: LLM-based High-Level Synthesis

Media processor hardware/software co-simulation and co-verification platform

A Compilation Method for Zero Overhead Loop in DSPs with VLIW.

Design and Application of Programmable Speech Processor

Programming Heterogeneous Systems from an Image Processing DSL

Preprocessing Scheme of Intelligent Assembly for a High Performance VLIW DSP.

SL: a "quick and dirty" but working intermediate language for SVP systems

Design And Implementation Of Reconfigurable Stream Processor In Multimedia Applications

SPUR Programming Model for to Embedded Media Processing Architecture

A Software Pipelining Based VLIW Architecture and Optimizing Compiler

C2HLSC: Leveraging Large Language Models to Bridge the Software-to-Hardware Design Gap