Abstract:Large Language Models (LLMs) have shown great potential in automating code generation; however, their ability to generate accurate circuit-level SPICE code remains limited due to a lack of hardware-specific knowledge. In this paper, we analyze and identify the typical limitations of existing LLMs in SPICE code generation. To address these limitations, we present SPICEPilot a novel Python-based dataset generated using PySpice, along with its accompanying framework. This marks a significant step forward in automating SPICE code generation across various circuit configurations. Our framework automates the creation of SPICE simulation scripts, introduces standardized benchmarking metrics to evaluate LLM's ability for circuit generation, and outlines a roadmap for integrating LLMs into the hardware design process. SPICEPilot is open-sourced under the permissive MIT license at <a class="link-external link-https" href="https://github.com/ACADLab/SPICEPilot.git" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the field of hardware design, especially in analog circuit design, large language models (LLMs) have limited ability to generate accurate SPICE code. Specifically, the paper points out that although LLMs show great potential in automated code generation, there are still limitations in generating accurate circuit - level SPICE code, mainly due to the lack of hardware - specific knowledge. These problems include, but are not limited to: 1. **Misunderstanding of gate width and length**: LLMs make mistakes in defining and selecting the gate length and gate width in SPICE code, which directly affects the performance of the circuit. For example, for many standard design practices, the 2:1 gate width ratio between PMOS and NMOS is crucial, but LLMs often fail to correctly understand and apply this ratio. 2. **Inability to perform circuit analysis**: SPICE simulation is a powerful tool for various forms of circuit analysis, such as transient analysis, DC analysis, and AC analysis. However, LLMs are usually unable to independently select and perform the appropriate type of analysis based on the operational requirements of the circuit. 3. **Incorrect input signal assignment and device parameter configuration**: In SPICE simulation, accurate input signal assignment and device parameter configuration are crucial for circuit testing. However, LLMs often fail to correctly assign input signals according to the functional requirements of the circuit or ignore the setting of basic parameters (such as operating temperature), which have an important impact on the behavior of semiconductor devices. To solve the above problems, the paper proposes the **SPICEPilot** framework, a new Python - based dataset and accompanying framework, which aims to improve the performance of LLMs in SPICE code generation in the following ways: - **Generate high - quality datasets**: Use the PySpice library to generate a Python - based SPICE code dataset containing multiple transistor models and circuit configurations to make up for the problem of data scarcity. - **Introduce standardized benchmarking metrics**: Evaluate the performance of LLMs in circuit generation to ensure that innovations meet the required specifications and industry standards. - **Propose a future development roadmap**: Outline how to further optimize the application of LLMs in analog circuit design, including methods to enhance logical reasoning ability, autonomously generate or enhance the required datasets, etc. Through these measures, the SPICEPilot framework aims to improve the automation level of LLMs in hardware design tasks, especially in SPICE code generation, thereby accelerating the circuit design process and improving its efficiency.

SPICEPilot: Navigating SPICE Code Generation and Simulation with AI Guidance

Masala-CHAI: A Large-Scale SPICE Netlist Dataset for Analog Circuits by Harnessing AI

HLSPilot: LLM-based High-Level Synthesis

IICPilot: An Intelligent Integrated Circuit Backend Design Framework Using Open EDA

HPC-Coder-V2: Studying Code LLMs Across Low-Resource Parallel Languages

SA-DS: A Dataset for Large Language Model-Driven AI Accelerator Design Generation

LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automation

MemSPICE: Automated Simulation and Energy Estimation Framework for MAGIC-Based Logic-in-Memory

A Python Framework for SPICE Circuit Simulation of In-Memory Analog Computing Circuits

Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming

Schemato -- An LLM for Netlist-to-Schematic Conversion

From Text to Test: AI-Generated Control Software for Materials Science Instruments

Advanced Large Language Model (LLM)-Driven Verilog Development: Enhancing Power, Performance, and Area Optimization in Code Synthesis

HDLCopilot: Natural Language Exploration of Hardware Designs and Libraries

CodeV: Empowering LLMs for Verilog Generation through Multi-Level Summarization

AutoChip: Automating HDL Generation Using LLM Feedback

An Empirical Study of the Code Generation of Safety-Critical Software Using LLMs

SPICED: Syntactical Bug and Trojan Pattern Identification in A/MS Circuits using LLM-Enhanced Detection

A Fast Parallel Sparse Solver for SPICE-based Circuit Simulators.

Python Framework for Modular and Parametric SPICE Netlists Generation

HPC-Coder: Modeling Parallel Programs using Large Language Models