ORAssistant: A Custom RAG-based Conversational Assistant for OpenROAD

Aviral Kaintura,Palaniappan R,Shui Song Luar,Indira Iyer Almeida

2024-10-05

Abstract:Open-source Electronic Design Automation (EDA) tools are rapidly transforming chip design by addressing key barriers of commercial EDA tools such as complexity, costs, and access. Recent advancements in Large Language Models (LLMs) have further enhanced efficiency in chip design by providing user assistance across a range of tasks like setup, decision-making, and flow automation. This paper introduces ORAssistant, a conversational assistant for OpenROAD, based on Retrieval-Augmented Generation (RAG). ORAssistant aims to improve the user experience for the OpenROAD flow, from RTL-GDSII by providing context-specific responses to common user queries, including installation, command usage, flow setup, and execution, in prose format. Currently, ORAssistant integrates OpenROAD, OpenROAD-flow-scripts, Yosys, OpenSTA, and KLayout. The data model is built from publicly available documentation and GitHub resources. The proposed architecture is scalable, supporting extensions to other open-source tools, operating modes, and LLM models. We use Google Gemini as the base LLM model to build and test ORAssistant. Early evaluation results of the RAG-based model show notable improvements in performance and accuracy compared to non-fine-tuned LLMs.

Computation and Language,Hardware Architecture

What problem does this paper attempt to address?

The paper attempts to address common issues faced by users in open-source Electronic Design Automation (EDA) tools, particularly within the OpenROAD toolchain, during chip design processes such as installation, command usage, process setup, and execution. These issues are often difficult to resolve effectively due to the outdated nature of traditional user resources like documentation and tutorials. The paper proposes a conversational assistant, ORAssistant, based on Retrieval-Augmented Generation (RAG) technology, aimed at improving user experience by providing context-relevant responses to help users efficiently complete basic tasks in the design flow from RTL to GDSII. ORAssistant achieves this goal by integrating multiple open-source tools and resources, such as OpenROAD-flow-scripts, Yosys, OpenSTA, and KLayout, and by leveraging publicly available documentation and GitHub resources to build its data model. Additionally, the paper introduces the dataset generation method for ORAssistant, the RAG architecture, and its evaluation framework, demonstrating significant improvements in performance and accuracy.