Abstract:The increasing complexity of modern very-large-scale integration (VLSI) design highlights the significance of Electronic Design Automation (EDA) technologies. Chip placement is a critical step in the EDA workflow, which positions chip modules on the canvas with the goal of optimizing performance, power, and area (PPA) metrics of final chip designs. Recent advances have demonstrated the great potential of AI-based algorithms in enhancing chip placement. However, due to the lengthy workflow of chip design, the evaluations of these algorithms often focus on intermediate surrogate metrics, which are easy to compute but frequently reveal a substantial misalignment with the end-to-end performance (i.e., the final design PPA). To address this challenge, we introduce ChiPBench, which can effectively facilitate research in chip placement within the AI community. ChiPBench is a comprehensive benchmark specifically designed to evaluate the effectiveness of existing AI-based chip placement algorithms in improving final design PPA metrics. Specifically, we have gathered 20 circuits from various domains (e.g., CPU, GPU, and microcontrollers). These designs are compiled by executing the workflow from the verilog source code, which preserves necessary physical implementation kits, enabling evaluations for the placement algorithms on their impacts on the final design PPA. We executed six state-of-the-art AI-based chip placement algorithms on these designs and plugged the results of each single-point algorithm into the physical implementation workflow to obtain the final PPA results. Experimental results show that even if intermediate metric of a single-point algorithm is dominant, while the final PPA results are unsatisfactory. We believe that our benchmark will serve as an effective evaluation framework to bridge the gap between academia and industry.

Understanding the Architectural Characteristics of EDA Algorithms

Accelerating RTL Quality Assessment Method Based on CAD Tools

A Fast Method for Reconfigurable Architecture Design Space Exploration

Automatic Design of CPU Development Tool Chain

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

AIBench: An Agile Domain-specific Benchmarking Methodology and an AI Benchmark Suite

An accelerator-aware microarchitecture simulator for design space exploration

GARDENIA: A Domain-specific Benchmark Suite for Next-generation Accelerators

Electronic Design Automation With Graphic Processors: A Survey

Benchmarking End-To-End Performance of AI-Based Chip Placement Algorithms

iEDA: An Open-Source Intelligent Physical Implementation Toolkit and Library

The Survey of Chiplet-based Integrated Architecture: An EDA perspective

Ieda: an Open-source Infrastructure of EDA

Invited Paper: Accelerating Routability and Timing Optimization with Open-Source AI4EDA Dataset CircuitNet and Heterogeneous Platforms

Eliminating Timing Errors Through Collaborative Design to Maximize the Throughput

Workshops on Extreme Scale Design Automation (ESDA) Challenges and Opportunities for 2025 and Beyond

Toward EDA Computing on GPUs

ANALYSIS AND COMPARISON OF A FEW ARCHITECTURE SIMULATOR ACCELERATION TECHNOLOGIES

Deep submicron trends and implications on electronic design automation

RESEARCH ON BENCHMARKS IN COMPUTER ARCHITECTURE

AI-assisted Synthesis in Next Generation EDA: Promises, Challenges, and Prospects.