Abstract:The complexity of chip design has consistently grown, adhering to Moore’s law. In this paper, we examine a crucial step in integrated circuit design called chip macro placement. Traditionally, human experts are consulted to optimize placement for reduced power consumption, but this requires significant effort. Recently, machine learning-based methods have emerged to address this task, showing promising results. Our work aims to tackle key bottlenecks in current reinforcement learning (RL) based methods, which often suffer from sparse rewards, large state–action search spaces, and unstable training, resulting in suboptimal solutions. To address these issues, we propose a novel approach called Hierarchical Reinforcement Learning for Placement (HRLP). This method distinguishes itself in two ways. First, we introduce a hierarchical RL framework that learns human expert design patterns by assigning agent-specific placement sub-tasks (referred to as options in reinforcement learning) instead of primitive actions at each time step within an episode. Second, we generate dense rewards for each episode by calculating the difference in local wirelength and congestion. We conducted experiments on eight public chip design benchmarks, adaptec and bigblue series. Our model has an average improvement of 9.29 % and 14.25 % on Half Perimeter Wire Length (HPWL), the huge improvement shows that our method is capable of converging to a better sub-optimal than DeepPlace and providing a promising future for AI to aid the design of circuit placement.

Multi-Corner Timing Macro Modeling With Neural Collaborative Filtering From Recommendation Systems Perspective

Multi-Corner Timing Analysis Acceleration for Iterative Physical Design of ICs

Fast Machine-Learning-Driven Supply Noise-Aware Macromodeling for High-Speed Nonlinear Drivers

Heterogeneous Static Timing Analysis with Advanced Delay Calculator

Toward Reinforcement Learning-based Rectilinear Macro Placement Under Human Constraints

Correlated Bayesian Model Fusion: Efficient High-Dimensional Performance Modeling of Analog/RF Integrated Circuits over Multiple Corners

Macro modeling of liquid crystal cell using machine learning method: reservoir computing approach

Experimental Evaluation of Statistical Model Checking Methods for Probabilistic Timing Analysis of Multiprocessor Systems

IncreMacro: Incremental Macro Placement Refinement

Eliminating Timing Errors Through Collaborative Design to Maximize the Throughput

Restructure-Tolerant Timing Prediction via Multimodal Fusion

Timing-Driven Technology Mapping Approximation Based on Reinforcement Learning

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

MNSIM-TIME: Performance Modeling Framework for Training-In-Memory Architectures

Timing Model Reduction for Hierarchical Timing Analysis

Useful Clock Skew Optimization under a Multi-Corner Multi-Mode Design Framework

On Timing Model Extraction and Hierarchical Statistical Timing Analysis

A Crosstalk-Aware Timing Prediction Method in Routing

Hierarchical Reinforcement Learning for Chip-Macro Placement in Integrated Circuit

Efficient Performance Modeling for Automated CMOS Analog Circuit Synthesis

Reinforcement Learning Within Tree Search for Fast Macro Placement