Abstract:The complexity of chip design has consistently grown, adhering to Moore’s law. In this paper, we examine a crucial step in integrated circuit design called chip macro placement. Traditionally, human experts are consulted to optimize placement for reduced power consumption, but this requires significant effort. Recently, machine learning-based methods have emerged to address this task, showing promising results. Our work aims to tackle key bottlenecks in current reinforcement learning (RL) based methods, which often suffer from sparse rewards, large state–action search spaces, and unstable training, resulting in suboptimal solutions. To address these issues, we propose a novel approach called Hierarchical Reinforcement Learning for Placement (HRLP). This method distinguishes itself in two ways. First, we introduce a hierarchical RL framework that learns human expert design patterns by assigning agent-specific placement sub-tasks (referred to as options in reinforcement learning) instead of primitive actions at each time step within an episode. Second, we generate dense rewards for each episode by calculating the difference in local wirelength and congestion. We conducted experiments on eight public chip design benchmarks, adaptec and bigblue series. Our model has an average improvement of 9.29 % and 14.25 % on Half Perimeter Wire Length (HPWL), the huge improvement shows that our method is capable of converging to a better sub-optimal than DeepPlace and providing a promising future for AI to aid the design of circuit placement.

Floorplanning with Edge-Aware Graph Attention Network and Hindsight Experience Replay

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

Floorplanning with Graph Attention

GraphPlanner: Floorplanning with Graph Neural Network.

Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning

A graph placement methodology for fast chip design

Learning Placement Order for Constructive Floorplanning

Chip Placement with Deep Reinforcement Learning

Multi-objective optimization in fixed-outline floorplanning with reinforcement learning

Hierarchical Reinforcement Learning for Chip-Macro Placement in Integrated Circuit

Hierarchical Graph Learning-Based Floorplanning with Dirichlet Boundary Conditions

Non-Overlapping Placement of Macro Cells based on Reinforcement Learning in Chip Design

Large Reasoning Models for 3D Floorplanning in EDA: Learning from Imperfections

Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning

Fast ML-driven Analog Circuit Layout using Reinforcement Learning and Steiner Trees

Network planning with deep reinforcement learning

On Joint Learning for Solving Placement and Routing in Chip Design

2.5d Floorplan Based Annealed Neural Networks For Circuit Partitioning

Graph2Plan: Learning Floorplan Generation from Layout Graphs

Floorplan and Power/Ground network co-design using guided incremental floorplanning

Floorplanning of VLSI by Mixed-Variable Optimization