Abstract:Despite the effort of analog circuit design automation, currently complex analog circuit design still requires extensive manual iterations, making it labor intensive and time-consuming. Recently, reinforcement learning (RL) algorithms have been demonstrated successfully for the analog circuit design optimization. However, a robust and highly efficient RL method to design analog circuits with complex design space has not been fully explored yet. In this work, inspired by multiagent planning theory as well as human expert design practice, we propose a multiagent based RL (MA-RL) framework to tackle this issue. Particularly, we (i) partition the complex analog circuits into several sub-blocks based on topology information and effectively reduce the complexity of design search space; (ii) leverage MA-RL for the circuit optimization, where each agent corresponds to a single sub-block, and the interactions between agents delicately mimic the best design tradeoffs between circuit sub-blocks by human experts; (iii) introduce and compare three different multiagent RL algorithms and corresponding frameworks to demonstrate the effectiveness of the MA-RL method. (iv) employing twin-delayed techniques and proximal policy to further boost training stability and accomplish higher performances. (v) The impacts of different reward function definitions as well as different state settings of MA-RL agents are investigated to further improve the robustness of this framework. (vi) Experiments on three different complex analog circuit topologies (GBA, DLL and SAR ADC) and knowledge transfers between two technology nodes are demonstrated. It’s shown that MA-RL framework can achieve the best FoM for complex analog circuits’ design. This work shines the light for future large scale analog circuit system design automation.

Fast ML-driven Analog Circuit Layout using Reinforcement Learning and Steiner Trees

Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

ML-based Routing Guidance Generation Data Pre-processing Trained ML Model Guided AMS Routing Guided Detailed Routing Post-processing ML Model Training AMS Circuit Layout Database Dashed : Training Solid : Inference Fr am ew or k Placement Routed Layout

Closing the Gap between Electrical and Physical Design Steps with an Analog IC Placement Optimizer Enhanced with Machine-Learning-Based Post-Layout Performance Regressors

A graph placement methodology for fast chip design

MAGICAL: Toward Fully Automated Analog IC Layout Leveraging Human and Machine Intelligence: Invited Paper.

Exploiting a Deep Learning Toolbox for Human-Machine Feedback towards Analog Integrated Circuit Placement Automation

Performance-driven Routing Methodology with Incremental Placement Refinement for Analog Layout Design

An Open-Source AMS Circuit Optimization Framework Based on Reinforcement Learning—From Specifications to Layouts

Hierarchical Reinforcement Learning for Chip-Macro Placement in Integrated Circuit

Automated Design of Complex Analog Circuits with Multiagent Based Reinforcement Learning.

Performance-driven X-architecture Routing Algorithm for Artificial Intelligence Chip Design in Smart Manufacturing

AutoCkt: Deep Reinforcement Learning of Analog Circuit Designs

Automatic layout synthesis of analog ICs using circuit recognition and constraint analysis techniques

Circuit Routing Using Monte Carlo Tree Search and Deep Neural Networks

Multiagent Based Reinforcement Learning (MA-RL): an Automated Designer for Complex Analog Circuits

A Novel Performance-Driven Automatic Layout Tool for Analog Circuit

Procedural- and Reinforcement-Learning-Based Automation Methods for Analog Integrated Circuit Sizing in the Electrical Design Space

Domain Knowledge-Based Automated Analog Circuit Design with Deep Reinforcement Learning

Practical Layout-Aware Analog/Mixed-Signal Design Automation with Bayesian Neural Networks