Abstract:Despite the effort of analog circuit design automation, currently complex analog circuit design still requires extensive manual iterations, making it labor intensive and time-consuming. Recently, reinforcement learning (RL) algorithms have been demonstrated successfully for the analog circuit design optimization. However, a robust and highly efficient RL method to design analog circuits with complex design space has not been fully explored yet. In this work, inspired by multiagent planning theory as well as human expert design practice, we propose a multiagent based RL (MA-RL) framework to tackle this issue. Particularly, we (i) partition the complex analog circuits into several sub-blocks based on topology information and effectively reduce the complexity of design search space; (ii) leverage MA-RL for the circuit optimization, where each agent corresponds to a single sub-block, and the interactions between agents delicately mimic the best design tradeoffs between circuit sub-blocks by human experts; (iii) introduce and compare three different multiagent RL algorithms and corresponding frameworks to demonstrate the effectiveness of the MA-RL method. (iv) employing twin-delayed techniques and proximal policy to further boost training stability and accomplish higher performances. (v) The impacts of different reward function definitions as well as different state settings of MA-RL agents are investigated to further improve the robustness of this framework. (vi) Experiments on three different complex analog circuit topologies (GBA, DLL and SAR ADC) and knowledge transfers between two technology nodes are demonstrated. It’s shown that MA-RL framework can achieve the best FoM for complex analog circuits’ design. This work shines the light for future large scale analog circuit system design automation.

ML-based Routing Guidance Generation Data Pre-processing Trained ML Model Guided AMS Routing Guided Detailed Routing Post-processing ML Model Training AMS Circuit Layout Database Dashed : Training Solid : Inference Fr am ew or k Placement Routed Layout

GeniusRoute: A New Analog Routing Paradigm Using Generative Neural Network Guidance

Performance-driven Routing Methodology with Incremental Placement Refinement for Analog Layout Design

A routing framework for technology migration with bump encroachment

Toward silicon-proven detailed routing for analog and mixed-signal circuits

SAGERoute: Synergistic Analog Routing Considering Geometric and Electrical Constraints with Manual Design Compatibility

Multi-Scenario Analog and Mixed-Signal Circuit Routing with Agile Human Interaction (Extended Abstract)

MAGICAL 1.0: An Open-Source Fully-Automated AMS Layout Synthesis Framework Verified With a 40-nm 1GS/s ADC

Fast ML-driven Analog Circuit Layout using Reinforcement Learning and Steiner Trees

SAGERoute 2.0: Hierarchical Analog and Mixed Signal Routing Considering Versatile Routing Scenarios

Track-Assignment Detailed Routing Using Attention-based Policy Model With Supervision

Interactive Analog Layout Editing with Instant Placement and Routing Legalization

A Structure-Based Methodology for Analog Layout Generation

Process Route and Layout Design Method for Reconfigurable Manufacturing Systems

Towards Machine Learning for Placement and Routing in Chip Design: a Methodological Overview

Intelligent and Interactive Analog Layout Design Automation

An Analytical Placement Algorithm with Routing Topology Optimization

Multiagent Based Reinforcement Learning (MA-RL): an Automated Designer for Complex Analog Circuits

Challenges and opportunities toward fully automated analog layout design

A Survey on Machine Learning-Based Routing for VLSI Physical Design

Analog routing considering min-area constraint