AutoCkt: Deep Reinforcement Learning of Analog Circuit Designs

Keertana Settaluri,Ameer Haj-Ali,Qijing Huang,Kourosh Hakhamaneshi,Borivoje Nikolic

DOI: https://doi.org/10.48550/arXiv.2001.01808

2020-01-21

Abstract:Domain specialization under energy constraints in deeply-scaled CMOS has been driving the need for agile development of Systems on a Chip (SoCs). While digital subsystems have design flows that are conducive to rapid iterations from specification to layout, analog and mixed-signal modules face the challenge of a long human-in-the-middle iteration loop that requires expert intuition to verify that post-layout circuit parameters meet the original design specification. Existing automated solutions that optimize circuit parameters for a given target design specification have limitations of being schematic-only, inaccurate, sample-inefficient or not generalizable. This work presents AutoCkt, a machine learning optimization framework trained using deep reinforcement learning that not only finds post-layout circuit parameters for a given target specification, but also gains knowledge about the entire design space through a sparse subsampling technique. Our results show that for multiple circuit topologies, AutoCkt is able to converge and meet all target specifications on at least 96.3% of tested design goals in schematic simulation, on average 40X faster than a traditional genetic algorithm. Using the Berkeley Analog Generator, AutoCkt is able to design 40 LVS passed operational amplifiers in 68 hours, 9.6X faster than the state-of-the-art when considering layout parasitics.

Signal Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the problems of low degree of automation, long design cycle and strong dependence on human experience in the analog circuit design process under modern CMOS technology nodes. Specifically, the existing automated solutions have limitations when optimizing circuit parameters to meet specific design specifications, such as being limited to the schematic level, having poor accuracy, low sample efficiency or insufficient generalization ability. These problems make it difficult to achieve rapid iteration from specifications to layout, especially in analog and mixed - signal modules, where expert intuition is required to verify whether the circuit parameters after layout meet the original design specifications, and this process is usually very time - consuming and complex. To address these challenges, the paper proposes AutoCkt, a machine - learning optimization framework based on deep reinforcement learning, which aims not only to find the post - layout circuit parameters that meet the given target specifications, but also to acquire knowledge in the entire design space through sparse sub - sampling techniques. The test results of AutoCkt on multiple circuit topologies show that it can converge to at least 96.3% of the test design goals in schematic simulation on average 40 times faster than the traditional genetic algorithm, and in the case of considering layout parasitic parameters, it can design 40 LVS - passed operational amplifiers within 68 hours using the Berkeley Analog Generator, which is 9.6 times faster than the existing technology.

AutoCkt: Deep Reinforcement Learning of Analog Circuit Designs

Domain Knowledge-Based Automated Analog Circuit Design with Deep Reinforcement Learning

Domain Knowledge-Infused Deep Learning for Automated Analog/Radio-Frequency Circuit Parameter Optimization

Learning to Design Circuits

RLCkt: an Analog Circuit Automatic Sizing Sage Based on Reinforcement Learning

Machine Learning Driven Global Optimisation Framework for Analog Circuit Design

Procedural- and Reinforcement-Learning-Based Automation Methods for Analog Integrated Circuit Sizing in the Electrical Design Space

Pareto Optimization of Analog Circuits Using Reinforcement Learning

Learning to Design Analog Circuits to Meet Threshold Specifications

An Open-Source AMS Circuit Optimization Framework Based on Reinforcement Learning—From Specifications to Layouts

Automated Design of Complex Analog Circuits with Multiagent Based Reinforcement Learning.

Circuit Optimization over Multiple Process Corners for Analog Electronic Design Automation.

Incremental reinforcement learning for multi-objective analog circuit design acceleration

AnalogCoder: Analog Circuit Design via Training-Free Code Generation

Graph Theory Based Machine Learning for Analog Circuit Design

RobustAnalog: Fast Variation-Aware Analog Circuit Design Via Multi-task RL

AICircuit: A Multi-Level Dataset and Benchmark for AI-Driven Analog Integrated Circuit Design

Closing the Gap between Electrical and Physical Design Steps with an Analog IC Placement Optimizer Enhanced with Machine-Learning-Based Post-Layout Performance Regressors

An Efficient Analog Circuit Sizing Method Based on Machine Learning Assisted Global Optimization

CktGNN: Circuit Graph Neural Network for Electronic Design Automation

Automated design and optimization of distributed filter circuits using reinforcement learning