Abstract:Analog IC design relies on human experts to search for parameters that satisfy circuit specifications with their experience and intuitions, which is highly labor intensive, time consuming and suboptimal. Machine learning is a promising tool to automate this process. However, supervised learning is difficult for this task due to the low availability of training data: 1) Circuit simulation is slow, thus generating large-scale dataset is time-consuming; 2) Most circuit designs are propitiatory IPs within individual IC companies, making it expensive to collect large-scale datasets. We propose Learning to Design Circuits (L2DC) to leverage reinforcement learning that learns to efficiently generate new circuits data and to optimize circuits. We fix the schematic, and optimize the parameters of the transistors automatically by training an RL agent with no prior knowledge about optimizing circuits. After iteratively getting observations, generating a new set of transistor parameters, getting a reward, and adjusting the model, L2DC is able to optimize circuits. We evaluate L2DC on two transimpedance amplifiers. Trained for a day, our RL agent can achieve comparable or better performance than human experts trained for a quarter. It first learns to meet hard-constraints (eg. gain, bandwidth), and then learns to optimize good-to-have targets (eg. area, power). Compared with grid search-aided human design, L2DC can achieve $\mathbf{250}\boldsymbol{\times}$ higher sample efficiency with comparable performance. Under the same runtime constraint, the performance of L2DC is also better than Bayesian Optimization.

Optimization Algorithm Design via Electric Circuits

Multi-objective Design and Optimization of Inductors: A Generalized Software-Driven Approach

Optimization Algorithm of Evolutionary Design of Circuits Based on Genetic Algorithm

An Equivalent Circuit Workflow for Unconstrained Optimization

Efficient Design of Rotary Traveling Wave Oscillator Array Via Geometric Programming

An optimization-based approach to automated design

An Improved Tabu-Based Vector Optimal Algorithm for Design Optimizations of Electromagnetic Devices

Efficient Approach for Monte Carlo Simulation Experiments and Its Applications to Circuit Systems Design

A Response Surface Methodology Based On Improved Compactly Supported Radial Basis Function And Its Application To Rapid Optimizations Of Electromagnetic Devices

A Global Optimization Algorithm Based on C-1 Piecewise Response Surface Patches

Frequency-Domain Analysis of Distributed Optimization: Fundamental Convergence Rate and Optimal Algorithm Synthesis

Fixed-Time Neurodynamic Optimization Algorithms and Application to Circuits Design

Analog Circuit Optimization System Based on Hybrid Evolutionary Algorithms

Optimization and Quality Estimation of Circuit Design Via Random Region Covering Method

Learning to Design Circuits

An Equivalent Circuit Approach to Distributed Optimization

Circuit Optimization over Multiple Process Corners for Analog Electronic Design Automation.

Oscillator-based optimization: design, emulation, and implementation

Pareto Optimization of Analog Circuits Using Reinforcement Learning

Optimal Design of Electric Machine with Efficient Handling of Constraints and Surrogate Assistance

Circuits for robust designs