Abstract:This paper proposes a learning framework, RoSE-Opt, to achieve robust and efficient analog circuit parameter optimization. RoSE-Opt has two important features. First, it incorporates key domain knowledge of analog circuit design, such as circuit topology, couplings between circuit specifications, and variations of process, supply voltage, and temperature, into the learning loop. This strategy facilitates the training of an artificial agent capable of achieving design goals by identifying device parameters that are optimal and robust. Second, it exploits a two-level optimization method, that is, integrating Bayesian optimization (BO) with reinforcement learning (RL) to improve sample efficiency. In particular, BO is used for a coarse yet quick search of an initial starting point for optimization. This sets a solid foundation to efficiently train the RL agent with fewer samples. Experimental evaluations on benchmarking circuits show promising sample efficiency, extraordinary figure-of-merit in terms of design efficiency and design success rate, and Pareto optimality in circuit performance of our framework, compared to previous methods. Furthermore, this work thoroughly studies the performance of different RL optimization algorithms, such as Deep Deterministic Policy Gradients (DDPG) with an off-policy learning mechanism and Proximal Policy Optimization (PPO) with an on-policy learning mechanism. This investigation provides users with guidance on choosing the appropriate RL algorithms to optimize the device parameters of analog circuits. Finally, our study also demonstrates RoSE-Opt's promise in parasitic-aware device optimization for analog circuits. In summary, our work reports a knowledge-infused BO-RL design automation framework for reliable and efficient optimization of analog circuits' device parameters.

An Open-Source AMS Circuit Optimization Framework Based on Reinforcement Learning—From Specifications to Layouts

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

LEDRO: LLM-Enhanced Design Space Reduction and Optimization for Analog Circuits

Multiagent Based Reinforcement Learning (MA-RL): an Automated Designer for Complex Analog Circuits

Automated Design of Complex Analog Circuits with Multiagent Based Reinforcement Learning.

TOTAL: Topology Optimization of Operational Amplifier via Reinforcement Learning

RoSE-Opt: Robust and Efficient Analog Circuit Parameter Optimization with Knowledge-infused Reinforcement Learning

An efficient leakage power optimization framework based on reinforcement learning with graph neural network

AutoCkt: Deep Reinforcement Learning of Analog Circuit Designs

Learning to Design Circuits

Domain Knowledge-Infused Deep Learning for Automated Analog/Radio-Frequency Circuit Parameter Optimization

Logic Synthesis Optimization Sequence tuning using RL-based LSTM and Graph Isomorphism Network

GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

Efficient Reinforcement Learning Framework for Automated Logic Synthesis Exploration

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

Automated Design and Optimization of Distributed Filtering Circuits via Reinforcement Learning

Machine Learning Driven Global Optimisation Framework for Analog Circuit Design

An Efficient Reinforcement Learning Based Framework for Exploring Logic Synthesis

DNN-Opt: An RL Inspired Optimization for Analog Circuit Sizing using Deep Neural Networks

Incremental reinforcement learning for multi-objective analog circuit design acceleration

AISYN: AI-driven Reinforcement Learning-Based Logic Synthesis Framework