Abstract:This paper proposes a learning framework, RoSE-Opt, to achieve robust and efficient analog circuit parameter optimization. RoSE-Opt has two important features. First, it incorporates key domain knowledge of analog circuit design, such as circuit topology, couplings between circuit specifications, and variations of process, supply voltage, and temperature, into the learning loop. This strategy facilitates the training of an artificial agent capable of achieving design goals by identifying device parameters that are optimal and robust. Second, it exploits a two-level optimization method, that is, integrating Bayesian optimization (BO) with reinforcement learning (RL) to improve sample efficiency. In particular, BO is used for a coarse yet quick search of an initial starting point for optimization. This sets a solid foundation to efficiently train the RL agent with fewer samples. Experimental evaluations on benchmarking circuits show promising sample efficiency, extraordinary figure-of-merit in terms of design efficiency and design success rate, and Pareto optimality in circuit performance of our framework, compared to previous methods. Furthermore, this work thoroughly studies the performance of different RL optimization algorithms, such as Deep Deterministic Policy Gradients (DDPG) with an off-policy learning mechanism and Proximal Policy Optimization (PPO) with an on-policy learning mechanism. This investigation provides users with guidance on choosing the appropriate RL algorithms to optimize the device parameters of analog circuits. Finally, our study also demonstrates RoSE-Opt's promise in parasitic-aware device optimization for analog circuits. In summary, our work reports a knowledge-infused BO-RL design automation framework for reliable and efficient optimization of analog circuits' device parameters.

EasySO: Exploration-enhanced Reinforcement Learning for Logic Synthesis Sequence Optimization and a Comprehensive RL Environment

Efficient Reinforcement Learning Framework for Automated Logic Synthesis Exploration

An Efficient Reinforcement Learning Based Framework for Exploring Logic Synthesis

Logic Synthesis Optimization Sequence tuning using RL-based LSTM and Graph Isomorphism Network

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

AISYN: AI-driven Reinforcement Learning-Based Logic Synthesis Framework

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

An Open-Source AMS Circuit Optimization Framework Based on Reinforcement Learning—From Specifications to Layouts

LEDRO: LLM-Enhanced Design Space Reduction and Optimization for Analog Circuits

MTLSO: A Multi-Task Learning Approach for Logic Synthesis Optimization

PowerSyn: A Logic Synthesis Framework with Early Power Optimization

RoSE-Opt: Robust and Efficient Analog Circuit Parameter Optimization with Knowledge-infused Reinforcement Learning

SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning

Towards Mixed Optimization for Reinforcement Learning with Program Synthesis

Reinforcement Learning for Temporal Logic Control Synthesis with Probabilistic Satisfaction Guarantees

Synthesis from LTL with Reward Optimization in Sampled Oblivious Environments

A novel reinforcement learning-based method for structure optimization

Logical Specifications-guided Dynamic Task Sampling for Reinforcement Learning Agents

DAG-aware Synthesis Orchestration

An Open-source End-to-End Logic Optimization Framework for Large-scale Boolean Network with Reinforcement Learning