Abstract:We introduce a new workflow for unconstrained optimization whereby objective functions are mapped onto a physical domain to more easily design algorithms that are robust to hyperparameters and achieve fast convergence rates. Specifically, we represent optimization problems as an equivalent circuit that are then solved solely as nonlinear circuits using robust solution methods. The equivalent circuit models the trajectory of component-wise scaled gradient flow problem as the transient response of the circuit for which the steady-state coincides with a critical point of the objective function. The equivalent circuit model leverages circuit domain knowledge to methodically design new optimization algorithms that would likely not be developed without a physical model. We incorporate circuit knowledge into optimization methods by 1) enhancing the underlying circuit model for fast numerical analysis, 2) controlling the optimization trajectory by designing the nonlinear circuit components, and 3) solving for step sizes using well-known methods from the circuit simulation. We first establish the necessary conditions that the controls must fulfill for convergence. We show that existing descent algorithms can be re-derived as special cases of this approach and derive new optimization algorithms that are developed with insights from a circuit-based model. The new algorithms can be designed to be robust to hyperparameters, achieve convergence rates comparable or faster than state of the art methods, and are applicable to optimizing a variety of both convex and nonconvex problems.

Efficient Approach for Monte Carlo Simulation Experiments and Its Applications to Circuit Systems Design

Optimal computing budget allocation for Monte Carlo simulation with application to product design

An optimization-based approach to automated design

Circuits for robust designs

A Novel Integrated Approach for Simulation of Electromagnetic Susceptibility Problem

Comparative Study of Surrogate Modeling Methods for Signal Integrity and Microwave Circuit Applications

Efficient Simulation Resource Sharing and Allocation for Selecting the Best.

An Algorithmic Framework for Efficient Large-Scale Circuit Simulation Using Exponential Integrators

Adaptive Simulation for Single-Electron Devices

Subspace-Based Approach for Circuit Simulation

CircuitVAE: Efficient and Scalable Latent Circuit Optimization

Incremental Circuit Simulation Analysis for Design Modification and Verification

An Efficient Method for Evaluating Analog Circuit Performance Bounds Under Process Variations.

Optimization Algorithm Design via Electric Circuits

Constrained Minimum Energy Designs

A Simulation-based strategy used in electrical design for reliability

An Equivalent Circuit Workflow for Unconstrained Optimization

SCGen: A Versatile Generator Framework for Agile Design of Stochastic Circuits

An Efficient Approach to Multiphase Constant On-Time Buck Converter Simulation

Nano-Sim: A Step Wise Equivalent Conductance based Statistical Simulator for Nanotechnology Circuit Design

A Novel and Efficient Bayesian Optimization Approach for Analog Designs with Multi-Testbench