Abstract:Despite the great success of high-level synthesis (HLS) tools, we observe several unresolved challenges: 1) the high-level abstraction of HLS programming styles sometimes conceals optimization opportunities; 2) the actual quality of resulting RTL designs is hard to predict; and 3) existing HLS tools do not provide flexible tradeoff (Pareto) solutions among different objectives and constraints. To this end, we propose an end-to-end framework, namely, IronMan-Pro. The primary goal is to enable a flexible and automated design space exploration (DSE), to provide either optimized solutions under user-specified constraints or Pareto tradeoffs among different objectives (such as resource types, area, and latency). IronMan-Pro consists of three components: 1) GPP, a highly accurate graph-neural-network-based performance and resource predictor; 2) RLMD, a reinforcement-learning-based multiobjective design exploration engine for optimal resource allocation strategies, aiming to provide Pareto solutions among different objectives; and 3) CT, a code transformer to assist RLMD and GPP, which extracts the data flow graphs from original HLS C/C++ and automatically generates synthesizable code with optimized HLS directives. Experimental results show that, 1) GPP achieves high prediction accuracy, reducing the prediction errors of HLS tools by in resource utilization and in critical path (CP) timing; 2) compared with meta-heuristic-based techniques, IronMan-Pro generates superior solutions improving resource utilization by and CP timing by 7.6%–16.5%; and - ) under user-specified constraints, IronMan-Pro can find satisfying solutions over 96% of the cases, more than twice as many as that of meta-heuristic-based techniques and with a speedup of up to . This work demonstrates the great potential of applying machine learning algorithms in the electronic design automation domain, especially for the hard-to-solve problems, such as timing estimation and optimization. IronMan-Pro is available at https://github.com/lydiawunan/IronMan.

Efficient Reinforcement Learning Framework for Automated Logic Synthesis Exploration

An Efficient Reinforcement Learning Based Framework for Exploring Logic Synthesis

EasySO: Exploration-enhanced Reinforcement Learning for Logic Synthesis Sequence Optimization and a Comprehensive RL Environment

AISYN: AI-driven Reinforcement Learning-Based Logic Synthesis Framework

Logic Synthesis Optimization Sequence tuning using RL-based LSTM and Graph Isomorphism Network

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization

An Open-Source AMS Circuit Optimization Framework Based on Reinforcement Learning—From Specifications to Layouts

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

Learning from the Past: Efficient High-level Synthesis Design Space Exploration for FPGAs

E-Syn: E-Graph Rewriting with Technology-Aware Cost Functions for Logic Synthesis

Multiagent Based Reinforcement Learning (MA-RL): an Automated Designer for Complex Analog Circuits

A Circuit Domain Generalization Framework for Efficient Logic Synthesis in Chip Design

Automated Design of Complex Analog Circuits with Multiagent Based Reinforcement Learning.

PowerSyn: A Logic Synthesis Framework with Early Power Optimization

IronMan-Pro: Multiobjective Design Space Exploration in HLS via Reinforcement Learning and Graph Neural Network-Based Modeling

DAG-aware Synthesis Orchestration

Domain Knowledge-Based Automated Analog Circuit Design with Deep Reinforcement Learning

Towards Mixed Optimization for Reinforcement Learning with Program Synthesis

LEDRO: LLM-Enhanced Design Space Reduction and Optimization for Analog Circuits

MasterRTL: A Pre-Synthesis PPA Estimation Framework for Any RTL Design