Abstract:The mathematical formula is the human language to describe nature and is the essence of scientific research. Finding mathematical formulas from observational data is a major demand of scientific research and a major challenge of artificial intelligence. This area is called symbolic regression. Originally symbolic regression was often formulated as a combinatorial optimization problem and solved using GP or reinforcement learning algorithms. These two kinds of algorithms have strong noise robustness ability and good Versatility. However, inference time usually takes a long time, so the search efficiency is relatively low. Later, based on large-scale pre-training data proposed, such methods use a large number of synthetic data points and expression pairs to train a Generative Pre-Trained Transformer(GPT). Then this GPT can only need to perform one forward propagation to obtain the results, the advantage is that the inference speed is very fast. However, its performance is very dependent on the training data and performs poorly on data outside the training set, which leads to poor noise robustness and Versatility of such methods. So, can we combine the advantages of the above two categories of SR algorithms? In this paper, we propose \textbf{FormulaGPT}, which trains a GPT using massive sparse reward learning histories of reinforcement learning-based SR algorithms as training data. After training, the SR algorithm based on reinforcement learning is distilled into a Transformer. When new test data comes, FormulaGPT can directly generate a "reinforcement learning process" and automatically update the learning policy in context. Tested on more than ten datasets including SRBench, formulaGPT achieves the state-of-the-art performance in fitting ability compared with four baselines. In addition, it achieves satisfactory results in noise robustness, versatility, and inference efficiency.

GPT-LS: Generative Pre-Trained Transformer with Offline Reinforcement Learning for Logic Synthesis.

Logic Synthesis with Generative Deep Neural Networks

OpenLS-DGF: An Adaptive Open-Source Dataset Generation Framework for Machine Learning Tasks in Logic Synthesis

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

ERL-LS: Accelerating Primitive Sequence Generation of Logic Synthesis with Evolutionary Reinforcement Learning

Logic Synthesis Optimization Sequence tuning using RL-based LSTM and Graph Isomorphism Network

Circuit Transformer: End-to-end Circuit Design by Predicting the Next Gate

Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning

Neural Circuit Synthesis from Specification Patterns

Can Language Models Pretend Solvers? Logic Code Simulation with LLMs

ShortCircuit: AlphaZero-Driven Circuit Design

MTLSO: A Multi-Task Learning Approach for Logic Synthesis Optimization

Too Big to Fail? Active Few-Shot Learning Guided Logic Synthesis

PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

The prediction of the quality of results in Logic Synthesis using Transformer and Graph Neural Networks

A General Framework for Efficient Logic Synthesis

TRIZ-GPT: An LLM-augmented method for problem-solving

AISYN: AI-driven Reinforcement Learning-Based Logic Synthesis Framework

RTLCoder: Fully Open-Source and Efficient LLM-Assisted RTL Code Generation Technique

Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives