Abstract:Many real-world systems can be described by mathematical models that are human-comprehensible, easy to analyze and help explain the system's behavior. Symbolic regression is a method that can automatically generate such models from data. Historically, symbolic regression has been predominantly realized by genetic programming, a method that evolves populations of candidate solutions that are subsequently modified by genetic operators crossover and mutation. However, this approach suffers from several deficiencies: it does not scale well with the number of variables and samples in the training data - models tend to grow in size and complexity without an adequate accuracy gain, and it is hard to fine-tune the model coefficients using just genetic operators. Recently, neural networks have been applied to learn the whole analytic model, i.e., its structure and the coefficients, using gradient-based optimization algorithms. This paper proposes a novel neural network-based symbolic regression method that constructs physically plausible models based on even very small training data sets and prior knowledge about the system. The method employs an adaptive weighting scheme to effectively deal with multiple loss function terms and an epoch-wise learning process to reduce the chance of getting stuck in poor local optima. Furthermore, we propose a parameter-free method for choosing the model with the best interpolation and extrapolation performance out of all the models generated throughout the whole learning process. We experimentally evaluate the approach on four test systems: the TurtleBot 2 mobile robot, the magnetic manipulation system, the equivalent resistance of two resistors in parallel, and the longitudinal force of the anti-lock braking system. The results clearly show the potential of the method to find parsimonious models that comply with the prior knowledge provided.

Harnessing data using symbolic regression methods for discovering novel paradigms in physics

Deep symbolic regression for physics guided by units constraints: toward the automated discovery of physical laws

Interpretable scientific discovery with symbolic regression: a review

Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression

Deep Learning and Symbolic Regression for Discovering Parametric Equations

Using machine learning to find exact analytic solutions to analytically posed physics problems

Toward Physically Plausible Data-Driven Models: A Novel Neural Network Approach to Symbolic Regression

Data-driven discovery of Tsallis-like distribution using symbolic regression in high-energy physics

Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl

Symbolic regression via neural networks

Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Tasks

Symbolic Regression in Materials Science: Discovering Interatomic Potentials from Data

PHYSICS DISCOVERY OF ENGINEERING APPLICATIONS WITH CONSTRAINED OPTIMIZATION AND GENETIC PROGRAMMING

Exploring the Mathematic Equations Behind the Materials Science Data Using Interpretable Symbolic Regression

Class Symbolic Regression: Gotta Fit 'Em All

Symbolic regression for precision LHC physics

Enhancing Symbolic Regression and Universal Physics-Informed Neural Networks with Dimensional Analysis

Revolutionizing physics: a comprehensive survey of machine learning applications

Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data set

Learning Symbolic Physics with Graph Networks

SymbolFit: Automatic Parametric Modeling with Symbolic Regression