Abstract:In differential equation discovery algorithms, a priori expert knowledge is mainly used implicitly to constrain the form of the expected equation, making it impossible for the algorithm to truly discover equations. Instead, most differential equation discovery algorithms try to recover the coefficients for a known structure. In this paper, we describe an algorithm that allows the discovery of unknown equations using automatically or manually extracted background knowledge. Instead of imposing rigid constraints, we modify the structure space so that certain terms are likely to appear within the crossover and mutation operators. In this way, we mimic expertly chosen terms while preserving the possibility of obtaining any equation form. The paper shows that the extraction and use of knowledge allows it to outperform the SINDy algorithm in terms of search stability and robustness. Synthetic examples are given for Burgers, wave, and Korteweg--De Vries equations.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is how to effectively incorporate background knowledge into the differential equation discovery algorithm, thereby enhancing the ability to discover unknown equations. Specifically, the author proposes a new method to guide the evolutionary optimization process by automatically or manually extracting background knowledge, rather than imposing strict limitations on the form of the desired equation as in traditional methods. ### Main Problems 1. **How to Represent and Utilize Background Knowledge**: Existing differential equation discovery algorithms usually implicitly use expert knowledge to constrain the form of the desired equation, which makes it difficult for the algorithm to truly discover unknown equations. This paper proposes a new method that allows the discovery of unknown equations by automatically or manually extracting background knowledge. 2. **How to Improve Search Stability and Robustness**: Traditional differential equation discovery algorithms (such as SINDy) have deficiencies in search stability and robustness. The method in this paper improves search stability and robustness by modifying the structural space so that certain terms are more likely to appear in crossover and mutation operations. ### Method Overview The author introduces a "knowledge - aware" evolutionary differential equation discovery algorithm (EPDE), which is implemented through the following steps: 1. **Initial Guess Generation**: Use the modified SymNet architecture to generate an initial guess. This architecture can quickly generate a large structural space without explicitly defining terms. 2. **Probability Distribution Generation**: Generate the importance distribution of terms based on the initial guess. This distribution is used to guide the selection of new terms in the evolutionary process, making terms with higher importance more likely to be selected. 3. **Modify Evolutionary Operations**: - **Crossover Operation**: Generate a new model based on two model structures and rank terms according to the preferences of complementary models. Terms with higher weights are more likely to participate in crossover exchanges. - **Mutation Operation**: All terms are uniformly regarded as mutation objects, but their importance distribution is considered when selecting replacement terms. For term mutation, use the importance distribution to generate new terms. 4. **Smoothing Processing**: To prevent the slow convergence of the optimization process due to excessive coefficient differences, a smoothing step is introduced to make the coefficient values closer to the average value, thereby making the calculated probability distribution closer to a uniform distribution. ### Experimental Results The paper demonstrates the superiority of this method in terms of search stability and robustness over the existing SINDy algorithm through synthetic examples (such as Burgers' equation, wave equation, and Korteweg - De Vries equation). ### Summary This paper proposes a new differential equation discovery method. By automatically extracting background knowledge and integrating it into the evolutionary optimization process, the ability to discover unknown equations is enhanced. Experimental results show that this method is superior to existing methods in terms of search stability and robustness.

Knowledge-aware equation discovery with automated background knowledge extraction

Extracting Conservative Equations from Nonconservative State Data

Towards Discovery of the Differential Equations

Towards true discovery of the differential equations

Data-driven discovery of free-form governing differential equations

Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data

A knowledge transfer-based adaptive differential evolution for solving nonlinear equation systems

Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbert

D-CIPHER: Discovery of Closed-form Partial Differential Equations

Large language models for automatic equation discovery of nonlinear dynamics

Automatically identifying ordinary differential equations from data

Active Symbolic Discovery of Ordinary Differential Equations via Phase Portrait Sketching

Automatically discovering ordinary differential equations from data with sparse regression

A Bayesian Approach for Data-Driven Dynamic Equation Discovery

Robust data-driven discovery of governing physical laws with error bars

KO-PDE: Kernel Optimized Discovery of Partial Differential Equations with Varying Coefficients.

Amortized Equation Discovery in Hybrid Dynamical Systems

Governing equation discovery of a complex system from snapshots

Learning dynamical systems from data: Gradient-based dictionary optimization

Discovery of differential equations using sparse state and parameter regression

Evolutionary sparse data-driven discovery of multibody system dynamics