Abstract:Interpretability is crucial for machine learning in many scenarios such as quantitative finance, banking, healthcare, etc. Symbolic regression (SR) is a classic interpretable machine learning method by bridging X and Y using mathematical expressions composed of some basic functions. However, the search space of all possible expressions grows exponentially with the length of the expression, making it infeasible for enumeration. Genetic programming (GP) has been traditionally and commonly used in SR to search for the optimal solution, but it suffers from several limitations, e.g. the difficulty in incorporating prior knowledge; overly-complicated output expression and reduced interpretability etc. To address these issues, we propose a new method to fit SR under a Bayesian framework. Firstly, Bayesian model can naturally incorporate prior knowledge (e.g., preference of basis functions, operators and raw features) to improve the efficiency of fitting SR. Secondly, to improve interpretability of expressions in SR, we aim to capture concise but informative signals. To this end, we assume the expected signal has an additive structure, i.e., a linear combination of several concise expressions, whose complexity is controlled by a well-designed prior distribution. In our setup, each expression is characterized by a symbolic tree, and the proposed SR model could be solved by sampling symbolic trees from the posterior distribution using an efficient Markov chain Monte Carlo (MCMC) algorithm. Finally, compared with GP, the proposed BSR(Bayesian Symbolic Regression) method saves computer memory with no need to keep an updated 'genome pool'. Numerical experiments show that, compared with GP, the solutions of BSR are closer to the ground truth and the expressions are more concise. Meanwhile we find the solution of BSR is robust to hyper-parameter specifications such as the number of trees.

Symbolic Recurrence Quantification Analysis and Its Application

Multidimensional Joint Recurrence Quantification Analysis: detecting coupling between time series of different dimensionalities

Analyzing Multivariate Dynamics Using Cross-Recurrence Quantification Analysis (CRQA), Diagonal-Cross-Recurrence Profiles (DCRP), and Multidimensional Recurrence Quantification Analysis (MdRQA) – A Tutorial in R

Analyzing time series of unequal durations using Multidimensional Recurrence Quantification Analysis (MdRQA): validation and implementation using Python

Trends in recurrence analysis of dynamical systems

Bayesian Symbolic Regression

Nonlinear dynamics in Divisia monetary aggregates: an application of recurrence quantification analysis

Multivariate data analysis using recurrence measures

Measuring Structural Changes Of Recurrence Patterns In Multifractal And Multiscale Aspects By Generalized Recurrence Lacunarity

Multi-scale recurrence quantification analysis of heartbeat interval series in healthy vs. Heart failure subjects

Optimising Parameters in Recurrence Quantification Analysis of Smart Energy Systems

Identifying Spatial Pattern of NDVI Series Dynamics Using Recurrence Quantification Analysis

Multiscale multidimensional recurrence quantitative analysis for analysing MEG signals in patients with schizophrenia

Unveiling Early Warning Signals of Systemic Risks in Banks: A Recurrence Network-Based Approach

Generalizability Improvement of Interpretable Symbolic Regression Models for Quantitative Structure-Activity Relationships

Exploring recursive properties and dynamical complexity in scalar time-series using threshold-free recursive analysis approach

Symbolic dynamics techniques for complex systems: Application to share price dynamics

RQA Application for the Monitoring of Financial and Commodity markets state

Combination of Equiprobable Symbolization and Time Reversal Asymmetry for Heartbeat Interval Series Analysis

Finite-step alternating approximately bi-similar symbolic model for Markov jump systems

New models for symbolic data analysis