Predicting discrete-time bifurcations with deep learning

Thomas M. Bury,Daniel Dylewsky,Chris T. Bauch,Madhur Anand,Leon Glass,Alvin Shrier,Gil Bub
DOI: https://doi.org/10.1038/s41467-023-42020-z
2024-02-09
Abstract:Many natural and man-made systems are prone to critical transitions -- abrupt and potentially devastating changes in dynamics. Deep learning classifiers can provide an early warning signal (EWS) for critical transitions by learning generic features of bifurcations (dynamical instabilities) from large simulated training data sets. So far, classifiers have only been trained to predict continuous-time bifurcations, ignoring rich dynamics unique to discrete-time bifurcations. Here, we train a deep learning classifier to provide an EWS for the five local discrete-time bifurcations of codimension-1. We test the classifier on simulation data from discrete-time models used in physiology, economics and ecology, as well as experimental data of spontaneously beating chick-heart aggregates that undergo a period-doubling bifurcation. The classifier outperforms commonly used EWS under a wide range of noise intensities and rates of approach to the bifurcation. It also predicts the correct bifurcation in most cases, with particularly high accuracy for the period-doubling, Neimark-Sacker and fold bifurcations. Deep learning as a tool for bifurcation prediction is still in its nascence and has the potential to transform the way we monitor systems for critical transitions.
Quantitative Methods,Machine Learning,Dynamical Systems
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to solve the problem of how to predict bifurcations in discrete - time systems. Specifically, the authors focus on providing early - warning signals (EWS) through deep - learning methods to identify and predict five local one - dimensional discrete - time bifurcations: period - doubling, Neimark - Sacker bifurcation, fold bifurcation, transcritical bifurcation, and pitchfork bifurcation. These problems are very important in fields such as physiology, economics, and ecology, because the dynamic changes of these systems may lead to catastrophic transitions. #### Background and Motivation Many natural and man - made systems are prone to critical transitions - that is, sudden and potentially devastating changes in dynamics. These critical transitions can occur in heart rhythms, financial markets, or ecosystems. Although traditional early - warning signals (such as variance and lag - 1 autocorrelation) can provide warnings in some cases, they cannot accurately predict specific bifurcation types and perform poorly in cases of high noise or when approaching bifurcations at a high speed. #### Research Objectives 1. **Develop new prediction tools**: Use deep - learning classifiers to predict bifurcations in discrete - time systems and provide more reliable early - warning signals. 2. **Improve prediction accuracy**: Evaluate the performance of deep - learning classifiers under different noise intensities and approaching - bifurcation rates, and compare them with traditional indicators (such as variance and lag - 1 autocorrelation). 3. **Verify the generalization ability of the model**: Test the generalization ability of the classifier through simulated data and experimental data (such as data from spontaneously beating heart cell aggregates) to ensure its effectiveness in practical applications. #### Method Overview - **Generate training data**: Use a normal - form model containing high - order terms and noise to generate a large amount of simulated data covering five discrete - time bifurcations. - **Train the classifier**: Adopt a neural network with a CNN - LSTM architecture and train two independent classifiers (Classifier 1 and Classifier 2), which learn features from different parts of the time series respectively. - **Test and evaluate**: Test the performance of the classifier on multiple theoretical models and experimental data, and evaluate its advantages over traditional indicators. Through this method, the authors hope to provide a new tool for monitoring critical transitions, thereby better preventing harmful dynamic changes and promoting favorable transitions.