Abstract:Neural networks are increasingly employed to model, analyze and control non-linear dynamical systems ranging from physics to biology. Owing to their universal approximation capabilities, they regularly outperform state-of-the-art model-driven methods in terms of accuracy, computational speed, and/or control capabilities. On the other hand, neural networks are very often they are taken as black boxes whose explainability is challenged, among others, by huge amounts of trainable parameters. In this paper, we tackle the outstanding issue of analyzing the inner workings of neural networks trained to classify regular-versus-chaotic time series. This setting, well-studied in dynamical systems, enables thorough formal analyses. We focus specifically on a family of networks dubbed Large Kernel Convolutional Neural Networks (LKCNN), recently introduced by Boullé et al. (2021). These non-recursive networks have been shown to outperform other established architectures (e.g. residual networks, shallow neural networks and fully convolutional networks) at this classification task. Furthermore, they outperform ``manual'' classification approaches based on direct reconstruction of the Lyapunov exponent. We find that LKCNNs use qualitative properties of the input sequence. In particular, we show that the relation between input periodicity and activation periodicity is key for the performance of LKCNN models. Low performing models show, in fact, analogous periodic activations to random untrained models. This could give very general criteria for identifying, a priori, trained models that have poor accuracy.

Chaotic Dynamics of Supervised Neural Network

Chaos and firing patterns in a discrete fractional Hopfield neural network model

HOPF BIFURCATION AND CHAOS IN TABU LEARNING NEURON MODELS

Controlling Chaos In A Neural Network Based On The Phase Space Constraint

Lyapunov Exponent and Chaotic Area Distribution of a Chaotic Neural Network

Studying a Chaotic Spiking Neural Model

Dynamical stability and chaos in artificial neural network trajectories along training

Exponential Synchronization of Discrete-Time Chaotic Delayed Neural Networks

Analysis and control of the fractional chaotic Hopfield neural network

How neural networks learn to classify chaotic time series

Controlling a chaotic neural network for information processing

Pattern recognition in chaotic neural networks

Associative Dynamics And Its Control Of Chaotic Neural Network

Sinusoidal Modulation Control Method in a Chaotic Neural Network

Study on the delayed feedback control of chaos in chaotic neural networks

Investigation of a chaotic spiking neuron model

Entropy Analysis and Neural Network-Based Adaptive Control of a Non-Equilibrium Four-Dimensional Chaotic System with Hidden Attractors

A Type of Delay Feedback Control of Chaotic Dynamics in A Chaotic Neural Network

Chaos Control In A Neural Network With Threshold Activated Coupling

Statistical physics of learning in high-dimensional chaotic systems

Chaotic Neural Network Approach to Chaotic Time Series Prediction