Abstract:Introduction: Machine learning provides fundamental tools both for scientific research and for the development of technologies with significant impact on society. It provides methods that facilitate the discovery of regularities in data and that give predictions without explicit knowledge of the rules governing a system. However, a price is paid for exploiting such flexibility: machine learning methods are typically black-boxes where it is difficult to fully understand what the machine is doing or how it is operating. This poses constraints on the applicability and explainability of such methods. Methods: Our research aims to open the black-box of recurrent neural networks, an important family of neural networks used for processing sequential data. We propose a novel methodology that provides a mechanistic interpretation of behaviour when solving a computational task. Our methodology uses mathematical constructs called excitable network attractors, which are invariant sets in phase space composed of stable attractors and excitable connections between them. Results and Discussion: As the behaviour of recurrent neural networks depends both on training and on inputs to the system, we introduce an algorithm to extract network attractors directly from the trajectory of a neural network while solving tasks. Simulations conducted on a controlled benchmark task confirm the relevance of these attractors for interpreting the behaviour of recurrent neural networks, at least for tasks that involve learning a finite number of stable states and transitions between them.

Arbitrary sensitive transitions in recurrent neural networks

Interpreting recurrent neural networks behaviour via excitable network attractors

Effect of Constant External Input on Continuous Attractors Shifting

ENN: A Neural Network with DCT Adaptive Activation Functions

Simultaneous embedding of multiple attractor manifolds in a recurrent neural network using constrained gradient optimization

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Slow and Weak Attractor Computation Embedded in Fast and Strong E-I Balanced Neural Dynamics.

Continuous Attractors of Discrete-Time Recurrent Neural Networks

Dynamic shift mechanism of continuous attractors in a class of recurrent neural networks

Attentive Transfer Entropy to Exploit Transient Emergence of Coupling Effect.

Continuous Attractors Of A Class Of Recurrent Neural Networks Without Lateral Inhibition

Dynamics of Adaptive Continuous Attractor Neural Networks

Noisy Adaptation Generates Lévy Flights in Attractor Neural Networks.

Drift of neural ensembles driven by slow fluctuations of intrinsic excitability

Transitions between spatial attractors in place-cell networks

Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory

Multiperiodicity And Attractivity Of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions

Lyapunov-Guided Representation of Recurrent Neural Network Performance

Selectable and Unselectable Sets of Neurons in Recurrent Neural Networks with Saturated Piecewise Linear Transfer Function

Single-unit activations confer inductive biases for emergent circuit solutions to cognitive tasks