Abstract:Electroencephalogram (EEG) microstates that represent quasi-stable, global neuronal activity are considered as the building blocks of brain dynamics. Therefore, the analysis of microstate sequences is a promising approach to understand fast brain dynamics that underlie various mental processes. Recent studies suggest that EEG microstate sequences are non-Markovian and nonstationary, highlighting the importance of the sequential flow of information between different brain states. These findings inspired us to model these sequences using Recurrent Neural Networks (RNNs) consisting of long-short-term-memory (LSTM) units to capture the complex temporal dependencies. Using an LSTM-based auto encoder framework and different encoding schemes, we modeled the microstate sequences at multiple time scales (200-2,000 ms) aiming to capture stably recurring microstate patterns within and across subjects. We show that RNNs can learn underlying microstate patterns with high accuracy and that the microstate trajectories are subject invariant at shorter time scales (≤400 ms) and reproducible across sessions. Significant drop in the reconstruction accuracy was observed for longer sequence lengths of 2,000 ms. These findings indirectly corroborate earlier studies which indicated that EEG microstate sequences exhibit long-range dependencies with finite memory content. Furthermore, we find that the latent representations learned by the RNNs are sensitive to external stimulation such as stress while the conventional univariate microstate measures (e.g., occurrence, mean duration, etc.) fail to capture such changes in brain dynamics. While RNNs cannot be configured to identify the specific discriminating patterns, they have the potential for learning the underlying temporal dynamics and are sensitive to sequence aberrations characterized by changes in metal processes. Empowered with the macroscopic understanding of the temporal dynamics that extends beyond short-term interactions, RNNs offer a reliable alternative for exploring system level brain dynamics using EEG microstate sequences.

Episodic Memory Theory for the Mechanistic Interpretation of Recurrent Neural Networks

Memory and Information Processing in Recurrent Neural Networks

Recurrent Network Models Of Sequence Generation And Memory

Ordered Memory.

Understanding Hidden Memories of Recurrent Neural Networks

On the Long-Term Memory of Deep Recurrent Networks

Distributed Sequence Memory of Multidimensional Inputs in Recurrent Networks.

Ensemble perspective for understanding temporal credit assignment

Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insights

Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Variable Computation in Recurrent Neural Networks

Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks

Generic Memory Modeling with Recurrent Neural Network

Investigating the temporal dynamics of electroencephalogram (EEG) microstates using recurrent neural networks

Teaching Recurrent Neural Networks to Modify Chaotic Memories by Example

Analysis and Design of Associative Memories Based on Recurrent Neural Network with Discontinuous Activation Functions

Expanding memory in recurrent spiking networks

A bio-inspired bistable recurrent cell allows for long-lasting memory

Investigating Recurrent Neural Network Memory Structures using Neuro-Evolution

Interpreting recurrent neural networks behaviour via excitable network attractors