Abstract:Electroencephalogram (EEG) microstates that represent quasi-stable, global neuronal activity are considered as the building blocks of brain dynamics. Therefore, the analysis of microstate sequences is a promising approach to understand fast brain dynamics that underlie various mental processes. Recent studies suggest that EEG microstate sequences are non-Markovian and nonstationary, highlighting the importance of the sequential flow of information between different brain states. These findings inspired us to model these sequences using Recurrent Neural Networks (RNNs) consisting of long-short-term-memory (LSTM) units to capture the complex temporal dependencies. Using an LSTM-based auto encoder framework and different encoding schemes, we modeled the microstate sequences at multiple time scales (200-2,000 ms) aiming to capture stably recurring microstate patterns within and across subjects. We show that RNNs can learn underlying microstate patterns with high accuracy and that the microstate trajectories are subject invariant at shorter time scales (≤400 ms) and reproducible across sessions. Significant drop in the reconstruction accuracy was observed for longer sequence lengths of 2,000 ms. These findings indirectly corroborate earlier studies which indicated that EEG microstate sequences exhibit long-range dependencies with finite memory content. Furthermore, we find that the latent representations learned by the RNNs are sensitive to external stimulation such as stress while the conventional univariate microstate measures (e.g., occurrence, mean duration, etc.) fail to capture such changes in brain dynamics. While RNNs cannot be configured to identify the specific discriminating patterns, they have the potential for learning the underlying temporal dynamics and are sensitive to sequence aberrations characterized by changes in metal processes. Empowered with the macroscopic understanding of the temporal dynamics that extends beyond short-term interactions, RNNs offer a reliable alternative for exploring system level brain dynamics using EEG microstate sequences.

Understanding Recurrent Neural State Using Memory Signatures

Understanding Hidden Memories of Recurrent Neural Networks

Residual Recurrent Neural Networks for Learning Sequential Representations.

Towards Interpreting Recurrent Neural Networks Through Probabilistic Abstraction

Memory Visualization for Gated Recurrent Neural Networks in Speech Recognition

Visualizing and Understanding Neural Models in NLP

Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models

Learning Longer Memory in Recurrent Neural Networks

Recurrent Memory Networks for Language Modeling

Non-local Recurrent Neural Memory for Supervised Sequence Modeling

Investigating the temporal dynamics of electroencephalogram (EEG) microstates using recurrent neural networks

Gating Recurrent Enhanced Memory Neural Networks on Language Identification.

Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation

Assessing the Memory Ability of Recurrent Neural Networks

GMU: A Novel RNN Neuron and Its Application to Handwriting Recognition.

Representation of linguistic form and function in recurrent neural networks

On extended long short-term memory and dependent bidirectional recurrent neural network

Episodic Memory Theory for the Mechanistic Interpretation of Recurrent Neural Networks

Linguistic Knowledge as Memory for Recurrent Neural Networks.

Memory-Gated Recurrent Networks

Investigating Gated Recurrent Neural Networks for Acoustic Modeling