Abstract:We propose using subject embeddings to learn and exploit the structure in between‐subject variability in MEG decoding. We show that the combination of deep learning and subject embedding is crucial to closing the performance gap between subject‐ and group‐level models, with group models outperforming subject models on low‐accuracy subjects. Decoding brain imaging data are gaining popularity, with applications in brain‐computer interfaces and the study of neural representations. Decoding is typically subject‐specific and does not generalise well over subjects, due to high amounts of between subject variability. Techniques that overcome this will not only provide richer neuroscientific insights but also make it possible for group‐level models to outperform subject‐specific models. Here, we propose a method that uses subject embedding, analogous to word embedding in natural language processing, to learn and exploit the structure in between‐subject variability as part of a decoding model, our adaptation of the WaveNet architecture for classification. We apply this to magnetoencephalography data, where 15 subjects viewed 118 different images, with 30 examples per image; to classify images using the entire 1 s window following image presentation. We show that the combination of deep learning and subject embedding is crucial to closing the performance gap between subject‐ and group‐level decoding models. Importantly, group models outperform subject models on low‐accuracy subjects (although slightly impair high‐accuracy subjects) and can be helpful for initialising subject models. While we have not generally found group‐level models to perform better than subject‐level models, the performance of group modelling is expected to be even higher with bigger datasets. In order to provide physiological interpretation at the group level, we make use of permutation feature importance. This provides insights into the spatiotemporal and spectral information encoded in the models. All code is available on GitHub (https://github.com/ricsinaruto/MEG-group-decode).

Categorizing Objects from MEG Signals Using EEGNet

Inter-Subject MEG Decoding for Visual Information with Hybrid Gated Recurrent Network

Rapidly Decoding Image Categories from MEG Data Using a Multivariate Short-Time FC Pattern Analysis Approach

An AMCMD Approach for Robust EEG Signal Classification: Unraveling Neurophysiological Insights and BCI Applications

Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning

LV-CadeNet: Long View Feature Convolution-Attention Fusion Encoder-Decoder Network for Clinical MEG Spike Detection

Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans

Brain State Classification Based on Magnetoencephalography Via Hybrid Linear-Dot Attention Mechanisms

Enhancing EEG Motor Imagery Decoding Performance Via Deep Temporal-domain Information Extraction

Decoding Visual Recognition of Objects from EEG Signals based on Attention-Driven Convolutional Neural Network

Group‐level brain decoding with deep learning

Group-level Brain Decoding with Deep Learning

Decoding Natural Images from EEG for Object Recognition

GCNs-Net: A Graph Convolutional Neural Network Approach for Decoding Time-resolved EEG Motor Imagery Signals

Coherence-based channel selection and Riemannian geometry features for magnetoencephalography decoding

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

EEG decoding with conditional identification information

MSHANet: a multi-scale residual network with hybrid attention for motor imagery EEG decoding

Learning Exemplar Representations in Single-Trial EEG Category Decoding

A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding

Motor Imagery EEG Decoding Based on Multi-scale Hybrid Networks and Feature Enhancement.