Abstract:Neuroscience research has increasingly used decoding techniques, in which multivariate statistical methods identify patterns in neural data that allow the classification of experimental conditions or participant groups. Typically, the features used for decoding are spatial in nature, including voxel patterns and electrode locations. However, the strength of many neurophysiological recording techniques such as electroencephalography or magnetoencephalography is in their rich temporal, rather than spatial, content. The present report proposes a new decoding method that relies on the time information contained in neural time series. This information is then used in a subsequent step, generalization across location (GAL), which characterizes the relationship between sensor locations based on their ability to cross-decode. Two datasets are used to demonstrate usage of this method, referred to as time-GAL, involving (1) event-related potentials in response to affective pictures and (2) steady-state visual evoked potentials in response to aversively conditioned grating stimuli. In both cases, experimental conditions were successfully decoded based on the temporal features contained in the neural time series. Cross-decoding occurred in regions known to be involved in visual and affective processing. We conclude that the time-GAL approach holds promise for analyzing neural time series from a wide range of paradigms and measurement domains providing an assumption-free method to quantifying differences in temporal patterns of neural information processing and whether these patterns are shared across sensor locations.

What problem does this paper attempt to address?

The paper attempts to address the issue of how to utilize temporal information to decode neural signals in neuroscience research and explore the generalization ability of these temporal patterns across different locations. Specifically, the researchers propose a novel method, the time-based Generalization Across Locations (time-GAL) method, for classifying temporal patterns in neural time series and analyzing the sharing of these patterns across different sensor locations. Traditional multivariate pattern analysis (MVPA) methods primarily rely on spatial information (such as voxel patterns and electrode positions) to decode experimental conditions or participant groups. However, many neurophysiological recording techniques (such as electroencephalography EEG and magnetoencephalography MEG) have the advantage of rich temporal information rather than spatial information. Therefore, this paper proposes a new decoding method that utilizes temporal information in neural time series for classification and characterizes the relationships between different sensor locations through a subsequent Generalization Across Locations (GAL) step. The researchers used two datasets to demonstrate the application of this method: one is an event-related potential (ERP) dataset related to affective pictures, and the other is a steady-state visual evoked potential (ssVEP) dataset related to aversive conditioning. In both datasets, the researchers successfully classified experimental conditions based on temporal features in neural time series and observed cross-location decoding phenomena in regions known to be involved in visual and affective processing. Overall, the paper aims to provide a hypothesis-free method to quantify the differences in temporal patterns of neural information processing and their sharing across different sensor locations, thereby offering new tools for analyzing neural time series from various paradigms and measurement domains.

Decoding in the fourth dimension: Classification of temporal patterns and their generalization across locations

Decoding multimodal behavior using time differences of MEG events

An introduction to time-resolved decoding analysis for M/EEG

Temporal Spiking Generative Adversarial Networks for Heading Direction Decoding

Deep learning approaches for neural decoding across architectures and recording modalities

Group-level Brain Decoding with Deep Learning

Decoding visual colour from scalp electroencephalography measurements

Multi-Scale Spatio-Temporal Fusion with Adaptive Brain Topology Learning for Fmri Based Neural Decoding.

Decoding Visual Experience and Mapping Semantics through Whole-Brain Analysis Using fMRI Foundation Models

Bayesian Neural Decoding Using A Diversity-Encouraging Latent Representation Learning Method

Decoding Patterns of Human Brain Activity

‘When’ and ‘what’ did you see? A novel fMRI-based visual decoding framework

Generalized neural decoders for transfer learning across participants and recording modalities

Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics

Brain decoding: toward real-time reconstruction of visual perception

Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI

Neural Decoding of Visual Information Across Different Neural Recording Modalities and Approaches

Exploiting correlations across trials and behavioral sessions to improve neural decoding

Decoding region-level visual functions from invasive EEG data

Toward Generalizing Visual Brain Decoding to Unseen Subjects

Efficient Neural Decoding Based on Multimodal Training