Abstract:The recognition of object categories is effortlessly accomplished in everyday life, yet its neural underpinnings remain not fully understood. In this electroencephalography (EEG) study, we used single-trial classification to perform a Representational Similarity Analysis (RSA) of categorical representation of objects in human visual cortex. Brain responses were recorded while participants viewed a set of 72 photographs of objects with a planned category structure. The Representational Dissimilarity Matrix (RDM) used for RSA was derived from confusions of a linear classifier operating on single EEG trials. In contrast to past studies, which used pairwise correlation or classification to derive the RDM, we used confusion matrices from multi-class classifications, which provided novel self-similarity measures that were used to derive the overall size of the representational space. We additionally performed classifications on subsets of the brain response in order to identify spatial and temporal EEG components that best discriminated object categories and exemplars. Results from category-level classifications revealed that brain responses to images of human faces formed the most distinct category, while responses to images from the two inanimate categories formed a single category cluster. Exemplar-level classifications produced a broadly similar category structure, as well as sub-clusters corresponding to natural language categories. Spatiotemporal components of the brain response that differentiated exemplars within a category were found to differ from those implicated in differentiating between categories. Our results show that a classification approach can be successfully applied to single-trial scalp-recorded EEG to recover fine-grained object category structure, as well as to identify interpretable spatiotemporal components underlying object processing. Finally, object category can be decoded from purely temporal information recorded at single electrodes.

Temporal Variabilities Provide Additional Category-Related Information in Object Category Decoding: A Systematic Comparison of Informative EEG Features

Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans

Long short‐term memory‐based neural decoding of object categories evoked by natural images

Rapidly Decoding Image Categories from MEG Data Using a Multivariate Short-Time FC Pattern Analysis Approach

Resolving the time course of visual and auditory object categorization

Decoding objects of basic categories from electroencephalographic signals using wavelet transform and support vector machines

A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Decoding SSVEP patterns from EEG via multivariate variational mode decomposition-informed canonical correlation analysis

Decoding in the fourth dimension: Classification of temporal patterns and their generalization across locations

An introduction to time-resolved decoding analysis for M/EEG

Learning Exemplar Representations in Single-Trial EEG Category Decoding

Beware of Overestimated Decoding Performance Arising from Temporal Autocorrelations in Electroencephalogram Signals

Categorizing Objects from MEG Signals Using EEGNet

Exploiting Information in Event-Related Brain Potentials from Average Temporal Waveform, Time-Frequency Representation, and Phase Dynamics

Neural correlates tracking different aspects of the emerging representation of novel visual categories

Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning

Unraveling the Neural Network: Identifying Temporal Labeling of Visual Events through EEG-Based Functional Connectivity Analysis of Brain Regions

Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics

Spatio-temporal Pattern Analysis of Single-Trial EEG Signals Recorded During Visual Object Recognition

Decoding Human Visual Colour EEG Information Using Machine Learning and Visual Evoked Potentials