Abstract:The recognition of object categories is effortlessly accomplished in everyday life, yet its neural underpinnings remain not fully understood. In this electroencephalography (EEG) study, we used single-trial classification to perform a Representational Similarity Analysis (RSA) of categorical representation of objects in human visual cortex. Brain responses were recorded while participants viewed a set of 72 photographs of objects with a planned category structure. The Representational Dissimilarity Matrix (RDM) used for RSA was derived from confusions of a linear classifier operating on single EEG trials. In contrast to past studies, which used pairwise correlation or classification to derive the RDM, we used confusion matrices from multi-class classifications, which provided novel self-similarity measures that were used to derive the overall size of the representational space. We additionally performed classifications on subsets of the brain response in order to identify spatial and temporal EEG components that best discriminated object categories and exemplars. Results from category-level classifications revealed that brain responses to images of human faces formed the most distinct category, while responses to images from the two inanimate categories formed a single category cluster. Exemplar-level classifications produced a broadly similar category structure, as well as sub-clusters corresponding to natural language categories. Spatiotemporal components of the brain response that differentiated exemplars within a category were found to differ from those implicated in differentiating between categories. Our results show that a classification approach can be successfully applied to single-trial scalp-recorded EEG to recover fine-grained object category structure, as well as to identify interpretable spatiotemporal components underlying object processing. Finally, object category can be decoded from purely temporal information recorded at single electrodes.

Human EEG and artificial neural networks reveal disentangled representations of object real-world size in natural images

Ensemble Size Perception: Its Neural Signature and the Role of Global Interaction over Individual Items

Real-world Size of Objects Serves As an Axis of Object Space

Achieving More Human Brain-Like Vision via Human EEG Representational Alignment

Dynamic representation of multidimensional object properties in the human brain

Naturalistic Object Representations Depend on Distance and Size Cues

The neural time course of size constancy in natural scenes

Distributed representations of behaviour-derived object dimensions in the human visual system

A large and rich EEG dataset for modeling human visual object recognition

Distributed representations of behavior-derived object dimensions in the human visual system

Visual representations in the human brain are aligned with large language models

Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognition

Multivariate Analysis of BOLD Activation Patterns Recovers Graded Depth Representations in Human Visual and Parietal Cortex

A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification

Universal dimensions of visual representation

Brain decoding: toward real-time reconstruction of visual perception

Brain Decodes Deep Nets

Size constancy affects the perception and parietal neural representation of object size

Decoding Natural Images from EEG for Object Recognition

A large-scale examination of inductive biases shaping high-level visual representation in brains and machines

Using deep neural networks to disentangle visual and semantic information in human perception and memory