Abstract:The recognition of object categories is effortlessly accomplished in everyday life, yet its neural underpinnings remain not fully understood. In this electroencephalography (EEG) study, we used single-trial classification to perform a Representational Similarity Analysis (RSA) of categorical representation of objects in human visual cortex. Brain responses were recorded while participants viewed a set of 72 photographs of objects with a planned category structure. The Representational Dissimilarity Matrix (RDM) used for RSA was derived from confusions of a linear classifier operating on single EEG trials. In contrast to past studies, which used pairwise correlation or classification to derive the RDM, we used confusion matrices from multi-class classifications, which provided novel self-similarity measures that were used to derive the overall size of the representational space. We additionally performed classifications on subsets of the brain response in order to identify spatial and temporal EEG components that best discriminated object categories and exemplars. Results from category-level classifications revealed that brain responses to images of human faces formed the most distinct category, while responses to images from the two inanimate categories formed a single category cluster. Exemplar-level classifications produced a broadly similar category structure, as well as sub-clusters corresponding to natural language categories. Spatiotemporal components of the brain response that differentiated exemplars within a category were found to differ from those implicated in differentiating between categories. Our results show that a classification approach can be successfully applied to single-trial scalp-recorded EEG to recover fine-grained object category structure, as well as to identify interpretable spatiotemporal components underlying object processing. Finally, object category can be decoded from purely temporal information recorded at single electrodes.

Deep Representational Similarity Learning for analyzing neural signatures in task-based fMRI dataset

Gradient-based Representational Similarity Analysis with Searchlight for Analyzing fMRI Data

Higher-order Comparisons of Sentence Encoder Representations

A Guide to Representational Similarity Analysis for Social Neuroscience.

Representational similarity analysis in neuroimaging: proxy vehicles and provisional representations

Using Single-Trial Representational Similarity Analysis with EEG to track semantic similarity in emotional word processing

Deep reinforcement learning for fMRI prediction of Autism Spectrum Disorder

Topological Representational Similarity Analysis in Brains and Beyond

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification

Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains

Characterizing And Differentiating Task-Based And Resting State Fmri Signals Via Two-Stage Dictionary Learning

Representational dissimilarity component analysis (ReDisCA)

Modularity-Constrained Dynamic Representation Learning for Interpretable Brain Disorder Analysis with Functional MRI.

A Hybrid Spatio-Temporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multi-Level Core Functional Components in Decoding Multi-Task fMRI Signals

A Hybrid Spatiotemporal Deep Belief Network and Sparse Representation-Based Framework Reveals Multilevel Core Functional Components in Decoding Multitask Fmri Signals.

Signal Sampling for Efficient Sparse Representation of Resting State FMRI Data

Dual Temporal and Spatial Sparse Representation for Inferring Group-Wise Brain Networks from Resting-State Fmri Dataset

Characterizing and differentiating task-based and resting state fMRI signals via two-stage sparse representations

Deep sr-DDL: Deep structurally regularized dynamic dictionary learning to integrate multimodal and dynamic functional connectomics data for multidimensional clinical characterizations

Enriched Representation Learning in Resting-State fMRI for Early MCI Diagnosis