Abstract:A central question for neuroscience is how to characterize brain representations of perceptual and cognitive content. An ideal characterization should distinguish different functional regions with robustness to noise and idiosyncrasies of individual brains that do not correspond to computational differences. Previous studies have characterized brain representations by their representational geometry, which is defined by the representational dissimilarity matrix (RDM), a summary statistic that abstracts from the roles of individual neurons (or responses channels) and characterizes the discriminability of stimuli. Here we explore a further step of abstraction: from the geometry to the topology of brain representations. We propose topological representational similarity analysis (tRSA), an extension of representational similarity analysis (RSA) that uses a family of geo-topological summary statistics that generalizes the RDM to characterize the topology while de-emphasizing the geometry. We evaluate this new family of statistics in terms of the sensitivity and specificity for model selection using both simulations and fMRI data. In the simulations, the ground truth is a data-generating layer representation in a neural network model and the models are the same and other layers in different model instances (trained from different random seeds). In fMRI, the ground truth is a visual area and the models are the same and other areas measured in different subjects. Results show that topology-sensitive characterizations of population codes are robust to noise and interindividual variability and maintain excellent sensitivity to the unique representational signatures of different neural network layers and brain regions. These methods enable researchers to calibrate comparisons among representations in brains and models to be sensitive to the geometry, the topology, or a combination of both.

Experimental Observations of the Topology of Convolutional Neural Network Activations

A Comprehensive Review of Deep Neural Network Interpretation Using Topological Data Analysis

Understanding Deep Neural Networks Using Topological Data Analysis

Visualizing Deep Neural Networks with Topographic Activation Maps

Activation Landscapes as a Topological Summary of Neural Network Performance

Topological Measurement of Deep Neural Networks Using Persistent Homology

Exposition and Interpretation of the Topology of Neural Networks

Characterization of topological structures in different neural network architectures

Preserving Information: How does Topological Data Analysis improve Neural Network performance?

Topological Data Analysis of Neural Network Layer Representations

Learning Connectivity of Neural Networks from a Topological Perspective

Research on fusing topological data analysis with convolutional neural network

Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networks

Topological Blind Spots: Understanding and Extending Topological Deep Learning Through the Lens of Expressivity

Attending to Topological Spaces: The Cellular Transformer

Do Neural Networks Trained with Topological Features Learn Different Internal Representations?

The Topology and Geometry of Neural Representations

Learning Point Cloud Shapes with Geometric and Topological Structures.

The Intrinsic Similarity of Topological Structure in Biological Neural Networks.

Topological learning in multiclass data sets

Geometric and Topological Inference for Deep Representations of Complex Networks