Abstract:Geometric descriptions of deep neural networks (DNNs) have the potential to uncover core representational principles of computational models in neuroscience. Here we examined the geometry of DNN models of visual cortex by quantifying the latent dimensionality of their natural image representations. A popular view holds that optimal DNNs compress their representations onto low-dimensional subspaces to achieve invariance and robustness, which suggests that better models of visual cortex should have lower dimensional geometries. Surprisingly, we found a strong trend in the opposite direction—neural networks with high-dimensional image subspaces tended to have better generalization performance when predicting cortical responses to held-out stimuli in both monkey electrophysiology and human fMRI data. Moreover, we found that high dimensionality was associated with better performance when learning new categories of stimuli, suggesting that higher dimensional representations are better suited to generalize beyond their training domains. These findings suggest a general principle whereby high-dimensional geometry confers computational benefits to DNN models of visual cortex. The effective dimensionality of neural population codes in both brains and artificial neural networks can be far smaller than the number of neurons in the population. In vision, it has been argued that there are crucial benefits of representing images using codes that are as simple and low-dimensional as possible, allowing representations to emphasize key semantic content and attenuate irrelevant perceptual details. However, there are competing benefits of high-dimensional codes, which can capture rich perceptual information to better support an open-ended set of visual behaviors. We quantified the effective dimensionality of neural networks created using a diverse set of training paradigms and compared these networks with image-evoked codes in the visual cortex of both monkeys and humans. Our findings revealed striking benefits of networks with higher effective dimensionality, which were consistently better predictors of cortical activity patterns and were able to readily learn new categories of images outside of their training domains. Together, these findings demonstrate the computational benefits of high-dimensional sensory codes, and they suggest that current neural network models of visual cortex may be better understood in terms of the richness of their representations rather than the details of their training tasks.

Dimensionally-reduced visual cortical network model predicts network response and connects system- and cellular-level descriptions

Simultaneous, cortex-wide and cellular-resolution neuronal population dynamics reveal an unbounded scaling of dimensionality with neuron number

Dimensional Reduction of a V1 Ring Model with Simple and Complex Cells

Cellular Connectomes As Arbiters of Local Circuit Models in the Cerebral Cortex.

Spatiotemporal Dynamics of Neuronal Population Response in the Primary Visual Cortex.

Revealing directed effective connectivity of cortical neuronal networks from measurements

Network Model Of Top-Down Influences On Local Gain And Contextual Interactions In Visual Cortex

High-performing neural network models of visual cortex benefit from high latent dimensionality

Low-dimensional criticality embedded in high-dimensional awake brain dynamics

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

Anatomical connectivity and the resting state activity of large cortical networks

Cognitive network interactions through communication subspaces in large-scale models of the neocortex

The determining role of covariances in large networks of stochastic neurons

Network structure of cerebral cortex shapes functional connectivity on multiple time scales

Computational Modeling of Neuronal Networks

Predicting single-neuron activity in locally connected networks

A biophysically-detailed model of inter-areal interactions in cortical sensory processing

Decoding Neuronal Networks: A Reservoir Computing Approach for Predicting Connectivity and Functionality

Cortical Motion Perception Emerges from Dimensionality Reduction with Evolved Spike-Timing-Dependent Plasticity Rules

Multi-scale spiking network model of human cerebral cortex

Nonlinear Local Electrovascular Coupling. I: A Theoretical Model.