Abstract:Geometric descriptions of deep neural networks (DNNs) have the potential to uncover core representational principles of computational models in neuroscience. Here we examined the geometry of DNN models of visual cortex by quantifying the latent dimensionality of their natural image representations. A popular view holds that optimal DNNs compress their representations onto low-dimensional subspaces to achieve invariance and robustness, which suggests that better models of visual cortex should have lower dimensional geometries. Surprisingly, we found a strong trend in the opposite direction—neural networks with high-dimensional image subspaces tended to have better generalization performance when predicting cortical responses to held-out stimuli in both monkey electrophysiology and human fMRI data. Moreover, we found that high dimensionality was associated with better performance when learning new categories of stimuli, suggesting that higher dimensional representations are better suited to generalize beyond their training domains. These findings suggest a general principle whereby high-dimensional geometry confers computational benefits to DNN models of visual cortex. The effective dimensionality of neural population codes in both brains and artificial neural networks can be far smaller than the number of neurons in the population. In vision, it has been argued that there are crucial benefits of representing images using codes that are as simple and low-dimensional as possible, allowing representations to emphasize key semantic content and attenuate irrelevant perceptual details. However, there are competing benefits of high-dimensional codes, which can capture rich perceptual information to better support an open-ended set of visual behaviors. We quantified the effective dimensionality of neural networks created using a diverse set of training paradigms and compared these networks with image-evoked codes in the visual cortex of both monkeys and humans. Our findings revealed striking benefits of networks with higher effective dimensionality, which were consistently better predictors of cortical activity patterns and were able to readily learn new categories of images outside of their training domains. Together, these findings demonstrate the computational benefits of high-dimensional sensory codes, and they suggest that current neural network models of visual cortex may be better understood in terms of the richness of their representations rather than the details of their training tasks.

On Privileged and Convergent Bases in Neural Network Representations

Privileged representational axes in biological and artificial neural networks

An Open Problem on Sparse Representations in Unions of Bases

Convergent Learning: Do different neural networks learn the same representations?

On 1/n neural representation and robustness

Basis Operator Network: A Neural Network-Based Model for Learning Nonlinear Operators Via Neural Basis

Local vs distributed representations: What is the right basis for interpretability?

Breaking the Curse of Dimensionality with Convex Neural Networks

High-performing neural network models of visual cortex benefit from high latent dimensionality

Prevention is Better than Cure: Handling Basis Collapse and Transparency in Dense Networks

The Persistence of Neural Collapse Despite Low-Rank Bias: An Analytic Perspective Through Unconstrained Features

Function-Space Optimality of Neural Architectures With Multivariate Nonlinearities

Emergent Neural Network Mechanisms for Generalization to Objects in Novel Orientations

Proving Linear Mode Connectivity of Neural Networks via Optimal Transport

When Do Neural Networks Outperform Kernel Methods?

Formation of Representations in Neural Networks

Don't Cut Corners: Exact Conditions for Modularity in Biologically Inspired Representations

Git Re-Basin: Merging Models modulo Permutation Symmetries

Rotation Equivariance and Invariance in Convolutional Neural Networks

Convergence Guarantees of Overparametrized Wide Deep Inverse Prior

Robustness of Neural Codes and Its Implication on Natural Image Processing