Abstract:A defining characteristic of intelligent systems, whether natural or artificial, is the ability to generalize and infer behaviorally relevant latent causes from high-dimensional sensory input, despite significant variations in the environment. To understand how brains achieve generalization, it is crucial to identify the features to which neurons respond selectively and invariantly. However, the high-dimensional nature of visual inputs, the non-linearity of information processing in the brain, and limited experimental time make it challenging to systematically characterize neuronal tuning and invariances, especially for natural stimuli. Here, we extended "inception loops" - a paradigm that iterates between large-scale recordings, neural predictive models, and in silico experiments followed by in vivo verification - to systematically characterize single neuron invariances in the mouse primary visual cortex. Using the predictive model we synthesized Diverse Exciting Inputs (DEIs), a set of inputs that differ substantially from each other while each driving a target neuron strongly, and verified these DEIs' efficacy in vivo. We discovered a novel bipartite invariance: one portion of the receptive field encoded phase-invariant texture-like patterns, while the other portion encoded a fixed spatial pattern. Our analysis revealed that the division between the fixed and invariant portions of the receptive fields aligns with object boundaries defined by spatial frequency differences present in highly activating natural images. These findings suggest that bipartite invariance might play a role in segmentation by detecting texture-defined object boundaries, independent of the phase of the texture. We also replicated these bipartite DEIs in the functional connectomics MICrONs data set, which opens the way towards a circuit-level mechanistic understanding of this novel type of invariance. Our study demonstrates the power of using a data-driven deep learning approach to systematically characterize neuronal invariances. By applying this method across the visual hierarchy, cell types, and sensory modalities, we can decipher how latent variables are robustly extracted from natural scenes, leading to a deeper understanding of generalization.

Digital twin reveals combinatorial code of non-linear computations in the mouse primary visual cortex

Functional connectomics reveals general wiring rule in mouse visual cortex

Decoding Neural Responses in Mouse Visual Cortex through a Deep Neural Network

Bipartite invariance in mouse primary visual cortex

Associations between in vitro, in vivo and in silico cell classes in mouse primary visual cortex

A large-scale, standardized physiological survey reveals higher order coding throughout the mouse visual cortex

Functional connectomics spanning multiple areas of mouse visual cortex

Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex

Predicting Single Neuron Responses of the Primary Visual Cortex with Deep Learning Model

Organization of Neural Population Code in Mouse Visual System

An unsupervised map of excitatory neurons’ dendritic morphology in the mouse visual cortex

Pinpointing Morphology and Projection of Excitatory Neurons in Mouse Visual Cortex.

Deep learning-driven characterization of single cell tuning in primate visual area V4 unveils topological organization

Multimodal Deep Learning Model Unveils Behavioral Dynamics of V1 Activity in Freely Moving Mice

Large-scale two-photon imaging revealed super-sparse population codes in V1 superficial layer of awake monkeys.

A large-scale standardized physiological survey reveals functional organization of the mouse visual cortex

The Visual Brain: Computing Through Multiscale Complexity

Efficient coding of natural images in the mouse visual cortex

Single-cell optogenetics reveals attenuation-by-suppression in visual cortical neurons

Highly Selective Receptive Fields in Mouse Visual Cortex

Neuron populations across layer 2-6 in the mouse visual cortex exhibit different coding abilities in the awake mice