Abstract:Neurons throughout the brain modulate their firing rate lawfully in response to sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization in which neurons aim to robustly and efficiently represent sensory information. Our understanding of how this optimization varies across different areas in the brain, however, is still in its infancy. Here, we show that neural sensory responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation towards optimizing for perceptual discrimination. Focusing on the representation of binocular disparities—the slight differences in the retinal images of the two eyes—we re-analyze measurements characterizing neuronal tuning curves in brain areas V1, V2, and MT (middle temporal) in the macaque monkey. We compare these to measurements of the statistics of binocular disparity typically encountered during natural behaviors using a Fisher Information framework. The differences in tuning curve characteristics across areas are consistent with a shift in optimization goals: V1 and V2 population-level responses are more consistent with maximizing the information encoded about naturally occurring binocular disparities, while MT responses shift towards maximizing the ability to support disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective areas of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings emphasize the need to consider not just information preservation and neural resources, but also relevance to behavior, when assessing the optimality of neural codes. The nervous system needs to transform information from the sensory organs into signals that can be used to guide behavior. Neural activity is noisy and can consume large amount of energy, so sensory neurons must optimize their information processing so as to limit energy consumption while maintaining key behaviorally-relevant information. In this report, we re-examine classically-defined brain areas in the visual processing hierarchy, and ask whether neurons in these areas vary lawfully in how they represent sensory information. Our results suggest that neurons in these brain areas shift from being an optimal conduit for conveying sensory information towards prioritizing information that supports key perceptual discriminations during natural tasks.

Interneuron diversity and normalization specificity in a visual system

Neuronal heterogeneity of normalization strength in a circuit model

Feature-specific divisive normalization improves natural image encoding for depth perception

Cascaded normalizations for spatial integration in the primary visual cortex of primates

The divisive normalization model of visual number sense: model predictions and experimental confirmation

Perceptual Resolution of Ambiguity: Can Tuned, Divisive Normalization Account for both Interocular Similarity Grouping and Difference Enhancement

The functional organization of high-level visual cortex determines the representation of complex visual stimuli

Visual information is broadcast among cortical areas in discrete channels

Unifying sparse coding, predictive coding, and divisive normalization

Differential temporal filtering in the fly optic lobe

Computational model links normalization to chemoarchitecture in the human visual system

Adaptation of retinal discriminability to natural scenes

Optogenetic Activation of Normalization in Alert Macaque Visual Cortex

Heterogeneity of synaptic connectivity in the fly visual system

Single neuron diversity supports area functional specialization along the visual cortical pathways

Multidimensional analysis of cortical interneuron synaptic features reveals underlying synaptic heterogeneity

Universal transition from unstructured to structured neural maps

Sparse Identification of Contrast Gain Control in the Fruit Fly Photoreceptor and Amacrine Cell Layer

SS-Norm: Spectral-spatial Normalization for Single-Domain Generalization with Application to Retinal Vessel Segmentation.

Population coding under normalization

Transformations of sensory information in the brain suggest changing criteria for optimality