Pattern completion and disruption characterize contextual modulation in the visual cortex

Jiakun Fu,Suhas Shrinivasan,Luca Baroni,Zhuokun Ding,Paul G. Fahey,Paweł A. Pierzchlewicz,Kayla Ponder,Rachel Froebe,Lydia Ntanavara,Taliah Muhammad,Konstantin F. Willeke,Eric Wang,Zhiwei Ding,Dat T. Tran,Stelios Papadopoulos,Saumil Patel,Jacob Reimer,Alexander S. Ecker,Xaq Pitkow,Jan Antolik,Fabian H. Sinz,Ralf M. Häfner,Andreas S. Tolias,Katrin Franke

DOI: https://doi.org/10.1101/2023.03.13.532473

2024-05-09

Abstract:Vision is fundamentally context-dependent, with neuronal responses influenced not just by local features but also by surrounding contextual information. In the visual cortex, studies using simple grating stimuli indicate that congruent stimuli—where the center and surround share the same orientation—are more inhibitory than when orientations are orthogonal, potentially serving redundancy reduction and predictive coding. Understanding these center-surround interactions in relation to natural image statistics is challenging due to the high dimensionality of the stimulus space, yet crucial for deciphering the neuronal code of real-world sensory processing. Utilizing large-scale recordings from mouse V1, we trained convolutional neural networks (CNNs) to predict and synthesize surround patterns that either optimally suppressed or enhanced responses to center stimuli, confirmed by experiments. Contrary to the notion that congruent stimuli are suppressive, we found that surrounds that completed patterns based on natural image statistics were facilitatory, while disruptive surrounds were suppressive. Applying our CNN image synthesis method in macaque V1, we discovered that pattern completion within the near surround occurred more frequently with excitatory than with inhibitory surrounds, suggesting that our results in mice are conserved in macaques. Further, experiments and model analyses confirmed previous studies reporting the opposite effect with grating stimuli in both species. Using the MICrONS functional connectomics dataset, we observed that neurons with similar feature selectivity formed excitatory connections regardless of their receptive field overlap, aligning with the pattern completion phenomenon observed for excitatory surrounds. Finally, our empirical results emerged in a normative model of perception implementing Bayesian inference, where neuronal responses are modulated by prior knowledge of natural scene statistics. In summary, our findings identify a novel relationship between contextual information and natural scene statistics and provide evidence for a role of contextual modulation in hierarchical inference.

Neuroscience

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how center - surround interactions are affected by the statistical characteristics of natural images in the visual cortex, and how these interactions influence the responses of neurons to visual stimuli. Specifically, the researchers focus on:

1. **Center - surround modulation mechanism**: Traditional research mainly uses simple grating stimuli to explore the center - surround modulation mechanism in the visual cortex, but these studies usually assume that the stimuli in the center area and the surround area have specific parametric characteristics (such as orientation consistency). However, this simplified method may not be able to fully capture the complexity and diversity in natural visual scenes. Therefore, this paper aims to explore new laws of center - surround modulation by using natural images and complex non - parametric stimuli to more realistically simulate the visual processing process in the natural environment.

2. **The relationship between natural image statistics and neuronal responses**: The researchers hope to experimentally verify whether the statistical characteristics of natural images will affect the center - surround modulation pattern of neurons in the visual cortex. For example, when the surround stimulus forms a coherent pattern with the center stimulus spatially, will it enhance the neuronal response; and when the surround stimulus disrupts this coherence, will it inhibit the neuronal response.

3. **Consistency across species**: In addition, this study also attempts to verify whether the center - surround modulation phenomenon observed in mice also exists in primates (such as rhesus monkeys), thereby evaluating the universality and biological significance of these findings.

Through these studies, the paper hopes to reveal the deep - seated principles of center - surround modulation in the visual cortex and provide a new perspective for understanding how the brain efficiently processes complex natural scenes.