Retinotopic biases in contextual feedback signals to V1 for object and scene processing

Matthew A. Bennett,Lucy S. Petro,Clement Abbatecola,Lars Muckli
DOI: https://doi.org/10.1101/2024.03.26.586553
2024-03-29
Abstract:Identifying the objects embedded in natural scenes relies on recurrent processing between lower and higher visual areas. How is cortical feedback information related to objects and scenes organised in lower visual areas? The spatial organisation of cortical feedback converging in early visual cortex during object and scene processing could be retinotopically specific as it is coded in V1, or object centred as coded in higher areas, or both. Here, we characterise object and scene-related feedback information to V1. Participants identified foreground objects or background scenes in images with occluded central and peripheral subsections, allowing us to isolate feedback activity to foveal and peripheral regions of V1. Using fMRI and multivoxel pattern classification, we found that feedback of object information is projected to foveal V1 cortex with increased detail during an object identification task. Background scene information is projected to both foveal and peripheral V1 but can be disrupted by a sufficiently demanding object discrimination task. We suggest that the feedback connections during scene perception project back to earlier visual areas an automatic sketch of occluded information to the predicted retinotopic location. In the case of a cognitive task however, feedback pathways project content to foveal retinotopic space, potentially for introspection, functioning as a cognitive active blackboard and not necessarily predicting the object’s location. This feedback architecture could reflect the internal mapping in V1 of the brain’s endogenous models of the visual environment that are used to predict perceptual inputs.
Neuroscience
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: In the process of visual processing, how is the information fed back from high - level visual areas to the primary visual cortex (V1) organized? Specifically, the researchers want to understand whether the feedback signals are retinotopically specific (i.e., in one - to - one correspondence with retinal positions) when processing objects and scenes, or whether these signals are more likely to be organized in an object - centered way, or both. ### Research Background The brain acquires knowledge about the external world by generating predictions of upcoming sensory inputs and sending these predictions to lower - level stages through cortical feedback pathways. This feedback mechanism is particularly important in the visual system because it can help interpret feed - forward information, predict perceptual inputs, and learn when predictions fail. The cortical areas of the visual system are interconnected and hierarchically organized, and these areas encode an internal model of the visual world and use cortical feedback signals to contextualize or predict feed - forward information. ### Specific Problems 1. **Organization of Feedback Information**: The researchers want to determine whether the information fed back from high - level visual areas to the primary visual cortex (V1) is retinotopically specific or more likely to be organized in an object - centered way. 2. **Effect of Tasks on Feedback**: The researchers also explored how different tasks (such as object recognition tasks and scene recognition tasks) affect the processing of these feedback signals. ### Experimental Design To explore these questions, the researchers designed two experiments: - **Experiment 1**: Participants were required to identify the foreground objects or background scenes in images, and the central and edge parts of the images were occluded in order to isolate the performance of feedback activities in the central and edge regions of V1. - **Experiment 2**: Real objects in natural scenes were used to further verify the results of Experiment 1. ### Main Findings - **Feedback of Scene Information**: Scene information can be fed back both in the central and edge V1. However, when the task is more difficult (such as a complex object recognition task), the feedback of scene information will be disrupted. - **Feedback of Object Information**: Object information is mainly fed back to the central V1, especially when performing object recognition tasks. This indicates that when the task requires attention to a specific object, the feedback pathway will project information onto the central retinal space, possibly for introspection or cognitive operations. ### Conclusion The research results show that the primary visual cortex (V1) can flexibly utilize its high - resolution processing ability when processing objects and scenes, and adaptively recruit feedback information from high - level visual areas according to task requirements. This feedback mechanism not only depends on retinotopic specificity but is also affected by cognitive tasks, reflecting the high flexibility of the brain in processing complex visual information.