Abstract:Midlevel features, such as contour and texture, provide a computational link between low- and high-level visual representations. Although the nature of midlevel representations in the brain is not fully understood, past work has suggested a texture statistics model, called the P-S model (Portilla and Simoncelli, 2000), is a candidate for predicting neural responses in areas V1-V4 as well as human behavioral data. However, it is not currently known how well this model accounts for the responses of higher visual cortex to natural scene images. To examine this, we constructed single-voxel encoding models based on P-S statistics and fit the models to fMRI data from human subjects (both sexes) from the Natural Scenes Dataset (Allen et al., 2022). We demonstrate that the texture statistics encoding model can predict the held-out responses of individual voxels in early retinotopic areas and higher-level category-selective areas. The ability of the model to reliably predict signal in higher visual cortex suggests that the representation of texture statistics features is widespread throughout the brain. Furthermore, using variance partitioning analyses, we identify which features are most uniquely predictive of brain responses and show that the contributions of higher-order texture features increase from early areas to higher areas on the ventral and lateral surfaces. We also demonstrate that patterns of sensitivity to texture statistics can be used to recover broad organizational axes within visual cortex, including dimensions that capture semantic image content. These results provide a key step forward in characterizing how midlevel feature representations emerge hierarchically across the visual system.SIGNIFICANCE STATEMENT Intermediate visual features, like texture, play an important role in cortical computations and may contribute to tasks like object and scene recognition. Here, we used a texture model proposed in past work to construct encoding models that predict the responses of neural populations in human visual cortex (measured with fMRI) to natural scene stimuli. We show that responses of neural populations at multiple levels of the visual system can be predicted by this model, and that the model is able to reveal an increase in the complexity of feature representations from early retinotopic cortex to higher areas of ventral and lateral visual cortex. These results support the idea that texture-like representations may play a broad underlying role in visual processing.

Texture feature extraction simulating the structure of V1 in the cortex

Feature Extraction Inspired by V1 in Visual Cortex

Edge detection based on characteristic of V1 cells

Analysis of Texture Images Generated by Olfactory System Bionic Model

Brain-inspired edge detection model

Feature Extraction Inspired by Visual Cortex Mechanisms.

A Method of SAR Image Edge Detection by Modeling the Properties of V1 in Cortex

Motion Feature Extraction of Random-Dot Video Sequences with the Visual Cortex Mechanism

A Computational Model That Realizes a Sparse Representation of the Primary Visual Cortex V1

A SOM Network Model for Feature Extraction by Hyper Columns Architecture of Primary Visual Cortex

Biological Visual Features Extraction Method Combined with Sparse Coding

A New Image Edge Detection Method Inspired from Biological Visual Cortex

New Spiking Cortical Model for Invariant Texture Retrieval and Image Processing

Edge Detection Based on Primary Visual Pathway

A model of primary visual sense with wavelets characterization

A Model of Early Vision Applying to Image Processing

A New Complex Cell-Inspired Feature Extraction Method

Feature Extraction of Wood Defect Reconstructed Images Based on the C-V Model

A Texture Statistics Encoding Model Reveals Hierarchical Feature Selectivity across Human Visual Cortex

A Computational Model of Early Vision Based on Synchronized Response and Inner Product Operation.

Organic Convolution in The Ventral Visual Pathway Can Explain the Variety of Shape Tuning in Area V4