Abstract:The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, interactions, and their relationship to human perception, we investigated neural responses and perceptual similarity judgements to a large set of visual stimuli that varied parametrically along four feature dimensions. We measured neural responses using electroencephalography (N = 16) to 256 grating stimuli that varied in orientation, spatial frequency, contrast, and colour. We then mapped the response profiles of the neural coding of each visual feature and their interactions, and related these to independently obtained behavioural judgements of stimulus similarity. The results confirmed fundamental principles of feature coding in the visual system, such that all four features were processed simultaneously but differed in their dynamics, and there was distinctive conjunction coding for different combinations of features in the neural responses. Importantly, modelling of the behaviour revealed that every stimulus feature contributed to perceptual judgements, despite the untargeted nature of the behavioural task. Further, the relationship between neural coding and behaviour was evident from initial processing stages, signifying that the fundamental features, not just their interactions, contribute to perception. This study highlights the importance of understanding how feature coding progresses through the visual hierarchy and the relationship between different stages of processing and perception. This study investigates the foundational computations in the human early visual cortex that underlie visual perception. Using electroencephalography (EEG), neural responses to 256 grating stimuli with variations in orientation, spatial frequency, contrast, and colour were measured in 16 participants. We explored how the neural coding of these visual features and their interactions relate to perceptual similarity judgments. Results confirmed simultaneous processing of all four features with distinct dynamics, revealing conjunction coding for various feature combinations. Behavioural modelling demonstrated that each stimulus feature contributes to perceptual judgments. This work emphasizes the significance of understanding feature coding progression through the visual hierarchy and its relationship to perception from early processing stages.

Unveiling coding of prediction and sharpening of perceptual features through multivariate pattern analysis

Prediction error processing and sharpening of expected information across the face-processing hierarchy

Balancing the Stability and Predictive Performance for Multivariate Voxel Selection in fMRI Study.

Mining Temporal Dynamics with Support Vector Machine for Predicting the Neural Fate of Target in Attentional Blink

Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception

Crossmodal hierarchical predictive coding for audiovisual sequences in the human brain

High-level visual prediction errors in early visual cortex

Decoding visual stimuli in human brain by using Anatomical Pattern Analysis on fMRI images

Predictive learning shapes the representational geometry of the human brain

Anatomical Pattern Analysis for decoding visual stimuli in human brains

Neural Univariate Activity and Multivariate Pattern in the Posterior Superior Temporal Sulcus Differentially Encode Facial Expression and Identity

Decoding Visual Feature Versus Visual Spatial Attention Control with Deep Neural Networks

Computational components of visual predictive coding circuitry

Predictions enable top-down pattern separation in the macaque face-processing hierarchy

Subjective confidence modulates individual BOLD patterns of predictive processing

Violated predictions enhance the representational fidelity of visual features in perception

Predictive Coding: a Theoretical and Experimental Review

Expectations guide predictive eye movements and information sampling during face recognition

Mapping the dynamics of visual feature coding: Insights into perception and integration

Predictive Coding in Area V4: Dynamic Shape Discrimination under Partial Occlusion

Unidirectional brain-computer interface: Artificial neural network encoding natural images to fMRI response in the visual cortex