Abstract:The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, interactions, and their relationship to human perception, we investigated neural responses and perceptual similarity judgements to a large set of visual stimuli that varied parametrically along four feature dimensions. We measured neural responses using electroencephalography (N = 16) to 256 grating stimuli that varied in orientation, spatial frequency, contrast, and colour. We then mapped the response profiles of the neural coding of each visual feature and their interactions, and related these to independently obtained behavioural judgements of stimulus similarity. The results confirmed fundamental principles of feature coding in the visual system, such that all four features were processed simultaneously but differed in their dynamics, and there was distinctive conjunction coding for different combinations of features in the neural responses. Importantly, modelling of the behaviour revealed that every stimulus feature contributed to perceptual judgements, despite the untargeted nature of the behavioural task. Further, the relationship between neural coding and behaviour was evident from initial processing stages, signifying that the fundamental features, not just their interactions, contribute to perception. This study highlights the importance of understanding how feature coding progresses through the visual hierarchy and the relationship between different stages of processing and perception. This study investigates the foundational computations in the human early visual cortex that underlie visual perception. Using electroencephalography (EEG), neural responses to 256 grating stimuli with variations in orientation, spatial frequency, contrast, and colour were measured in 16 participants. We explored how the neural coding of these visual features and their interactions relate to perceptual similarity judgments. Results confirmed simultaneous processing of all four features with distinct dynamics, revealing conjunction coding for various feature combinations. Behavioural modelling demonstrated that each stimulus feature contributes to perceptual judgments. This work emphasizes the significance of understanding feature coding progression through the visual hierarchy and its relationship to perception from early processing stages.

Coordinated optimization of visual cortical maps (I) Symmetry-based analysis

The coordinated mapping of visual space and response features in visual cortex.

Parsimony, exhaustivity and balanced detection in neocortex

Analytic model for feature maps in the primary visual cortex

New Photodetection Method Using Unbalanced Sidebands for Squeezed Quantum Noise in Gravitational Wave Interferometer

Origins of Functional Organization in the Visual Cortex

Random wiring, ganglion cell mosaics, and the functional architecture of the visual cortex

Natural Scene Statistics and the Structure of Orientation Maps in the Visual Cortex

Universal transition from unstructured to structured neural maps

Mutual consistency of multiple visual feature maps constrains combined map topology

Optimizing Visual Cortex Parameterization with Error-Tolerant Teichmuller Map in Retinotopic Mapping

Ocular dominance patterns in mammalian visual cortex: A wire length minimization approach

Developmental Designs and Adult Functions of Cortical Maps in Multiple Modalities: Perception, Attention, Navigation, Numbers, Streaming, Speech, and Cognition

Does the Cerebral Cortex Exploit High-Dimensional, Non-linear Dynamics for Information Processing?

Mapping the dynamics of visual feature coding: Insights into perception and integration

Can Retinal Ganglion Cell Dipoles Seed Iso-Orientation Domains in the Visual Cortex?

A Survey of Architecture and Function of the Primary Visual Cortex (V1)

Self-organized emergence of modularity, hierarchy, and mirror reversals from competitive synaptic growth in a developmental model of the visual pathway

Adaptive Scales of Spatial Integration and Response Latencies in a Critically-Balanced Model of the Primary Visual Cortex

Testing Hubel and Wiesel's "ice-cube" model of functional maps at cellular resolution in macaque V1

Functional maps of the primate cortex revealed by through-skull wide-field optical imaging