Abstract:We present a novel methodology that exploits work in computer vision, for identifying the neural correlates of face perception. It involves creating a sequence of non-face natural images that, on the one hand, constitute a smoothly varying continuum in terms of image-level similarity to faces, and on the other hand yield categorical face/non-face responses from observers. We then determine which brain regions exhibit graded activity changes across the sequence and which are categorical. The key challenge in operationalizing this approach lies in compiling the collection of natural images that would constitute a continuum in a face-similarity space. We have addressed this challenge by using a state of the art machine-based face detection system. Given any image, the system spots faces therein and, on rare occasions, generates false positives (FAs). We have collected several hundred such FAs and rank-ordered them in terms of their similarity to faces (using computational norms and also ratings from human observers). The final collection comprises 300 images, ranging smoothly from being very distinct from faces to genuine faces. Similarity ratings change almost linearly across this set, while the face/non-face labels change categorically. Using fMRI, we investigated which brain regions correlate with categorical face/non-face judgments. As a preliminary test of the approach, an ROI analysis showed that fusiform face area exhibited perceptually congruent categorical responses. In contrast to high level activity induced by faces, all non-face images, irrespective of their similarity to faces led to low activations. These results illustrate of how the approach allows us to assess whether a given region's activity is involved in categorical judgments rather than just being correlated with low-level image structure. We shall describe the use of this approach with whole-brain responses to identify additional regions involved in face processing.

Discriminative neural pathways for perception-cognition activity of color and face in the human brain

Electrophysiological studies of color processing in human visual cortex

Distinct Patterns of Automatic and Controlled Incongruent Information Processing in the Human Brain

The Interplay of Attention and Conscious Perception: Evidence from Human Intracerebral Recordings and Computational Modeling

Human Sensory Cortex Structure and Top-Down Controlling Brain Network Determine Individual Differences in Perceptual Alternations.

Intracranial EEGs evidenced visual object processing in the human medial temporal lobe subregions

Neural Hierarchy of Color Categorization: from Prototype Encoding to Boundary Encoding.

The Representation of Color across the Human Visual Cortex: Distinguishing Chromatic Signals Contributing to Object Form Versus Surface Color

Stereoscopic processing of crossed and uncrossed disparities in the human visual cortex

Attentional modulation of perceptual grouping in human visual cortex: functional MRI studies.

Category Selectivity of Human Visual Cortex in Perception of Rubin Face–Vase Illusion

Mesoscale functional organization and connectivity of color, disparity, and naturalistic texture in human second visual area

Functional Dissociation of the Left Ventral Occipito-Temporal Cortex in the Direct and Indirect Retrieval of Color Features

Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain

Using Computer Vision to Probe the Neural Correlates of Categorical Face Perception

Decoding Color Responses in Human Visual Cortex

Investigating critical brain area for EEG-based binocular color fusion and rivalry with EEGNet

Differential brain mechanisms for processing distracting information in task‐relevant and ‐irrelevant dimensions in visual search

Preferential responses to occluded objects in the human visual cortex.

fMRI representational similarity analysis reveals graded preferences for chromatic and achromatic stimulus contrast across human visual cortex

Attentional Modulation of Perceptual Grouping in Human Visual Cortex: Erp Studies