Abstract:Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face-selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self-organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye-gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.

Task Dependence and Level of Processing in Category-Specific Regions of the Ventral Stream

The Encoding of Category-Specific Versus Nonspecific Information in Human Inferior Temporal Cortex

Distinct Response Properties Between the FFA to Faces and the PPA to Houses

Visual high-level regions respond to high-level stimulus content in the absence of low-level confounds

Nonuniform and Pathway-Specific Laminar Processing of Spatial Frequencies in the Primary Visual Cortex of Primates

BOLD Signal Response Functions for Object and Face Processing in Noise

Distinct visual processing networks for foveal and peripheral visual fields

Regional Neural Response Differences in the Determination of Faces or Houses Positioned in a Wide Visual Field

Expectations of Faces and Words Differentially Activate the Primary Visual Cortex

Dissociated Modulations of Multivoxel Activation Patterns in the Ventral and Dorsal Visual Pathways by the Temporal Dynamics of Stimuli.

Data-point-wise spatiotemporal mapping of human ventral visual areas: Use of spatial frequency/luminance-modulated chromatic faces

Functional Subdomains within Scene-Selective Cortex: Parahippocampal Place Area, Retrosplenial Complex, and Occipital Place Area

617 Modulation of Brain Potentials by Hierarchical Processing: A High-Density ERP Study

Time-resolved Neural Effects of Attention Precuing and Spatial Location in the Left and Right Fusiform Face Areas.

The Representation Of Shape And Texture In Category‐Selective Regions Of Ventral‐Temporal Cortex

Differences In Neural Responses To Ipsilateral Stimuli I(N) Wide-View Fields Between Face- And House-Selective Areas

Functional Lateralization of Face Processing

Face processing in different brain areas, and critical band masking

The Neural Activation in Fusiform Face Area for Object Perception in Wide Visual Field.

The scope and limits of fine-grained image and category information in the ventral visual pathway