Abstract:Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face-selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self-organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye-gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.

The Effect of Learning on the Face Selective Responses of Neurons in the Cortex in the Superior Temporal Sulcus of the Monkey.

Neurons in the Cortex of the Temporal-Lobe and in the Amygdala of the Monkey with Responses Selective for Faces

Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey

The Role of Expression and Identity in the Face-Selective Responses of Neurons in the Temporal Visual Cortex of the Monkey

Visual Neurones Responsive to Faces in the Monkey Temporal Cortex

Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey

The responses of neurons in the temporal cortex of primates, and face identification and detection

Translation Invariance in the Responses to Faces of Single Neurons in the Temporal Visual Cortical Areas of the Alert Macaque.

The responses of neurons in the cortex in the superior temporal sulcus of the monkey to band-pass spatial frequency filtered faces

Neurophysiological Mechanisms Underlying Face Processing Within and Beyond the Temporal Cortical Visual Areas.

The Responses of Single Neurons in the Temporal Visual Cortical Areas of the Macaque when More Than One Stimulus is Present in the Receptive Field.

Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus in the monkey

Face processing in different brain areas, and critical band masking

Neurons in the amygdala of the monkey with responses selective for faces.

Object-centered Encoding by Face-Selective Neurons in the Cortex in the Superior Temporal Sulcus of the Monkey.

The representation of information about faces in the temporal and frontal lobes

Neuronal Responses Related to the Novelty and Familiarity of Visual Stimuli in the Substantia Innominata, Diagonal Band of Broca and Periventricular Region of the Primate Basal Forebrain

Information in the Neuronal Representation of Individual Stimuli in the Primate Temporal Visual Cortex

Organization And Functions Of Cells Responsive To Faces In The Temporal Cortex

Intracellular Properties of Deep-Layer Pyramidal Neurons in Frontal Eye Field of Macaque Monkeys

Sparseness of the Neuronal Representation of Stimuli in the Primate Temporal Visual-Cortex