Abstract:Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face-selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self-organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye-gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.

The influence of familiarity on brain activation during haptic exploration of 3-D facemasks

Investigating the role of visual experience with face-masks in face recognition during COVID-19

Early visual exposure primes future cross-modal specialization of the fusiform face area in tactile face processing in the blind

On the brain struggles to recognize basic facial emotions with face masks: an fMRI study

Early visual experience and the recognition of basic facial expressions: involvement of the middle temporal and inferior frontal gyri during haptic identification by the early blind

Familiarity enhances functional connectivity between visual and nonvisual regions of the brain during natural viewing

The Fusiform Face Area is Engaged in Holistic, Not Parts-Based, Representation of Faces.

Familiarity Is Key: Exploring the Effect of Familiarity on the Face-Voice Correlation

The Neural Correlates of Covert Recognition of Familiar Faces

A robust neural index of automatic generalization across variable natural views of familiar face identities

Face processing in different brain areas, and critical band masking

Functional Dissociation of the Left and Right Fusiform Gyrus in Self‐face Recognition

The prefrontal cortex is differentially involved in implicit and explicit facial emotion processing: An fNIRS study

Functional Lateralization of Face Processing

High Familiar Faces Have Both Part Recognition and Holistic Processing Advantages

Different activation signatures in the primary sensorimotor and higher-level regions for haptic three-dimensional curved surface exploration

Characterizing the shared signals of face familiarity: Long-term acquaintance, voluntary control, and concealed knowledge

A Study of Specific Neural Substrate for Face Processing

Rapid integration of face detection and task set in visually guided reaching

The anterior fusiform gyrus: the ghost in the cortical face machine

Intracerebral electrical stimulation of the face-selective right lateral fusiform gyrus transiently impairs face identity recognition