Abstract:Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size, view, and spatial frequency of faces and objects, and that these neurons show rapid processing and rapid learning. Critical band spatial frequency masking is shown to be a property of these face-selective neurons and of the human visual perception of faces. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximizing the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalization, and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses generalize to other views of the same face. A theory is described of how such invariant representations may be produced by self-organizing learning in a hierarchically organized set of visual cortical areas with convergent connectivity. The theory utilizes either temporal or spatial continuity with an associative synaptic modification rule. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye-gaze, face view, and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the human orbitofrontal and pregenual cingulate cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.

Differential and temporally dynamic involvement of primate amygdala nuclei in face animacy and reward information processing

Beyond faces: the contribution of the amygdala to visual processing in the macaque brain

Dynamic coding and sequential integration of multiple reward attributes by primate amygdala neurons

Dopamine-dependent visual attention preference to social stimuli in nonhuman primates

Interaction between decision-making and interoceptive representations of bodily arousal in frontal cortex

Environmental context-dependent activation of dopamine neurons via putative amygdala-nigra pathway in macaques

Shared neural coding for social hierarchy and reward value in primate amygdala

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field

The amygdala's response to face and emotional information and potential category-specific modulation of temporal cortex as a function of emotion

The Primate Amygdala and Reinforcement: A Dissociation Between Rule-Based and Associatively-Mediated Memory Revealed in Neuronal Activity

Abstraction of Reward Context Facilitates Relative Reward Coding in Neural Populations of the Macaque Anterior Cingulate Cortex

Encoding of facial features by single neurons in the human amygdala and hippocampus

Real Face Value: The Processing of Naturalistic Facial Expressions in the Macaque Inferior Temporal Cortex

Decision-making shapes dynamic inter-areal communication within macaque ventral frontal cortex

Dynamic threat–reward neural processing under semi‐naturalistic ecologically relevant scenarios

Rapid responses of amygdala neurons discriminate facial expressions

Mixed Selectivity Coding of Content-Temporal Detail by Dorsomedial Posterior Parietal Neurons

Face processing in different brain areas, and critical band masking

Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex

Stimulus-driven and strategic neural responses to fearful and happy facial expressions in humans

Exploring distinct and joint contributions of the Locus Coeruleus and the Substantia Nigra/Ventral Tegmental Area complex to reward and valence processing using high-resolution fMRI