Abstract:Humans and other primates can rapidly detect familiar objects and distinguish them from never-before-seen novel objects. We have an astonishing capacity to remember the details of visual scenes even after a single, fleeting experience. This ability is thought to rely in part on experience-dependent changes in the primate inferotemporal cortex (IT). Single neurons in IT encode visual familiarity by discriminating between novel and familiar stimuli, with stronger neural activity on average for novel images. However, key open questions are to understand how neural encoding in IT changes as images progress from novel to highly familiar, and what learning rules and computations can account for learning-dependent changes in IT activity. Here, we investigate the timescales over which novel stimuli become familiar by recording in IT as initially novel images become increasingly familiar both within and across days. We identified salient and persistent memory-related signals in IT that spanned multiple timescales of minutes, hours, and days. Average neural activity progressively decreased with familiarity as firing rates were strongest for novel, weaker for intermediately familiar, and weakest for highly familiar images. Neural signatures of familiarity learning were slow to develop as response reductions to initially-novel images emerged gradually over multiple days (or hundreds of views) of visual experience. In addition to slow changes that emerged across sessions, neural responses to novel images showed rapid decreases with familiarity within single sessions. To gain insight into the mechanisms underlying changes of visual responses with familiarity, we use computational modeling to investigate which plasticity rules are consistent with these changes. Learning rules inferred from the neural data revealed a strong diversity with many neurons following a ‘negative’ plasticity rule as they exhibited synaptic depression over the course of learning across multiple days. A recurrent network model with two plasticity time constants – a slow time constant for long timescales and a fast time constant for short timescales – captured key dynamic features accompanying the transition from novel to familiar, including a gradual decrease in firing rates over multiple sessions, and a rapid decrease in firing rates within single sessions. Our findings suggest that distinct and complementary plasticity rules operating at different timescales may underlie the inferotemporal code for visual familiarity.

The time it takes to truly know someone: Neurophysiological correlates of face and identity learning during the first two years

Single trial ERP amplitudes reveal the time course of acquiring representations of novel faces in individual participants

Temporal Dynamics of the Neural Representation of Social Relationships

The temporal dynamics of familiar face recognition: Event-related brain potentials reveal the efficient activation of facial identity representations

Neural Correlates of Face Familiarity Perception

Revisiting the Earliest Electrophysiological Correlate of Familiar Face Recognition.

Characterizing the shared signals of face familiarity: Long-term acquaintance, voluntary control, and concealed knowledge

Visual familiarity learning at multiple timescales in the primate inferotemporal cortex

Learning own- and other-race facial identities: Testing implicit recognition with event-related brain potentials

A robust neural index of automatic generalization across variable natural views of familiar face identities

Combining Real‐Time Neuroimaging With Machine Learning to Study Attention to Familiar Faces During Infancy: A Proof of Principle Study

Medial prefrontal and occipito-temporal activity at encoding determines enhanced recognition of threatening faces after 1.5 years

This is me! Neural correlates of self‐recognition in 6‐ to 8‐month‐old infants

Comparison with others influences encoding and recognition of their faces: Behavioural and ERP evidence

Shared neural codes of recognition memory

5-year-olds' Featural Information Recognition of Familiar Faces

Better face-name recall is associated with better face recognition ability

Familiarity Is Key: Exploring the Effect of Familiarity on the Face-Voice Correlation

Relationship evolution shapes inter-brain synchrony in affective sharing: The role of self-expansion

Social Perception in the Infant Brain and Its Link to Social Behavior

Using Event-Related Potentials (ERP) to identify the purchase intention of a consumer for familiar brands