Abstract:The human brain is tuned to recognize emotional facial expressions in faces having a natural upright orientation. The relative contributions of featural, configural, and holistic processing to decision-making are as yet poorly understood. This study used a diffusion decision model (DDM) of decision-making to investigate the contribution of early face-sensitive processes to emotion recognition from physiognomic features (the eyes, nose, and mouth) by determining how experimental conditions tapping those processes affect early face-sensitive neuroelectric reflections (P100, N170, and P250) of processes determining evidence accumulation at the behavioral level. We first examined the effects of both stimulus orientation (upright vs. inverted) and stimulus type (photographs vs. sketches) on behavior and neuroelectric components (amplitude and latency). Then, we explored the sources of variance common to the experimental effects on event-related potentials (ERPs) and the DDM parameters. Several results suggest that the N170 indicates core visual processing for emotion recognition decision-making: (a) the additive effect of stimulus inversion and impoverishment on N170 latency; and (b) multivariate analysis suggesting that N170 neuroelectric activity must be increased to counteract the detrimental effects of face inversion on drift rate and of stimulus impoverishment on the stimulus encoding component of non-decision times. Overall, our results show that emotion recognition is still possible even with degraded stimulation, but at a neurocognitive cost, reflecting the extent to which our brain struggles to accumulate sensory evidence of a given emotion. Accordingly, we theorize that: (a) the P100 neural generator would provide a holistic frame of reference to the face percept through categorical encoding; (b) the N170 neural generator would maintain the structural cohesiveness of the subtle configural variations in facial expressions across our experimental manipulations through coordinate encoding of the facial features; and (c) building on the previous configural processing, the neurons generating the P250 would be responsible for a normalization process adapting to the facial features to match the stimulus to internal representations of emotional expressions.

The neuropsychological evaluation of face identity recognition

Intracerebral electrical stimulation of the face-selective right lateral fusiform gyrus transiently impairs face identity recognition

Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect

Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography

An Iterative Approach for EEG based Rapid Face Search: A Refined Retrieval by Brain Computer Interfaces

Congenital prosopagnosia: multistage anatomical and functional deficits in face processing circuitry

A robust neural index of automatic generalization across variable natural views of familiar face identities

The Executive Control of Face Memory

A Rapid Face Recognition Bci System Using Single-Trial Erp

The anterior fusiform gyrus: the ghost in the cortical face machine

Face imagery and its relation to perception and covert recognition in prosopagnosia

EEG-FRM: a neural network based familiar and unfamiliar face EEG recognition method

Brain Processes While Struggling With Evidence Accumulation During Facial Emotion Recognition: An ERP Study

The Contribution of the Face-Name Associative Recognition Test to Objectifying the Impairment of Associative Memory in Subjective Cognitive Decline

Decoding face recognition abilities in the human brain

(Micro)saccade-related potentials during face recognition: A study combining EEG, eye-tracking, and deconvolution modeling

Real and Deepfake Face Recognition: An EEG Study on Cognitive and Emotive Implications

The Neural Network for Face Recognition: Insights from an Fmri Study on Developmental Prosopagnosia.

A Randomized Trial Utilizing EEG Brain Computer Interface to Improve Facial Emotion Recognition in Autistic Adults

Relationship between individual differences in functional connectivity and facial-emotion recognition abilities in adults with traumatic brain injury

Simultaneous EEG–fMRI reveals brain networks underlying recognition memory ERP old/new effects