Abstract:Facial expressions are among the earliest behaviors infants use to express emotional states, and are crucial to preverbal social interaction. Manual coding of infant facial expressions, however, is laborious and poses limitations to replicability. Recent developments in computer vision have advanced automated facial expression analyses in adults, providing reproducible results at lower time investment. Baby FaceReader 9 is commercially available software for automated measurement of infant facial expressions, but has received little validation. We compared Baby FaceReader 9 output to manual micro-coding of positive, negative, or neutral facial expressions in a longitudinal dataset of 58 infants at 4 and 8 months of age during naturalistic face-to-face interactions with the mother, father, and an unfamiliar adult. Baby FaceReader 9's global emotional valence formula yielded reasonable classification accuracy ( AUC = .81) for discriminating manually coded positive from negative/neutral facial expressions; however, the discrimination of negative from neutral facial expressions was not reliable ( AUC = .58). Automatically detected a priori action unit (AU) configurations for distinguishing positive from negative facial expressions based on existing literature were also not reliable. A parsimonious approach using only automatically detected smiling (AU12) yielded good performance for discriminating positive from negative/neutral facial expressions ( AUC = .86). Likewise, automatically detected brow lowering (AU3+AU4) reliably distinguished neutral from negative facial expressions ( AUC = .79). These results provide initial support for the use of selected automatically detected individual facial actions to index positive and negative affect in young infants, but shed doubt on the accuracy of complex a priori formulas.

Validation of the child models of the Radboud Faces Database by children

Validating the Radboud faces database from a child’s perspective

Presentation and validation of the Radboud Faces Database

Trait Ratings for the Radboud Faces Database

Facial expression analysis with AFFDEX and FACET: A validation study

Human and machine validation of 14 databases of dynamic facial expressions

Validation of dynamic virtual faces for facial affect recognition

Recognizing Emotions through Facial Expressions: A Largescale Experimental Study

A novel database of children's spontaneous facial expressions (LIRIS-CSE)

Automated facial expression measurement in a longitudinal sample of 4- and 8-month-olds: Baby FaceReader 9 and manual coding of affective expressions

Emotional expression visual mismatch negativity in children

Cross-cultural emotion recognition and evaluation of Radboud faces database with an Indian sample

The Qingdao Preschooler Facial Expression Set: Acquisition and Validation of Chinese Children’s Facial Emotion Stimuli

No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces

Facial emotion labeling in unaffected offspring of adults with bipolar I disorder

Emotional face processing across neurodevelopmental disorders: a dynamic faces study in children with autism spectrum disorder, attention deficit hyperactivity disorder and obsessive-compulsive disorder

Adults as Augmentations for Children in Facial Emotion Recognition with Contrastive Learning

The Nature of Facial Emotion Recognition Impairments in Children on the Autism Spectrum

Facial Expressions of Emotions: Recognition Accuracy and Affective Reactions During Late Childhood

Perceived emotion genuineness: normative ratings for popular facial expression stimuli and the development of perceived-as-genuine and perceived-as-fake sets

Emotion Classification of Children Expressions