Abstract:Automatic facial expression coding of infants plays an important role in infants-related applications, including computer-aided ASD diagnosis, automatic intervention for ASD children and diagnosis of ADHD, etc. However, most of existing facial expression researches focused on adult facial expression analysis, the infant facial expression recognition has been less investigated. Due to an age gap between the facial expression datasets of adults and infants, a facial expression recognition model trained on adult datasets usually shows poor generalization to infants datasets. A labeled infant facial expression dataset can mitigate this problem, and hence we first collect a facial expression dataset of 30 infants under 24 months of age by recording videos of infants’ facial expression during a face-to-face mother-infant interaction. Due to infants spontaneous facial behaviors, the dataset covers multiple challenges, such as large head-poses, occlusion, facial expression intensities, etc. To develop an automatic facial expression coding system, we propose a framework consisted of adaptive region learning and island loss, i.e., ARL-IL, to self-adaptively discover facial regions with higher discriminability between different emotion classes. The framework was verified on our collected dataset, and attained a classification accuracy of 86.86%, which has shown better performance than conventional method based on hand-crafted features and some basic CNN architectures. To interpret the effectiveness of ARL-IL, we also visualize the learned features and find that the proposed framework focuses on facial regions with more emotion information compared with other hand-crafted features or learned features from basic CNN architectures. The experimental results show that our proposed framework has robustness to the large head-poses and occlusion.

Automatic Smile Detection of Infants in Mother-Infant Interaction Via CNN-based Feature Learning

ARL-IL CNN for Automatic Facial Expression Recognition of Infants under 24 Months of Age

Detecting Discomfort in Infants Through Facial Expressions

Facial Smile Detection Based On Deep Learning Features

Detecting Smiles of Young Children Via Deep Transfer Learning.

Smile detection in the wild based on transfer learning

Infant Facial Expression Analysis Towards Defecation Detection

Deep Convolution Network Based Emotion Analysis for Automatic Detection of Mild Cognitive Impairment in the Elderly

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Novel Multi-Convolutional Neural Network Fusion Approach for Smile Recognition

A Multi-center Clinical Trial for Camera-based Infant Sleep and Awake Detection in Neonatal Intensive Care Unit

Towards Automatic Engagement Recognition of Autistic Children in a Machine Learning Approach.

Attention mechanism-based CNN for facial expression recognition

Recognition of Infants' Gaze Behaviors and Emotions.

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Deep Learning System for Automatic Diagnosis of Ocular Diseases in Infants

AI-Powered Human-Computer Interaction Assisting Early Identification of Emotional and Facial Symptoms of Autism Spectrum Disorder in Children: “A Deep Learning-Based Enhanced Facial Feature Recognition System”

Video-based Discomfort Detection for Infants.

Fine-Grained Facial Expression Recognition in Multiple Smiles

CFEW: A Large-Scale Database for Understanding Child Facial Expression in Real World

Coding infant engagement in the Face-to-Face Still-Face paradigm using deep neural networks