Abstract:Automatic facial expression coding of infants plays an important role in infants-related applications, including computer-aided ASD diagnosis, automatic intervention for ASD children and diagnosis of ADHD, etc. However, most of existing facial expression researches focused on adult facial expression analysis, the infant facial expression recognition has been less investigated. Due to an age gap between the facial expression datasets of adults and infants, a facial expression recognition model trained on adult datasets usually shows poor generalization to infants datasets. A labeled infant facial expression dataset can mitigate this problem, and hence we first collect a facial expression dataset of 30 infants under 24 months of age by recording videos of infants’ facial expression during a face-to-face mother-infant interaction. Due to infants spontaneous facial behaviors, the dataset covers multiple challenges, such as large head-poses, occlusion, facial expression intensities, etc. To develop an automatic facial expression coding system, we propose a framework consisted of adaptive region learning and island loss, i.e., ARL-IL, to self-adaptively discover facial regions with higher discriminability between different emotion classes. The framework was verified on our collected dataset, and attained a classification accuracy of 86.86%, which has shown better performance than conventional method based on hand-crafted features and some basic CNN architectures. To interpret the effectiveness of ARL-IL, we also visualize the learned features and find that the proposed framework focuses on facial regions with more emotion information compared with other hand-crafted features or learned features from basic CNN architectures. The experimental results show that our proposed framework has robustness to the large head-poses and occlusion.

Detecting Smiles of Young Children Via Deep Transfer Learning.

Smile detection in the wild based on transfer learning

Automatic Smile Detection of Infants in Mother-Infant Interaction Via CNN-based Feature Learning

ASDFace: Face-based Autism Diagnosis Via Heterogeneous Domain Adaptation

Deep Convolutional Neural Networks for Smile Recognition

Deep Adaptation of Adult-Child Facial Expressions by Fusing Landmark Features

Emotion Monitoring for Preschool Children Based on Face Recognition and Emotion Recognition Algorithms

Smile detection in unconstrained scenarios using self-similarity of gradients features

ARL-IL CNN for Automatic Facial Expression Recognition of Infants under 24 Months of Age

A New Perspective on Smiling and Laughter Detection: Intensity Levels Matter

How Do You Smile? Towards a Comprehensive Smile Analysis System

Age and Gender Prediction using Deep CNNs and Transfer Learning

Deep Emotion Transfer Network for Cross-database Facial Expression Recognition

A Deep Learning Approach for Recognizing Age, Emotion and Gender in Facial Expressions

Fine-Grained Facial Expression Recognition in Multiple Smiles

A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios.

Facial Expression Recognition Through Modeling Age-Related Spatial Patterns.

Discussions of Different Deep Transfer Learning Models for Emotion Recognitions

AI-Powered Human-Computer Interaction Assisting Early Identification of Emotional and Facial Symptoms of Autism Spectrum Disorder in Children: “A Deep Learning-Based Enhanced Facial Feature Recognition System”

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Children's Emotion Recognition Based on Convolutional Neural Network