Abstract:Parkinson's disease (PD) is a neurodegenerative disease which is prevalent among the elder population and severely affects the life quality of patients and their families. Therefore, it is important to conduct an early diagnosis for potential patients with PD, so as to promote prompt treatment and avoid the aggravation of the disease. Recently, the in-vitro PD diagnosis based on facial expressions has received increasing attention because of its distinguishability (i.e., PD patients always possess the characteristics of “masked face”) and affordability. However, the performance of the existing facial expression-based PD diagnosis approaches is limited by: 1) the small-scale training data on PD patients' facial expressions, and 2) the weak prediction model. To address these two problems, we propose a new facial expression guided PD diagnosis method based on high-quality training data augmentation and deep neural network prediction. Specifically, the proposed method consists of three stages: Firstly, we synthesize virtual facial expression images with 6 basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise) based on multi-domain adversarial learning to approximate the premorbid expressions of PD patients. Secondly, we introduce three facial image quality assessment (FIQA) criteria to measure the quality of these synthesized facial expression images and design a fusion screening strategy that shortlists the high-quality ones to augment the training data. Finally, we train a deep neural network prediction model based on the original and synthesized high-quality facial expression images for PD diagnosis. To show real-world impacts and evaluate the proposed method under different facial expressions, we also create a (currently largest) multiple facial expressions-based PD face dataset in collaboration with a hospital. Extensive experiments are performed to demonstrate the effectiveness of the multi-domain adversarial learning-based facial expression synthesis and the fusion screening strategy, particularly the superior performance of the proposed method for PD diagnosis.

ASD Diagnosis Using Facial Expression Recognition and Gaze Estimation

ASDFace: Face-based Autism Diagnosis Via Heterogeneous Domain Adaptation

Early Diagnosis of ASD Based on Facial Expression Recognition and Head Pose Estimation

Automatic Classification of ASD Children Using Appearance-Based Features from Videos

Appearance-Based Gaze Estimation for ASD Diagnosis.

Classifying Individuals With Asd Through Facial Emotion Recognition And Eye-Tracking

Classification of autism severity levels using facial features and eye gaze patterns

Facial Expression Guided Diagnosis of Parkinson's Disease Via High-Quality Data Augmentation

Early Screening of ASD Based on Hand Gesture Analysis

Identification of ASD Children Based on Video Data.

Identifying Children with Autism Spectrum Disorder Via Transformer-Based Representation Learning from Dynamic Facial Cues

An Auxiliary Screening System for Autism Spectrum Disorder Based on Emotion and Attention Analysis

Multimodal Emotion Recognition for Children with Autism Spectrum Disorder in Social Interaction

Learning Visual Attention to Identify People with Autism Spectrum Disorder.

A Multimodal Approach for Identifying Autism Spectrum Disorders in Children

Enhancing Autism Detection Through Gaze Analysis Using Eye Tracking Sensors and Data Attribution with Distillation in Deep Neural Networks

Discriminative Few Shot Learning of Facial Dynamics in Interview Videos for Autism Trait Classification

Exploring Gaze Pattern in Autistic Children: Clustering, Visualization, and Prediction

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth.

Enhancing ASD Classification Through Hybrid Attention-Based Learning of Facial Features

Deep Learning Approach for Screening Autism Spectrum Disorder in Children with Facial Images and Analysis of Ethnoracial Factors in Model Development and Application