Abstract:Parkinson's disease (PD) is a neurodegenerative disease which is prevalent among the elder population and severely affects the life quality of patients and their families. Therefore, it is important to conduct an early diagnosis for potential patients with PD, so as to promote prompt treatment and avoid the aggravation of the disease. Recently, the in-vitro PD diagnosis based on facial expressions has received increasing attention because of its distinguishability (i.e., PD patients always possess the characteristics of “masked face”) and affordability. However, the performance of the existing facial expression-based PD diagnosis approaches is limited by: 1) the small-scale training data on PD patients' facial expressions, and 2) the weak prediction model. To address these two problems, we propose a new facial expression guided PD diagnosis method based on high-quality training data augmentation and deep neural network prediction. Specifically, the proposed method consists of three stages: Firstly, we synthesize virtual facial expression images with 6 basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise) based on multi-domain adversarial learning to approximate the premorbid expressions of PD patients. Secondly, we introduce three facial image quality assessment (FIQA) criteria to measure the quality of these synthesized facial expression images and design a fusion screening strategy that shortlists the high-quality ones to augment the training data. Finally, we train a deep neural network prediction model based on the original and synthesized high-quality facial expression images for PD diagnosis. To show real-world impacts and evaluate the proposed method under different facial expressions, we also create a (currently largest) multiple facial expressions-based PD face dataset in collaboration with a hospital. Extensive experiments are performed to demonstrate the effectiveness of the multi-domain adversarial learning-based facial expression synthesis and the fusion screening strategy, particularly the superior performance of the proposed method for PD diagnosis.

Facial Instance Learning for Video-based ASD Diagnosis

ASDFace: Face-based Autism Diagnosis Via Heterogeneous Domain Adaptation

ASDPred: an End-to-End Autism Screening Framework Using Few-Shot Learning

Discriminative Few Shot Learning of Facial Dynamics in Interview Videos for Autism Trait Classification

Autism Screening Using Deep Embedding Representation

Early Diagnosis of ASD Based on Facial Expression Recognition and Head Pose Estimation

Automatic Classification of ASD Children Using Appearance-Based Features from Videos

A deep learning predictive classifier for autism screening and diagnosis

An Advanced Deep Learning Framework for Video-Based Diagnosis of ASD

ASD Diagnosis Using Facial Expression Recognition and Gaze Estimation

Enhancing ASD Classification Through Hybrid Attention-Based Learning of Facial Features

Identifying Children with Autism Spectrum Disorder Via Transformer-Based Representation Learning from Dynamic Facial Cues

Facial Expression Guided Diagnosis of Parkinson's Disease Via High-Quality Data Augmentation

Identification of ASD Children Based on Video Data.

Classifying ASD Children with LSTM Based on Raw Videos

Deep Learning Approach for Screening Autism Spectrum Disorder in Children with Facial Images and Analysis of Ethnoracial Factors in Model Development and Application

Deep learning performance analysis for facial expression based autism spectrum disorder identification

TimeConvNets: A Deep Time Windowed Convolution Neural Network Design for Real-time Video Facial Expression Recognition

ASD-GResTM: Deep Learning Framework for ASD classification using Gramian Angular Field

Developing a New Autism Diagnosis Process Based on a Hybrid Deep Learning Architecture Through Analyzing Home Videos

Video-Based Autism Detection with Deep Learning