Abstract:Parkinson's disease (PD) is a neurodegenerative disease which is prevalent among the elder population and severely affects the life quality of patients and their families. Therefore, it is important to conduct an early diagnosis for potential patients with PD, so as to promote prompt treatment and avoid the aggravation of the disease. Recently, the in-vitro PD diagnosis based on facial expressions has received increasing attention because of its distinguishability (i.e., PD patients always possess the characteristics of “masked face”) and affordability. However, the performance of the existing facial expression-based PD diagnosis approaches is limited by: 1) the small-scale training data on PD patients' facial expressions, and 2) the weak prediction model. To address these two problems, we propose a new facial expression guided PD diagnosis method based on high-quality training data augmentation and deep neural network prediction. Specifically, the proposed method consists of three stages: Firstly, we synthesize virtual facial expression images with 6 basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise) based on multi-domain adversarial learning to approximate the premorbid expressions of PD patients. Secondly, we introduce three facial image quality assessment (FIQA) criteria to measure the quality of these synthesized facial expression images and design a fusion screening strategy that shortlists the high-quality ones to augment the training data. Finally, we train a deep neural network prediction model based on the original and synthesized high-quality facial expression images for PD diagnosis. To show real-world impacts and evaluate the proposed method under different facial expressions, we also create a (currently largest) multiple facial expressions-based PD face dataset in collaboration with a hospital. Extensive experiments are performed to demonstrate the effectiveness of the multi-domain adversarial learning-based facial expression synthesis and the fusion screening strategy, particularly the superior performance of the proposed method for PD diagnosis.

Automatic Evaluation of Facial Paralysis with Transfer Learning and Improved ResNet34 Neural Network

Automatic Facial Paralysis Evaluation Augmented by a Cascaded Encoder Network Structure.

Evaluation of Facial Paralysis Degree Based on Regions

Automatic Evaluation of Facial Nerve Paralysis by Dual-Path LSTM with Deep Differentiated Network.

Region Based Parallel Hierarchy Convolutional Neural Network for Automatic Facial Nerve Paralysis Evaluation

Automatic Degree Evaluation of Facial Nerve Paralysis Based on Triple-stream Long Short Term Memory

Automatic Facial Paralysis Estimation with Facial Action Units

[Application of Artificial Intelligence in Recognition and Evaluation of Facial Paralysis].

Automatic Evaluation of the Degree of Facial Nerve Paralysis

Automatic Facial Paralysis Assessment via Computational Image Analysis

Approach to evaluation of degree of facial paralysis based on image processing and pattern recognition

Intelligent bell facial paralysis assessment: a facial recognition model using improved SSD network

Early Recognition of Facial Paralysis for Rehabilitation of Stroke Patients Using Visual Perception and AI-Assisted Analysis

CFCPalsy: Facial Image Synthesis with Cross-Fusion Cycle Diffusion Model for Facial Paralysis Individuals

Automatic Recognition of Facial Movement for Paralyzed Face.

Facial Nerve Paralysis Assessment based on Regularized Correntropy Criterion SSELMvc and Cascade CNN.

Facial Nerve Paralysis Assessment based on Regularized Correntropy Criterion SSELM<sup>vc</sup> and Cascade CNN

Optimization of the automated Sunnybrook Facial Grading System - Improving the reliability of a deep learning network with facial landmarks

Degree Evaluation of Facial Nerve Paralysis by Combining LBP and Gabor Features.

Quantitative Analysis of Facial Paralysis Using Local Binary Patterns in Biomedical Videos.

Facial Expression Guided Diagnosis of Parkinson's Disease Via High-Quality Data Augmentation