Abstract:Parkinson's disease (PD) is a neurodegenerative disease which is prevalent among the elder population and severely affects the life quality of patients and their families. Therefore, it is important to conduct an early diagnosis for potential patients with PD, so as to promote prompt treatment and avoid the aggravation of the disease. Recently, the in-vitro PD diagnosis based on facial expressions has received increasing attention because of its distinguishability (i.e., PD patients always possess the characteristics of “masked face”) and affordability. However, the performance of the existing facial expression-based PD diagnosis approaches is limited by: 1) the small-scale training data on PD patients' facial expressions, and 2) the weak prediction model. To address these two problems, we propose a new facial expression guided PD diagnosis method based on high-quality training data augmentation and deep neural network prediction. Specifically, the proposed method consists of three stages: Firstly, we synthesize virtual facial expression images with 6 basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise) based on multi-domain adversarial learning to approximate the premorbid expressions of PD patients. Secondly, we introduce three facial image quality assessment (FIQA) criteria to measure the quality of these synthesized facial expression images and design a fusion screening strategy that shortlists the high-quality ones to augment the training data. Finally, we train a deep neural network prediction model based on the original and synthesized high-quality facial expression images for PD diagnosis. To show real-world impacts and evaluate the proposed method under different facial expressions, we also create a (currently largest) multiple facial expressions-based PD face dataset in collaboration with a hospital. Extensive experiments are performed to demonstrate the effectiveness of the multi-domain adversarial learning-based facial expression synthesis and the fusion screening strategy, particularly the superior performance of the proposed method for PD diagnosis.

Visual Detection of Parkinson’s Disease via Facial Features Recognition

PDGes: an Interpretable Detection Model for Parkinson’s Disease Using Smartphones

Auto Diagnosis of Parkinson's Disease Via a Deep Learning Model Based on Mixed Emotional Facial Expressions

Facial Expression Guided Diagnosis of Parkinson's Disease Via High-Quality Data Augmentation

Diagnosing Parkinson Disease Through Facial Expression Recognition: Video Analysis

A Novel Face-based Approach for the Early Diagnosis of Parkinson’s Disease

A Fully Automatic Framework for Parkinson’s Disease Diagnosis by Multi-Modality Images

Global joint information extraction convolution neural network for Parkinson's disease diagnosis

Global Joint Information Extraction Convolution Neural Network for Parkinson’s Disease Diagnosis

A Simple and Effective Approach Based on a Multi-Level Feature Selection for Automated Parkinson's Disease Detection

PDDS: A Software for the Early Diagnosis of Parkinson’s Disease from MRI and DatScan Images using Detection and Segmentation Algorithms

A Markerless 2D Video, Facial Feature Recognition–Based, Artificial Intelligence Model to Assist With Screening for Parkinson Disease: Development and Usability Study

Integrated Equipment for Parkinson’s Disease Early Detection Using Graph Convolution Network

Parkinson Disease Detection Based on In-air Dynamics Feature Extraction and Selection Using Machine Learning

Parkinson’s Disease Detection Using Machine Learning Techniques

Recognizing Gait Pattern of Parkinson's Disease Patients Based on Fine-Grained Movement Function Features.

Leveraging Multimodal Deep Learning Framework and a Comprehensive Audio-Visual Dataset to Advance Parkinson’s Detection

An Integrated System for Unbiased Parkinson's Disease Detection from Handwritten Drawings

Parkinson's image detection and classification based on deep learning

An Activity Graph-Based Deep Convolutional Neural Network Framework in Symptom Severity Diagnosis Towards Parkinson's Disease Using Inertial Sensors

A deep learning approach for Parkinson’s disease diagnosis from EEG signals