Abstract:Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson's disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson's disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician-for example, during remote home assessments. Videos (n=729) were collected as part of routine MDS-UPDRS gait assessments of Parkinson's patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson's r=0.80, p<0.001). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians' ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman's ρ=0.52, p<0.001). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model's objective UPDRS rating estimation. The severity of gait impairment in Parkinson's disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring.

A Clinically Guided Graph Convolutional Network for Assessment of Parkinsonian Pronation-Supination Movements of Hands

A tree-structure-guided graph convolutional network with contrastive learning for the assessment of parkinsonian hand movements

A Three-Dimensional Finger-Tapping Framework for Recognition of Patients with Mild Parkinson's Disease.

Multi-Scale Sparse Graph Convolutional Network for the Assessment of Parkinsonian Gait

A Self-Supervised Metric Learning Framework for the Arising-From-Chair Assessment of Parkinsonians with Graph Convolutional Networks

Assessment of Parkinson's Motor Severity by Multi-feature and Multi-scale Motion Convolutional Neural Network with Positional Encoding

Automated assessment of Parkinsonian finger-tapping tests through a vision-based fine-grained classification model

An Activity Graph-Based Deep Convolutional Neural Network Framework in Symptom Severity Diagnosis Towards Parkinson's Disease Using Inertial Sensors

Sparse Adaptive Graph Convolutional Network for Leg Agility Assessment in Parkinson's Disease

An Automatic Evaluation Method for Parkinson's Dyskinesia Using Finger Tapping Video for Small Samples

A Contrastive Graph Convolutional Network for Toe-Tapping Assessment in Parkinson's Disease.

A Causality-Driven Graph Convolutional Network for Postural Abnormality Diagnosis in Parkinsonians.

A Computer Method for Pronation-Supination Assessment in Parkinson’s Disease Based on Latent Space Representations of Biomechanical Indicators

Vision-based estimation of MDS-UPDRS scores for quantifying Parkinson's disease tremor severity

A Graded Assessment System for Parkinson's Upper-Limb Bradykinesia Based on a Temporal Convolutional Network Model

A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson's Disease

Global joint information extraction convolution neural network for Parkinson's disease diagnosis

A Causality-Informed Graph Convolutional Network for Video Assessment of Parkinsonian Leg Agility

Deep Learning for Parkinson's Disease Diagnosis: A Graph Neural Network (GNN) Based Classification Approach with Graph Wavelet Transform (GWT) Using Protein–Peptide Datasets

A Convolutional Neural Network Based Classification Method for Mild to Moderate Parkinson’s Disease at Turns

Quantifying Parkinson’s disease motor severity under uncertainty using MDS-UPDRS videos