Abstract:Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson's disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson's disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician-for example, during remote home assessments. Videos (n=729) were collected as part of routine MDS-UPDRS gait assessments of Parkinson's patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson's r=0.80, p<0.001). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians' ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman's ρ=0.52, p<0.001). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model's objective UPDRS rating estimation. The severity of gait impairment in Parkinson's disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring.

An Optimized-Skeleton-Based Parkinsonian Gait Auxiliary Diagnosis Method with Both Monitoring Indicators and Assisted Ratings.

A Wearable Multi-sensor System for Classification of Multiple System Atrophy and Parkinson's Disease

Video-Based Quantification of Gait Impairments in Parkinson's Disease Using Skeleton-Silhouette Fusion Convolution Network

A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson's Disease

Quantitative Measurement of Parkinsonian Gait from Walking in Monocular Image Sequences Using a Centroid Tracking Algorithm

Gait analysis in the early stage of Parkinson's disease with a machine learning approach

Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson's Disease Motor Severity

Detection and Assessment of Parkinson's Disease Based on Gait Analysis: A Survey

Assessing gait dysfunction severity in Parkinson's Disease using 2-Stream Spatial-Temporal Neural Network

Video Based Shuffling Step Detection for Parkinsonian Patients Using 3D Convolution.

Benchmarking Skeleton-based Motion Encoder Models for Clinical Applications: Estimating Parkinson's Disease Severity in Walking Sequences

Closed-looped sensing and stimulation system for Parkinson’s disease early diagnosis and rehabilitation

GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation

Parkinson's Disease Classification Using Gait Analysis Via Deterministic Learning

Mp-Gait: Fine-grained Parkinson's Disease Gait Impairment Assessment with Robust Feature Analysis

A Wearable Gait Analysis and Recognition Method for Parkinson's Disease Based on Error State Kalman Filter

Automatic Parkinson's Disease Diagnosis with Wearable Sensor Technology for Medical Robot

Wearable multisource quantitative gait analysis of Parkinson's diseases

Feasibility of differentiating gait in Parkinson's disease and spinocerebellar degeneration using a pose estimation algorithm in two-dimensional video

Your Turn: At Home Turning Angle Estimation for Parkinson's Disease Severity Assessment

Can Gait Features Help in Differentiating Parkinson's Disease Medication States and Severity Levels? A Machine Learning Approach