Abstract:Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson's disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson's disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician-for example, during remote home assessments. Videos (n=729) were collected as part of routine MDS-UPDRS gait assessments of Parkinson's patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson's r=0.80, p<0.001). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians' ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman's ρ=0.52, p<0.001). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model's objective UPDRS rating estimation. The severity of gait impairment in Parkinson's disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring.

AI in evaluating ambulation of stroke patients: severity classification with video and functional ambulation category scale

Automatic Assessment of Upper Extremity Function and Mobile Application for Self-Administered Stroke Rehabilitation

Effect of Upper Limb Repetitive Facilitative Exercise on Gait of Stroke Patients based on Artificial Intelligence and Computer Vision Evaluation

Comparison of biomechanical parameters in lower limb joints of stroke patients according to conventional evaluation scores during level walking

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring

Towards the Ambulatory Assessment of Movement Quality in Stroke Survivors using a Wrist-worn Inertial Sensor

A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson's Disease

Assessment Methods of Post-stroke Gait: A Scoping Review of Technology-Driven Approaches to Gait Characterization and Analysis

Systematic Review of Automatic Post-Stroke Gait Classification Systems

Abnormal Motion Capture in Acute Stroke (BIONICS): A Low-Cost Tele-Evaluation Tool for Automated Assessment of Upper Extremity Function in Stroke Patients.

Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videos

Video-Based Quantification of Gait Impairments in Parkinson's Disease Using Skeleton-Silhouette Fusion Convolution Network

A Fine-Grained Analysis of Post-Stroke Motor Function Using Wearable Motion Sensors

A vision‐based clinical analysis for classification of knee osteoarthritis, Parkinson's disease and normal gait with severity based on k‐nearest neighbour

AI-Based Automatic System for Assessing Upper-Limb Spasticity of Patients with Stroke Through Voluntary Movement

A Feasible Way to Assess the Lower Extremity Motor Function of Stroke Patients - A Preliminary Study

Dual-modality Smart Shoes for Quantitative Assessment of Hemiplegic Patients' Lower Limbs' Muscle Strength

An Algorithm for Activity Recognition and Assessment of Adults Poststroke

Detection and Classification of Stroke Gaits by Deep Neural Networks Employing Inertial Measurement Units

Artificial Intelligence for Clinical Gait Diagnostics of Knee Osteoarthritis: An Evidence - based Review and Analysis

A Review of Artificial Intelligence-Based Gait Evaluation and Rehabilitation in Parkinson's Disease