Abstract:Background: Walking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI. Methods: Frontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut™ and calculate two-dimensional kinematic joint angles. Assessment scores from three experienced neurorehabilitation clinicians were used with these joint angles to train random forest networks with nested cross-validation to predict assessor scores for all videos. Agreement between unseen participant (i.e. test group participants that were not used to train the model) predictions and each individual assessor's scores were compared using quadratic weighted kappa. One sample t-tests (to determine over/underprediction against clinician ratings) and one-way ANOVA (to determine differences between networks) were applied to the four networks. Results: The machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen's d range = 0.156 to 0.217). Conclusions: This study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.

A Novel Video-Based Methodology for Automated Classification of Dystonia and Choreoathetosis in Dyskinetic Cerebral Palsy During a Lower Extremity Task

Home-Based Measurements of Dystonia in Cerebral Palsy Using Smartphone-Coupled Inertial Sensor Technology and Machine Learning: A Proof-of-Concept Study

Automated Leg Dystonia Diagnosis in Children with Cerebral Palsy Using Machine Learning

Deep Learning-Based Classification of Hyperkinetic Movement Disorders in Children

The relationship between manual ability, dystonia and choreoathetosis severity and upper limb movement patterns during reaching and grasping in children and young adults with dyskinetic cerebral palsy

Head movement dynamics in dystonia: a multi-centre retrospective study using visual perceptive deep learning

Video-based diagnosis support system for pianists with Musician's dystonia

Using DeepLabCut for tracking body landmarks in videos of children with dyskinetic cerebral palsy: a working methodology

2D Gait Skeleton Data Normalization for Quantitative Assessment of Movement Disorders from Freehand Single Camera Video Recordings

What the Trained Eye Cannot See: Quantitative Kinematics and Machine Learning Detect Movement Deficits in Early-Stage Parkinson's Disease from Videos

Automatic two-dimensional & three-dimensional video analysis with deep learning for movement disorders: A systematic review

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring

Validation of computer vision technology for analyzing bradykinesia in outpatient clinic videos of people with Parkinson's disease

Motor assessment of X-linked dystonia parkinsonism via machine-learning-based analysis of wearable sensor data

Markerless motion analysis to assess reaching-sideways in individuals with dyskinetic cerebral palsy: A validity study

Assessing infant risk of cerebral palsy with video-based motion tracking

Objective and automatic assessment of bradykinesia in Parkinson's patients using new repetitive pointing task with machine learning approach

A new methodological approach to characterize selective motor control in children with cerebral palsy

Clinical validation of automated depth camera-based measurement of the Fugl-Meyer assessment for upper extremity

Feasibility of differentiating gait in Parkinson's disease and spinocerebellar degeneration using a pose estimation algorithm in two-dimensional video

A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos