Abstract:Background: Walking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI. Methods: Frontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut™ and calculate two-dimensional kinematic joint angles. Assessment scores from three experienced neurorehabilitation clinicians were used with these joint angles to train random forest networks with nested cross-validation to predict assessor scores for all videos. Agreement between unseen participant (i.e. test group participants that were not used to train the model) predictions and each individual assessor's scores were compared using quadratic weighted kappa. One sample t-tests (to determine over/underprediction against clinician ratings) and one-way ANOVA (to determine differences between networks) were applied to the four networks. Results: The machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen's d range = 0.156 to 0.217). Conclusions: This study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.

Informing the development of an outcome set and banks of items to measure mobility among individuals with acquired brain injury using natural language processing

Automated Coding of Under-Studied Medical Concept Domains: Linking Physical Activity Reports to the International Classification of Functioning, Disability, and Health

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring

Patient-report and caregiver-report measures of rehabilitation service use following acquired brain injury: a systematic review

A comprehensive study of mobility functioning information in clinical notes: Entity hierarchy, corpus annotation, and sequence labeling

Evaluation of Rehabilitation Outcomes in Patients with Chronic Neurological Health Conditions Using a Machine Learning Approach

Mining Clinical Notes for Physical Rehabilitation Exercise Information: Natural Language Processing Algorithm Development and Validation Study

Learning Activities of Daily Living from Unobtrusive Multimodal Wearables: Towards Monitoring Outpatient Rehabilitation

Measuring Activities of Daily Living in Stroke Patients with Motion Machine Learning Algorithms: A Pilot Study

Toward a Common Language for Measuring Patient Mobility in the Hospital: Reliability and Construct Validity of Interprofessional Mobility Measures

Performance of a NLP Tool for Text Classification from Orthopaedic Operative Reports, Using Data from the Large Network of Clinical Data Warehouses of the West of France: The HACRO-HUGORTHO Project

Using Biosensors to Detect and Map Language Areas in the Brain for Individuals with Traumatic Brain Injury

Leveraging deep active learning to identify low-resource mobility functioning information in public clinical notes

Outcome measures in implantable brain-computer interface research: a systematic review

Identification of tasks performed by stroke patients using a mobility assistive device

Classification of neurologic outcomes from medical notes using natural language processing

Editorial: Wearable Sensing of Movement Quality after Neurological Disorders

A metric for characterizing the arm nonuse workspace in poststroke individuals using a robot arm

The art of medicine: subjective measures as predictors of outcome in stroke and traumatic brain injury

Monitoring and Predicting Health Status in Neurological Patients: The ALAMEDA Data Collection Protocol

Automated Extraction of Stroke Severity From Unstructured Electronic Health Records Using Natural Language Processing