Abstract:Introduction Sensory deficits are common in neurological disorders. Proprioception is an example of a sensory system that could be impaired. In clinical populations, proprioception is preferably assessed as easily as possible. Techniques based on deep learning to precisely track body landmarks in simple video recordings are promising to analyze movement in clinical settings, outside the laboratory and without the need to attach markers. This study aims to validate deep learning based motion capture (DeepLabCut) with respect to laboratory-based 3D optoelectronic motion capture (gold standard) to assess proprioception by measuring the Joint Reproduction Error (JRE) during a knee joint position sense test [1]. Research question Can deep learning based motion capture (DeepLabCut) provide valid assessment of proprioception that is comparable to the gold standard (laboratory-based 3D optoelectronic motion capture)? Methods Proprioception was assessed with the eyes closed during 45 knee position sense tests of 11 typically developing children (6 girls, 5 boys, mean age 8.9 ± 1.0 years old, mean BMI 17.0 ± 2.6kg/m^2) by determining the difference between the criterion and reproduced angle (JRE, in degrees). The joint angles were determined with 2 setups; 1) 3D optoelectronic motion capture (Vicon, 10 cameras) using the ISB lower limb marker model [2] (26 markers), and 2) 2D deep learning based motion capture (DeepLabCut [3,4]) in sagittal video files using the pre-trained human model (MPII) with 55 manually labeled frames from videos of children, which were used only for network training and were excluded from the statistical analyses. Negative knee JREs correspond to a greater reproduced angle compared to the criterion angle. Linear mixed models were used to assess differences in JREs between DeepLabCut and Vicon. In addition, the mean knee JRE was calculated per subject and compared between Vicon and DeepLabCut using a paired t-test. Results There was no significant difference in the knee JRE measured with Vicon (-4.18°) and the knee JRE measured with DeepLabCut (-4.03°) (F=0.01, p = 0.91) (Fig. 1). The mean JRE over repeated trials per subject determined by using Vicon was not significantly different from the mean JRE determined by using DeepLabCut (t(10) = -0.11, p = 0.92). Discussion Measuring the knee JRE with DeepLabCut seemed valid with respect to the gold standard in typically developing children. Further research is needed and ongoing to assess the validity of DeepLabCut to measure the JRE in other joints than the knee (such as the ankle and the hip) and assess the reliability of measuring the JRE with DeepLabCut. Furthermore, we are working on validation of DeepLabCut to assess proprioception using the joint position sense tests in children with Cerebral Palsy. Deep learning based motion capture techniques could facilitate the implementation of proprioception assessment in clinical settings as there are no markers and no laboratory setting needed.

Automated Romberg Test: Leveraging a CNN and Centre of Mass Analysis for Sensory Ataxia Diagnosis

Clinical Recognition of Sensory Ataxia and Cerebellar Ataxia

A Comparative Severity Assessment of Impaired Balance due to Cerebellar Ataxia using Regression Models

Validation of Non-Restrictive Inertial Gait Analysis of Individuals with Incomplete Spinal Cord Injury in Clinical Settings

Deep Learning Model to Evaluate Sensorimotor System Ability in Patients With Dizziness for Postural Control

Deep Learning for Accelerometric Data Assessment and Ataxic Gait Monitoring

Romberg's test revisited: Changes in classical and advanced sway metrics in patients with pure sensory neuropathy

Leg movement tracking in automatic video-based one-leg stance evaluation

Assessing Cerebellar Disorders With Wearable Inertial Sensor Data Using Time-Frequency and Autoregressive Hidden Markov Model Approaches

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring

Automatic Diagnosis of Cerebral Palsy Gait Using Computational Intelligence Techniques: A Low-Cost Multi-Sensor Approach

Automatic Assessment System Based on IMUs and Machine Learning for Predicting Berg Balance Scale

Whole Body Center of Mass Estimation with Portable Sensors: Using the Statically Equivalent Serial Chain and a Kinect

Real-time motion onset recognition for robot-assisted gait rehabilitation

A Novel Automated RGB-D Sensor-Based Measurement of Voluntary Items of the Fugl-Meyer Assessment for Upper Extremity: A Feasibility Study

Validity of deep learning based motion capture using DeepLabCut to assess proprioception

Using Wearable Inertial Sensors to Estimate Clinical Scores of Upper Limb Movement Quality in Stroke

Standing Balance Assessment by Measurement of Body Center of Gravity Using Smartphones

A Novel Deep Learning Method for Motion Assessment in Upper Limb Rehabilitation Grasping Test

Fall Risk Assessment in Stroke Survivors: A Machine Learning Model Using Detailed Motion Data from Common Clinical Tests and Motor-Cognitive Dual-Tasking

The Use of Wearable Sensors and Machine Learning Methods to Estimate Biomechanical Characteristics During Standing Posture or Locomotion: A Systematic Review