Abstract:Introduction Sensory deficits are common in neurological disorders. Proprioception is an example of a sensory system that could be impaired. In clinical populations, proprioception is preferably assessed as easily as possible. Techniques based on deep learning to precisely track body landmarks in simple video recordings are promising to analyze movement in clinical settings, outside the laboratory and without the need to attach markers. This study aims to validate deep learning based motion capture (DeepLabCut) with respect to laboratory-based 3D optoelectronic motion capture (gold standard) to assess proprioception by measuring the Joint Reproduction Error (JRE) during a knee joint position sense test [1]. Research question Can deep learning based motion capture (DeepLabCut) provide valid assessment of proprioception that is comparable to the gold standard (laboratory-based 3D optoelectronic motion capture)? Methods Proprioception was assessed with the eyes closed during 45 knee position sense tests of 11 typically developing children (6 girls, 5 boys, mean age 8.9 ± 1.0 years old, mean BMI 17.0 ± 2.6kg/m^2) by determining the difference between the criterion and reproduced angle (JRE, in degrees). The joint angles were determined with 2 setups; 1) 3D optoelectronic motion capture (Vicon, 10 cameras) using the ISB lower limb marker model [2] (26 markers), and 2) 2D deep learning based motion capture (DeepLabCut [3,4]) in sagittal video files using the pre-trained human model (MPII) with 55 manually labeled frames from videos of children, which were used only for network training and were excluded from the statistical analyses. Negative knee JREs correspond to a greater reproduced angle compared to the criterion angle. Linear mixed models were used to assess differences in JREs between DeepLabCut and Vicon. In addition, the mean knee JRE was calculated per subject and compared between Vicon and DeepLabCut using a paired t-test. Results There was no significant difference in the knee JRE measured with Vicon (-4.18°) and the knee JRE measured with DeepLabCut (-4.03°) (F=0.01, p = 0.91) (Fig. 1). The mean JRE over repeated trials per subject determined by using Vicon was not significantly different from the mean JRE determined by using DeepLabCut (t(10) = -0.11, p = 0.92). Discussion Measuring the knee JRE with DeepLabCut seemed valid with respect to the gold standard in typically developing children. Further research is needed and ongoing to assess the validity of DeepLabCut to measure the JRE in other joints than the knee (such as the ankle and the hip) and assess the reliability of measuring the JRE with DeepLabCut. Furthermore, we are working on validation of DeepLabCut to assess proprioception using the joint position sense tests in children with Cerebral Palsy. Deep learning based motion capture techniques could facilitate the implementation of proprioception assessment in clinical settings as there are no markers and no laboratory setting needed.

Validity of deep learning based motion capture using DeepLabCut to assess proprioception

Using DeepLabCut for tracking body landmarks in videos of children with dyskinetic cerebral palsy: a working methodology

Multi-joint approach for assessing lower limb proprioception: reliability and precision in school-aged children

Reliability and Validity of an Inertial Measurement System to Quantify Lower Extremity Joint Angle in Functional Movements

Assessing proprioception in children with upper motor neuron lesions: feasibility, validity, and reliability of the proprioception measurement tool

Validation of OpenCap: A low-cost markerless motion capture system for lower-extremity kinematics during return-to-sport tasks

Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults

Proprioceptive assessment in clinical settings: Evaluation of joint position sense in upper limb post-stroke using a robotic manipulator

Evaluating the Accuracy of a Novel Motion Tracking Sensor Technology as part of a Full-Body Immersive VR Rehabilitation System

Validity and Reliability of OpenPose-Based Motion Analysis in Measuring Knee Valgus during Drop Vertical Jump Test

A novel dataset and deep learning-based approach for marker-less motion capture during gait

Assessing the reliability of a digital inclinometer app for measuring hip, knee, and ankle proprioception

Validation of a portable marker-based motion analysis system

The effect of the number of labelled frames on the accuracy of 2D markerless pose estimation (DeepLabCut) during treadmill walking

Knee Angle Estimation from Surface EMG during Walking Using Attention-Based Deep Recurrent Neural Networks: Feasibility and Initial Demonstration in Cerebral Palsy

A Robotic Device for Measuring Human Ankle Motion Sense

A Novel Deep Learning Method for Motion Assessment in Upper Limb Rehabilitation Grasping Test

OpenSense: An open-source toolbox for inertial-measurement-unit-based measurement of lower extremity kinematics over long durations

A Novel Video-Based Methodology for Automated Classification of Dystonia and Choreoathetosis in Dyskinetic Cerebral Palsy During a Lower Extremity Task

The accuracy of markerless motion capture combined with computer vision techniques for measuring running kinematics

Video-Based Pose Estimation for Gait Analysis in Stroke Survivors during Clinical Assessments: A Proof-of-Concept Study