Quantitative Movement Analysis Using Scaled Information Implied in Monocular Videos

Tian-Yu Xiang,Xiao-Hu Zhou,Xiaoliang Xie,Shiqi Liu,Chen Wang,Mei-Jiang Gui,Hao Li,Z. Hou
DOI: https://doi.org/10.1109/TMRB.2023.3240285
2023-02-01
IEEE Transactions on Medical Robotics and Bionics
Abstract:Background: Quantitative movement analysis is significant in clinic decision-making for neurological diseases. However, current methods fail to be widely used due to expensive equipment and professional workers. Methods: To make movement analysis more accessible even in remote areas, this paper provides a quantitative movement analysis framework based monocular camera analyzing gait parameters automatically. A size-aligned method is formulated to recover scaled information uncertain in a single view under scaled restrictions from body size and geometric constraints among subject joints’ positions. The image key points are the subject joints’ positions in images and the scaling key points are processed by the size-aligned method. The attention mechanism fuses deep representations learned from image key points and scaling key points respectively. The fused representations are decoded to provide final analyses. Results: The suggested learning framework can analyze parameters with strong correlations to the ground truth according to experimental results on a dataset for cerebral palsy: cadence <inline-formula> <tex-math notation="LaTeX">$(r=0.81)$ </tex-math></inline-formula>, speed <inline-formula> <tex-math notation="LaTeX">$(r=0.78)$ </tex-math></inline-formula>, step length <inline-formula> <tex-math notation="LaTeX">$(r=0.78)$ </tex-math></inline-formula>, knee flexion at maximum extension <inline-formula> <tex-math notation="LaTeX">$(r=0.85)$ </tex-math></inline-formula>, gait deviation indexes <inline-formula> <tex-math notation="LaTeX">$(r=0.75)$ </tex-math></inline-formula>, and asymmetric in gait deviation indexes <inline-formula> <tex-math notation="LaTeX">$(r=0.55)$ </tex-math></inline-formula>. Conclusion: The encouraging findings show that it is feasible to quantitatively assess patients’ lower limb movement ability using a monocular camera.
What problem does this paper attempt to address?