Abstract:Physical rehabilitation plays a crucial role in restoring motor function following injuries or surgeries. However, the challenge of overcrowded waiting lists often hampers doctors' ability to monitor patients' recovery progress in person. Deep Learning methods offer a solution by enabling doctors to optimize their time with each patient and distinguish between those requiring specific attention and those making positive progress. Doctors use the flexion angle of limbs as a cue to assess a patient's mobility level during rehabilitation. From a Computer Vision perspective, this task can be framed as automatically estimating the pose of the target body limbs in an image. The objectives of this study can be summarized as follows: (i) evaluating and comparing multiple pose estimation methods; (ii) analyzing how the subject's position and camera viewpoint impact the estimation; and (iii) determining whether 3D estimation methods are necessary or if 2D estimation suffices for this purpose. To conduct this technical study, and due to the limited availability of public datasets related to physical rehabilitation exercises, we introduced a new dataset featuring 27 individuals performing eight diverse physical rehabilitation exercises focusing on various limbs and body positions. Each exercise was recorded using five RGB cameras capturing different viewpoints of the person. An infrared tracking system named OptiTrack was utilized to establish the ground truth positions of the joints in the limbs under study. The results, supported by statistical tests, show that not all state-of-the-art pose estimators perform equally in the presented situations (e.g., patient lying on the stretcher vs. standing). Statistical differences exist between camera viewpoints, with the frontal view being the most convenient. Additionally, the study concludes that 2D pose estimators are adequate for estimating joint angles given the selected camera viewpoints.

FineRehab: A Multi-modality and Multi-task Dataset for Rehabilitation Analysis

Design of a cerebral palsy rehabilitation training system based on Kinect motion interactive mode

MovePort: Multimodal Dataset of EMG, IMU, MoCap, and Insole Pressure for Analyzing Abnormal Movements and Postures in Rehabilitation Training

A Medical Low-Back Pain Physical Rehabilitation Dataset for Human Body Movement Analysis

UCO Physical Rehabilitation: New Dataset and Study of Human Pose Estimation Methods on Physical Rehabilitation Exercises

Indications, complications and results with silicone stents.

A review of computational approaches for evaluation of rehabilitation exercises

A Deep Learning Framework for Assessing Physical Rehabilitation Exercises

Rehabilitation Exercise Quality Assessment through Supervised Contrastive Learning with Hard and Soft Negatives

Automatic rehabilitation exercise task assessment of stroke patients based on wearable sensors with a lightweight multichannel 1D-CNN model

Rehabilitation Exercise Repetition Segmentation and Counting using Skeletal Body Joints

Temporal Dynamics and Physical Priori Multimodal Network for Rehabilitation Physical Training Evaluation

A Portable and Cost-Effective Upper Extremity Rehabilitation System for Individuals with Upper Limb Motor Deficits

Automatic Assessment of Functional Movement Screening Exercises with Deep Learning Architectures

ReHabgame A non-immersive virtual reality rehabilitation system with applications in neuroscience

Improved spatial-temporal graph convolutional networks for upper limb rehabilitation assessment based on precise posture measurement

A Skeleton-Based Rehabilitation Exercise Assessment System with Rotation Invariance.

FineGym: A Hierarchical Video Dataset for Fine-Grained Action Understanding

Automatic Classification of Knee Rehabilitation Exercises Using a Single Inertial Sensor: a Case Study

Vogtareuth Rehab Depth Datasets: Benchmark for Marker-less Posture Estimation in Rehabilitation

Unlocking the potential of RNN and CNN models for accurate rehabilitation exercise classification on multi-datasets