Abstract:After regular rehabilitation training, paralysis sequelae can be significantly reduced in patients with limb movement disorders caused by stroke. Rehabilitation assessment is the basis for the formulation of rehabilitation training programs and the objective standard for evaluating the effectiveness of training. However, the quantitative rehabilitation assessment is still in the experimental stage and has not been put into clinical practice. In this work, we propose improved spatial-temporal graph convolutional networks based on precise posture measurement for upper limb rehabilitation assessment. Two Azure Kinect are used to enlarge the angle range of the visual field. The rigid body model of the upper limb with multiple degrees of freedom is established. And the inverse kinematics is optimized based on the hybrid particle swarm optimization algorithm. The self-attention mechanism map is calculated to analyze the role of each upper limb joint in rehabilitation assessment, to improve the spatial-temporal graph convolution neural network model. Long short-term memory is built to explore the sequence dependence in spatial-temporal feature vectors. An exercise protocol for detecting the distal reachable workspace and proximal self-care ability of the upper limb is designed, and a virtual environment is built. The experimental results indicate that the proposed posture measurement method can reduce position jumps caused by occlusion, improve measurement accuracy and stability, and increase Signal Noise Ratio. By comparing with other models, our rehabilitation assessment model achieved the lowest mean absolute deviation, root mean square error, and mean absolute percentage error. The proposed method can effectively quantitatively evaluate the upper limb motor function of stroke patients.

A Graph Convolutional Siamese Network for the Assessment and Recognition of Physical Rehabilitation Exercises

An Expert-Knowledge-Based Graph Convolutional Network for Skeleton- Based Physical Rehabilitation Exercises Assessment

Action recognition in rehabilitation: combining 3D convolution and LSTM with spatiotemporal attention

Improved spatial-temporal graph convolutional networks for upper limb rehabilitation assessment based on precise posture measurement

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Spatial-Temporal Self-Attention Enhanced Graph Convolutional Networks for Fitness Yoga Action Recognition

D-STGCNT: A Dense Spatio-Temporal Graph Conv-GRU Network based on transformer for assessment of patient physical rehabilitation

Multi-Stage Attention-Enhanced Sparse Graph Convolutional Network for Skeleton-Based Action Recognition

An Attention Enhanced Spatial–Temporal Graph Convolutional LSTM Network for Action Recognition in Karate

Rehabilitation Exercise Quality Assessment through Supervised Contrastive Learning with Hard and Soft Negatives

Temporal Dynamics and Physical Priori Multimodal Network for Rehabilitation Physical Training Evaluation

Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessment

Effective skeleton topology and semantics-guided adaptive graph convolution network for action recognition

Multi-Scale Spatial Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition

Pyramidal Graph Convolutional Network for Skeleton-Based Human Action Recognition

A Deep Learning Framework for Assessing Physical Rehabilitation Exercises

Skeleton-based action recognition by part-aware graph convolutional networks

Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition

3D Pose Based Feedback for Physical Exercises

Dual-Excitation Spatial–Temporal Graph Convolution Network for Skeleton-Based Action Recognition