Abstract:After regular rehabilitation training, paralysis sequelae can be significantly reduced in patients with limb movement disorders caused by stroke. Rehabilitation assessment is the basis for the formulation of rehabilitation training programs and the objective standard for evaluating the effectiveness of training. However, the quantitative rehabilitation assessment is still in the experimental stage and has not been put into clinical practice. In this work, we propose improved spatial-temporal graph convolutional networks based on precise posture measurement for upper limb rehabilitation assessment. Two Azure Kinect are used to enlarge the angle range of the visual field. The rigid body model of the upper limb with multiple degrees of freedom is established. And the inverse kinematics is optimized based on the hybrid particle swarm optimization algorithm. The self-attention mechanism map is calculated to analyze the role of each upper limb joint in rehabilitation assessment, to improve the spatial-temporal graph convolution neural network model. Long short-term memory is built to explore the sequence dependence in spatial-temporal feature vectors. An exercise protocol for detecting the distal reachable workspace and proximal self-care ability of the upper limb is designed, and a virtual environment is built. The experimental results indicate that the proposed posture measurement method can reduce position jumps caused by occlusion, improve measurement accuracy and stability, and increase Signal Noise Ratio. By comparing with other models, our rehabilitation assessment model achieved the lowest mean absolute deviation, root mean square error, and mean absolute percentage error. The proposed method can effectively quantitatively evaluate the upper limb motor function of stroke patients.

Real-Time Stairs Geometric Parameters Estimation for Lower Limb Rehabilitation Exoskeleton

An Adaptive Stair-Ascending Gait Generation Approach Based on Depth Camera for Lower Limb Exoskeleton.

The Identification Method for the Lower Limb Posture Based on the Identification and Trace of Image

Stereo-based Terrain Parameters Estimation for Lower Limb Exoskeleton

An Onboard Framework for Staircases Modeling Based on Point Clouds

Learning and Planning of Stair Ascent for Lower-Limb Exoskeleton Systems.

Stair-ascent Strategies and Performance Evaluation for a Lower Limb Exoskeleton.

An Environment Recognition Algorithm for Staircase Climbing Robots

Adaptive Stair-Ascending and Stair-Descending Strategies for Powered Lower Limb Exoskeleton

Gait Planning with Dynamic Movement Primitives for Lower Limb Exoskeleton Walking Up Stairs

BIR-AHC: Balanced Iterative Reducing and Agglomerative Hierarchical Clustering for Stair Detection

Human Motion Capture System Based 3D Reconstruction on Rehabilitation Assistance Stability of Lower Limb Exoskeleton Robot Climbing Upstairs Posture

Convolutional neural network based ground reaction forces and center of pressure estimation during stair walking using multi-level kinematics

StairNetV3: Depth-aware Stair Modeling using Deep Learning

Enhancing Prosthetic Safety and Environmental Adaptability: A Visual-Inertial Prosthesis Motion Estimation Approach on Uneven Terrains

Real Time Gait Planning for a Mobile Medical Exoskeleton with Crutche.

Depth-aware pose estimation using deep learning for exoskeleton gait analysis

The Visual Footsteps Planning System for Exoskeleton Robots under Complex Terrain

A Review of the Application of Staircase Scene Recognition System in Assisted Motion

Improved spatial-temporal graph convolutional networks for upper limb rehabilitation assessment based on precise posture measurement

Deep leaning-based ultra-fast stair detection