Enhancing Prosthetic Safety and Environmental Adaptability: A Visual-Inertial Prosthesis Motion Estimation Approach on Uneven Terrains

Chuheng Chen,Xinxing Chen,Shucong Yin,Yuxuan Wang,Binxin Huang,Yuquan Leng,Chenglong Fu

2024-04-29

Abstract:Environment awareness is crucial for enhancing walking safety and stability of amputee wearing powered prosthesis when crossing uneven terrains such as stairs and obstacles. However, existing environmental perception systems for prosthesis only provide terrain types and corresponding parameters, which fails to prevent potential collisions when crossing uneven terrains and may lead to falls and other severe consequences. In this paper, a visual-inertial motion estimation approach is proposed for prosthesis to perceive its movement and the changes of spatial relationship between the prosthesis and uneven terrain when traversing them. To achieve this, we estimate the knee motion by utilizing a depth camera to perceive the environment and align feature points extracted from stairs and obstacles. Subsequently, an error-state Kalman filter is incorporated to fuse the inertial data into visual estimations to reduce the feature extraction error and obtain a more robust estimation. The motion of prosthetic joint and toe are derived using the prosthesis model parameters. Experiment conducted on our collected dataset and stair walking trials with a powered prosthesis shows that the proposed method can accurately tracking the motion of the human leg and prosthesis with an average root-mean-square error of toe trajectory less than 5 cm. The proposed method is expected to enable the environmental adaptive control for prosthesis, thereby enhancing amputee's safety and mobility in uneven terrains.

Robotics

What problem does this paper attempt to address?

This paper aims to address the safety and stability issues for amputees when walking on uneven terrains such as stairs and obstacles. Existing environmental perception systems can only provide terrain types and their parameters, but cannot prevent potential collisions, which may lead to serious consequences such as falls. Therefore, this paper proposes a visual-inertial motion estimation algorithm that enables prostheses to perceive their motion and changes in spatial relationships with the surrounding environment when traversing uneven terrains.

Specifically, this method uses a depth camera to perceive the environment and extract feature points of stairs and obstacles to estimate knee joint motion. Then, an error-state Kalman filter is integrated into the visual estimation to reduce the error in feature point extraction, obtaining more robust estimation results. The motion of the prosthetic joints and toes is derived using the prosthetic model parameters. Experimental results show that the proposed method can accurately track the motion of human legs and prostheses in various uneven terrains, with an average root mean square error of less than 5 centimeters. This method is expected to achieve environment-adaptive control, thereby improving the safety and mobility of amputees on uneven terrains.