Abstract:Environment awareness is crucial for enhancing walking safety and stability of amputee wearing powered prosthesis when crossing uneven terrains such as stairs and obstacles. However, existing environmental perception systems for prosthesis only provide terrain types and corresponding parameters, which fails to prevent potential collisions when crossing uneven terrains and may lead to falls and other severe consequences. In this paper, a visual-inertial motion estimation approach is proposed for prosthesis to perceive its movement and the changes of spatial relationship between the prosthesis and uneven terrain when traversing them. To achieve this, we estimate the knee motion by utilizing a depth camera to perceive the environment and align feature points extracted from stairs and obstacles. Subsequently, an error-state Kalman filter is incorporated to fuse the inertial data into visual estimations to reduce the feature extraction error and obtain a more robust estimation. The motion of prosthetic joint and toe are derived using the prosthesis model parameters. Experiment conducted on our collected dataset and stair walking trials with a powered prosthesis shows that the proposed method can accurately tracking the motion of the human leg and prosthesis with an average root-mean-square error of toe trajectory less than 5 cm. The proposed method is expected to enable the environmental adaptive control for prosthesis, thereby enhancing amputee's safety and mobility in uneven terrains.

Exosense: A Vision-Based Scene Understanding System For Exoskeletons

Enable Intuitive and Immersive Teleoperation: Design, Modeling and Control of a Novel Wearable Exoskeleton

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

Design and Research on a Vision-based Lightweight Soft Ankle Exosuit

Design and Performance Evaluation of a Wearable Sensing System for Lower-Limb Exoskeleton.

Design of a Wearable Sensing System for a Lower Extremity Exoskeleton

Review of Vision-Based Environmental Perception for Lower-Limb Exoskeleton Robots

A Survey of Wearable Lower Extremity Neurorehabilitation Exoskeleton: Sensing, Gait Dynamics, and Human–Robot Collaboration

The Visual Footsteps Planning System for Exoskeleton Robots under Complex Terrain

A laser-engraved wearable gait recognition sensor system for exoskeleton robots

Perception Engine Using a Multi-Sensor Head to Enable High-level Humanoid Robot Behaviors

Vision-Assisted Autonomous Lower-Limb Exoskeleton Robot.

Wearable Gait Measurement System with an Instrumented Cane for Exoskeleton Control

SensAA—Design and Verification of a Cloud-Based Wearable Biomechanical Data Acquisition System

Sensory-Motor Neurostimulation to Enhance Exosuit Performance

Development and Validation of a Modular Sensor-Based System for Gait Analysis and Control in Lower-Limb Exoskeletons

Enhancing Prosthetic Safety and Environmental Adaptability: A Visual-Inertial Prosthesis Motion Estimation Approach on Uneven Terrains

Real-time Onboard SVM-based Human Locomotion Recognition for a Bionic Knee Exoskeleton on Different Terrains

AI-Powered Camera and Sensors for the Rehabilitation Hand Exoskeleton

Development of Smart Wearable Exoskeleton Robot

Multi-class SVM Based Real-Time Recognition of Sit-to-Stand and Stand-to-Sit Transitions for a Bionic Knee Exoskeleton in Transparent Mode.