Abstract:Gait disabilities are among the most frequent impairments worldwide. Their treatment increasingly relies on rehabilitation therapies, in which smart walkers are being introduced to empower the user’s recovery state and autonomy, while reducing the clinicians effort. For that, these should be able to decode human motion and needs, as early as possible. Current walkers decode motion intention using information gathered from wearable or embedded sensors, namely inertial units, force sensors, hall sensors, and lasers, whose main limitations imply an expensive solution or hinder the perception of human movement. Smart walkers commonly lack an advanced and seamless human–robot interaction, which intuitively and promptly understands human motions. A contactless approach is proposed in this work, addressing human motion decoding as an early action recognition/detection problematic, using RGB-D cameras. We studied different deep learning-based algorithms, organised in three different approaches, to process lower body RGB-D video sequences, recorded from an embedded camera of a smart walker, and classify them into 4 classes (stop, walk, turn right/left). A custom dataset involving 15 healthy participants walking with the walker device was acquired and prepared, resulting in 28800 balanced RGB-D frames, to train and evaluate the deep learning networks. The best results were attained by a convolutional neural network with a channel-wise attention mechanism, reaching accuracy values of 99.61% and above 93%, for offline early detection/recognition and trial simulations, respectively. Following the hypothesis that human lower body features encode prominent information, fostering a more robust prediction towards real-time applications, the algorithm focus was also quantitatively evaluated using Dice metric, leading to values slightly higher than 30%. Promising results were attained for early action detection as a human motion decoding strategy, with enhancements in the focus of the proposed architectures.

ISR-AIWALKER: Robotic Walker for Intuitive and Safe Mobility Assistance and Gait Analysis

A Gait Recognition System for Interaction with a Homecare Mobile Robot

Design and Control of an Omni-Directional Robotic Walker Based on Human–Machine Interaction

A Smart Robotic Walker With Intelligent Close-Proximity Interaction Capabilities for Elderly Mobility Safety

Multimodal fusion and human-robot interaction control of an intelligent robot

An Intent-Based Control Approach For An Intelligent Mobility Aid

Evaluating Gait Symmetry with a Smart Robotic Walker: A Novel Approach to Mobility Assessment

Walker Integrated with IOT Based Fall Detection, Emergency Response System with Haptic Feedback System for Muscle Relief

Socially assistive walker for daily living assistance in older adults

A Safe and Compliant Noncontact Interactive Approach for Wheeled Walking Aid Robot.

A Human-assistive Robotic Platform with Quadrupedal Locomotion

Analysis of Gait Kinematics in Smart Walker-Assisted Locomotion in Immersive Virtual Reality Scenario

Walking analysis of young and elderly people by using an intelligent walker ANG

HealthWalk: Promoting Health and Mobility through Sensor-Based Rollator Walker Assistance

Walking Assist Robot: A Novel Non-Contact Abnormal Gait Recognition Approach Based on Extended Set Membership Filter

Human–Robot Interaction Analysis for a Smart Walker for Elderly: The ACANTO Interactive Guidance System

ROS-Based Smart Walker with Fuzzy Posture Judgement and Power Assistance

A Personalizable Controller for the Walking Assistive omNi-Directional Exo-Robot (WANDER)

Deep learning-based approaches for human motion decoding in smart walkers for rehabilitation

A Novel Coordinated Motion Fusion-Based Walking-Aid Robot System

Data-Driven Gait Segmentation for Walking Assistance in a Lower-Limb Assistive Device