Abstract:Objective: Customized human-machine interfaces for controlling assistive devices are vital in improving the self-help ability of upper limb amputees and tetraplegic patients. Given that most of them possess residual shoulder mobility, using it to generate commands to operate assistive devices can serve as a complementary approach to brain-computer interfaces. Approach: We propose a hybrid body-machine interface prototype that integrates soft sensors and an inertial measurement unit. This study introduces both a rule-based data decoding method and a user intent inference-based decoding method to map human shoulder movements into continuous commands. Additionally, by incorporating prior knowledge of the user's operational performance into a shared autonomy framework, we implement an adaptive switching command mapping approach. This approach enables seamless transitions between the two decoding methods, enhancing their adaptability across different tasks. Main results: The proposed method has been validated on individuals with cervical spinal cord injury, bilateral arm amputation, and healthy subjects through a series of center-out target reaching tasks and a virtual powered wheelchair driving task. The experimental results show that using both the soft sensors and the gyroscope exhibits the most well-rounded performance in intent inference. Additionally, the rule-based method demonstrates better dynamic performance for wheelchair operation, while the intent inference method is more accurate but has higher latency. Adaptive switching decoding methods offer the best adaptability by seamlessly transitioning between decoding methods for different tasks. Furthermore, we discussed the differences and characteristics among the various types of participants in the experiment Significance: The proposed method has the potential to be integrated into clothing, enabling non-invasive interaction with assistive devices in daily life, and could serve as a tool for rehabilitation assessment in the future.

Biological Motion As an Intuitive and Inviting Non-Symbolic Communication to Improve Human Interaction with Autonomous Systems

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Motion Control of Bionic Robots Via Biomimetic Learning

Motion-Based Perceptual User Interface

3D Intuitive Gesture Interaction via Motion Sensing

A Motion-based User Interface for the Control of Virtual Humans Performing Sports.

Human-centric Application in Cyber-Physical System: an Inertial-based Motion Capture and Recognition System

A Multimodal Emotional Communication Based Humans-Robots Interaction System

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Development of a Synchronized Human-Robot-Virtuality Interaction System Using Cooperative Robot and Motion Capture Device

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Does spontaneous motion lead to intuitive Body-Machine Interfaces? A fitness study of different body segments for wearable telerobotics

SoftBoMI: a non-invasive wearable body-machine interface for mapping movement of shoulder to commands

A High‐Precision Dynamic Movement Recognition Algorithm Using Multimodal Biological Signals for Human–Machine Interaction

"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and Pedestrians

Communicating the intention of an automated vehicle to pedestrians: The contributions of eHMI and vehicle behavior

Evaluation of Multimodal External Human–Machine Interface for Driverless Vehicles in Virtual Reality

Hands-On Robotics: Enabling Communication Through Direct Gesture Control

Social Momentum: Design and Evaluation of a Framework for Socially Competent Robot Navigation

A Visual Human-Computer Interaction System Based on Hybrid Visual Model

Intuitive interaction flow: A Dual-Loop Human-Machine Collaboration Task Allocation Model and an experimental study