Abstract:This article describes a multimodal fusion data acquisition and processing system about electromyography for dynamic movement recognition and bioelectrical impedance for key posture recognition. In addition, a new dynamic–static fusion algorithm strategy is designed. Experimental results demonstrate that proposed algorithm significantly improves the accuracy of movement recognition, and has been successfully applied to the remote control of Universal Robot. Accurate recognition of human dynamic movement is essential for seamless human–machine interaction (HMI) across various domains. However, most of the existing methods are single‐modal movement recognition, which has inherent limitations, such as limited feature representation and instability to noise, which will affect its practical performance. To address these limitations, this article proposes a novel fusion approach that can integrate two biological signals, including electromyography (EMG) and bioelectrical impedance (BI). The fusion method combines EMG for capturing dynamic movement features and BI for discerning key postures representing discrete points within dynamic movements. In this method, the identification of key postures and their temporal sequences provide a guiding framework for the selection and weighted correction of probability prediction matrices in EMG‐based dynamic recognition. To verify the effectiveness of the method, six dynamic upper limb movements and nine key postures are defined, and a Universal Robot that can follow movements is employed for experimental validation. Experimental results demonstrate that the recognition accuracy of the dynamic movement reaches 96.2%, representing an improvement of nearly 10% compared with single‐modal signal. This study illustrates the potential of multimodal fusion of EMG and BI in movement recognition, with broad prospects for application in HMI fields.

A Robust Algorithm for a System Identification Approach to Digital Human Modeling: an Application to Multi-Fingered Hand Movement

Biodynamic modeling, system identification, and variability of multi-finger movements.

PARAMETRIC IDENTIFICATION OF PARALLEL MANIPULATOR WITH REDUNDANCY DRIVEN BY PNEUMATIC MUSCLES

Development and Validation of a Biodynamic Model for Predicting Multi-Finger Movements in Cylinder-Grasping Tasks.

A novel two-stage framework for musculoskeletal dynamic modeling: an application to multifingered hand movement.

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Parameter Identification of Hydraulic Manipulators Considering Physical Feasibility and Control Stability

Non-Parametric Self-Identification and Model Predictive Control of Dexterous In-Hand Manipulation

Biomechatronic Approach to a Multi-Fingered Hand Prosthesis

Underactuated Hand Dynamic Modeling, Its Real-Time Simulation, And Control

A Human-Robot Interaction Modeling Approach for Hand Rehabilitation Exoskeleton Using Biomechanical Technique

A High‐Precision Dynamic Movement Recognition Algorithm Using Multimodal Biological Signals for Human–Machine Interaction

Dynamic Modeling and Analysis for Robotic Arm-Hand Systems

Modeling the Dynamics of Prosthetic Fingers for the Development of Predictive Control Algorithms

Curriculum-based humanoid robot identification using large-scale human motion database

Algorithm for the kinematics of dexterous manipulation

Towards Predicting Fine Finger Motions from Ultrasound Images via Kinematic Representation

Dynamic Modeling and Analysis of Underactuated Prosthetic Hand

An Anthropomorphic Motion Retargeting Method Based on an Adaptive Genetic Algorithm

Development of a feasible finite element digital human hand model