Abstract:Purpose The purpose of this paper is to present a novel data glove which can capture the motion of the arm and hand by inertial and magnetic sensors. The proposed data glove is used to provide the information of the gestures and teleoperate the robotic arm-hand. Design/methodology/approach The data glove comprises 18 low-cost inertial and magnetic measurement units (IMMUs) which not only make up the drawbacks of traditional data glove that only captures the incomplete gesture information but also provide a novel scheme of the robotic arm-hand teleoperation. The IMMUs are compact and small enough to wear on the upper arm, forearm, palm and fingers. The calibration method is proposed to improve the accuracy of measurements of units, and the orientations of each IMMU are estimated by a two-step optimal filter. The kinematic models of the arm, hand and fingers are integrated into the entire system to capture the motion gesture. A positon algorithm is also deduced to compute the positions of fingertips. With the proposed data glove, the robotic arm-hand can be teleoperated by the human arm, palm and fingers, thus establishing a novel robotic arm-hand teleoperation scheme. Findings Experimental results show that the proposed data glove can accurately and fully capture the fine gesture. Using the proposed data glove as the multiple input device has also proved to be a suitable teleoperating robotic arm-hand system. Originality/value Integrated with 18 low-cost and miniature IMMUs, the proposed data glove can give more information of the gesture than existing devices. Meanwhile, the proposed algorithms for motion capture determine the superior results. Furthermore, the accurately captured gestures can efficiently facilitate a novel teleoperation scheme to teleoperate the robotic arm-hand.

Hand Tracking Accuracy Enhancement by Data Fusion Using Leap Motion and Myo Armband

Novel Adaptive Sensor Fusion Methodology for Hand Pose Estimation with Multileap Motion

Adaptive sensor fusion labeling framework for hand pose recognition in robot teleoperation

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

CAPG-MYO - A Muscle-Computer Interface Supporting User-defined Gesture Recognition.

Interaction and control with the auxiliary of hand gesture

Real-Time Hand Gesture Tracking for Human–Computer Interface Based on Multi-Sensor Data Fusion

Hand Gesture Recognition Using Myo Armband

Hand Gesture Recognition with Leap Motion

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

Controlling a Robot Using Leap Motion

Hand Motion Recognition Based on a 3D Fingertip Detection Fusion Method

Natural Human–Robot Interface Using Adaptive Tracking System with the Unscented Kalman Filter

An interactive gesture control system for collaborative manipulator based on Leap Motion Controller

Interactive 3D Visualization with Dual Leap Motions

Upper Limb Motion Tracking with the Integration of IMU and Kinect

Accuracy of Video-Based Hand Tracking for People With Upper-Body Disabilities

Hand Gesture Recognition Using Leap Motion Via Deterministic Learning

Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm

A Novel Data Glove Using Inertial and Magnetic Sensors for Motion Capture and Robotic Arm-Hand Teleoperation

A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction