Abstract:Purpose The purpose of this paper is to present a novel data glove which can capture the motion of the arm and hand by inertial and magnetic sensors. The proposed data glove is used to provide the information of the gestures and teleoperate the robotic arm-hand. Design/methodology/approach The data glove comprises 18 low-cost inertial and magnetic measurement units (IMMUs) which not only make up the drawbacks of traditional data glove that only captures the incomplete gesture information but also provide a novel scheme of the robotic arm-hand teleoperation. The IMMUs are compact and small enough to wear on the upper arm, forearm, palm and fingers. The calibration method is proposed to improve the accuracy of measurements of units, and the orientations of each IMMU are estimated by a two-step optimal filter. The kinematic models of the arm, hand and fingers are integrated into the entire system to capture the motion gesture. A positon algorithm is also deduced to compute the positions of fingertips. With the proposed data glove, the robotic arm-hand can be teleoperated by the human arm, palm and fingers, thus establishing a novel robotic arm-hand teleoperation scheme. Findings Experimental results show that the proposed data glove can accurately and fully capture the fine gesture. Using the proposed data glove as the multiple input device has also proved to be a suitable teleoperating robotic arm-hand system. Originality/value Integrated with 18 low-cost and miniature IMMUs, the proposed data glove can give more information of the gesture than existing devices. Meanwhile, the proposed algorithms for motion capture determine the superior results. Furthermore, the accurately captured gestures can efficiently facilitate a novel teleoperation scheme to teleoperate the robotic arm-hand.

A Robotic Hand-Arm Teleoperation System Using Human Arm/Hand with A Novel Data Glove

A Sensor Glove Based on Inertial Measurement Unit for Robot Teleoperetion.

A Novel Data Glove Using Inertial and Magnetic Sensors for Motion Capture and Robotic Arm-Hand Teleoperation

Data Glove Control of Robot Hand with Force Telepresence

Robotic Teleoperation Systems Using a Wearable Multimodal Fusion Device

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

TeleFMG: A Wearable Force-Myography Device for Natural Teleoperation of Multi-finger Robotic Hands

Teleoperation of an Anthropomorphic Robot Hand with a Metamorphic Palm and Tunable-Stiffness Soft Fingers.

A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU

Interaction and control with the auxiliary of hand gesture

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Survey on Mapping Human Hand Motion to Robotic Hands for Teleoperation

A Dexterous Hand-Arm Teleoperation System Based on Hand Pose Estimation and Active Vision

A Glove-Based System For Studying Hand-Object Manipulation Via Joint Pose And Force Sensing

Teleoperation Control of an Underactuated Bionic Hand: Comparison between Wearable and Vision-Tracking-Based Methods

A Robust Data-Driven Soft Sensory Glove for Human Hand Motions Identification and Replication

Gesture-Controlled Robotic Arm for Agricultural Harvesting Using a Data Glove with Bending Sensor and OptiTrack Systems

Myoelectric teleoperation of a complex robotic hand

A Novel Data Glove for Fingers Motion Capture Using Inertial and Magnetic Measurement Units

Human–Robot Interaction Using Learning from Demonstrations and a Wearable Glove with Multiple Sensors