Abstract:Robust hand motion tracking holds promise for improved human-machine interaction in diverse fields, including virtual reality, and automated sign language translation. However, current wearable hand motion tracking approaches are typically limited in detection performance, wearability, and durability. This article presents a hand motion tracking system using multiple soft polymer acoustic waveguides (SPAWs). The innovative use of SPAWs as strain sensors offers several advantages that address the limitations. SPAWs are easily manufactured by casting a soft polymer shaped as a soft acoustic waveguide and containing a commercially available small ceramic piezoelectric transducer. When used as strain sensors, SPAWs demonstrate high stretchability (up to 100%), high linearity (R2 > 0.996 in all quasi-static, dynamic, and durability tensile tests), negligible hysteresis (<0.7410% under strain of up to 100%), excellent repeatability, and outstanding durability (up to 100,000 cycles). SPAWs also show high accuracy for continuous finger angle estimation (average root-mean-square errors [RMSE] <2.00°) at various flexion-extension speeds. Finally, a hand-tracking system is designed based on a SPAW array. An example application is developed to demonstrate the performance of SPAWs in real-time hand motion tracking in a three-dimensional (3D) virtual environment. To our knowledge, the system detailed in this article is the first to use soft acoustic waveguides to capture human motion. This work is part of an ongoing effort to develop soft sensors using both time and frequency domains, with the goal of extracting decoupled signals from simple sensing structures. As such, it represents a novel and promising path toward soft, simple, and wearable multimodal sensors.

Wearable Haptics for Orthotropic Actuation Based on Perpendicularly Nested Auxetic SMA Knotting

Enable Intuitive and Immersive Teleoperation: Design, Modeling and Control of a Novel Wearable Exoskeleton

Hoxels: Fully 3-D Printed Soft Multi-Modal & Multi-Contact Haptic Voxel Displays for Enriched Tactile Information Transfer

Fully Addressable Textile Sensor Array for Self-Powered Haptic Interfacing

Air Permeable Vibrotactile Actuators for Wearable Wireless Haptics

Design and Evaluation of a 3-DoF Haptic Device for Directional Shear Cues on the Forearm

A Wearable Soft Haptic Communicator Based on Dielectric Elastomer Actuators.

Haptic artificial muscle skin for extended reality

Bioelastic state recovery for haptic sensory substitution

A Wearable Haptic Device for the Hand With Interchangeable End-Effectors

Wearable Mechanotransduced Tactile Sensor for Haptic Perception

Soft Wearable Skin-Stretch Device for Haptic Feedback using Twisted and Coiled Polymer Actuators.

Cutaneous Electrohydraulic (CUTE) Wearable Devices for Pleasant Broad-Bandwidth Haptic Cues

A wireless haptic interface for programmable patterns of touch across large areas of the skin

Wireless programmable patterns of electro-hydraulic haptic electronic skins able to create surface morphology

Multimode Hydraulically Amplified Electrostatic Actuators for Wearable Haptics

Skin-Integrated Haptic Interfaces Enabled by Scalable Mechanical Actuators for Virtual Reality

A Lightweight Haptic Interface for Hand-to-Object Tasks with Spatiotemporal Displays

Biosymbiotic haptic feedback - Sustained long term human machine interfaces

A wearable wrist haptic display for motion tracking and force feedback in the operational space

Design of a Wearable Real-Time Hand Motion Tracking System Using an Array of Soft Polymer Acoustic Waveguides