ReaWristic: Remote Touch Sensation to Fingers from a Wristband via Visually Augmented Electro-Tactile Feedback

Yudai Tanaka,Neil Weiss,Robert Cole Bolger-Cruz,Jess Hartcher-O'Brien,Brendan Flynn,Roger Boldu,Nicholas Colonnese
DOI: https://doi.org/10.1109/ISMAR62088.2024.00111
2024-10-31
Abstract:We present a technique for providing remote tactile feedback to the thumb and index finger via a wristband device. This enables haptics for touch and pinch interactions in mixed reality (MR) while keeping the hand entirely free. We achieve this through a novel cross-modal stimulation, which we term visually augmented electro-tactile feedback. This consists of (1) electrically stimulating the nerves that innervate the targeted fingers using our wristband device and (2) concurrently, visually augmenting the targeted finger in MR to steer the perceived sensation to the desired location. In our psychophysics study, we found that our approach provides tactile perception akin to tapping and, even from the wrist, it is capable of delivering the sensation to the targeted fingers with about 50% of sensation occurring in the thumb and about 40% of sensation occurring in the index finger. These results on localizability are unprecedented compared to electro-tactile feedback alone or any prior work for creating sensations in the hand with devices worn on the wrist/arm. Moreover, unlike conventional electro-tactile techniques, our wristband dispenses with gel electrodes. Instead, it incorporates custom-made elastomer-based dry electrodes and a stimulation waveform designed for the electrodes, ensuring the practicality of the device beyond laboratory settings. Lastly, we evaluated the haptic realism of our approach in mixed reality and elicited qualitative feedback from users. Participants preferred our approach to a baseline vibrotactile wrist-worn device.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to provide users with tactile feedback of fingers through a device worn on the wrist to support touch and pinch interactions in mixed reality (MR), while keeping the user's hands completely free. Specifically, the paper proposes a technology named "Visually Augmented Electro - Tactile Feedback", aiming to overcome the limitations of existing wrist - worn tactile devices and enable users to feel more realistic tactile feedback when interacting in a virtual environment. ### Core Problems of the Paper 1. **Limitations of Existing Wrist - Worn Tactile Devices**: - Most wrist - worn tactile devices can only provide vibration or squeezing feedback at the wrist and cannot be directly transmitted to the fingers, resulting in an unintuitive user experience and a lack of realism. - Although traditional electro - tactile feedback can generate tactile sensations on the fingers, it is difficult to accurately locate specific fingers, and it uses gel electrodes, which have problems such as inconvenience in wearing and the need for frequent replacement. 2. **Requirement for Achieving Finger Tactile Feedback**: - In mixed reality, users need to interact with virtual objects, such as button - pressing, sliding and other operations, and these operations usually involve finger tactile feedback. - In order to improve the user's sense of immersion and interaction experience, a method must be found so that users can feel tactile sensations similar to those in the real world in the virtual environment. ### Solution The paper proposes a new technology - **Visually Augmented Electro - Tactile Feedback (VAET)**, which solves the above problems in the following ways: 1. **Combination of Electrical Stimulation and Visual Enhancement**: - **Electrical Stimulation**: Electrical stimulation of nerves is carried out through a device on the wrist, thereby generating tactile sensations on the fingers. - **Visual Enhancement**: Visual effects are applied in mixed reality to highlight the position of the target finger, making the perceived tactile position of the user more accurate. 2. **Innovative Electrode Design**: - Custom - made dry electrodes are used to replace traditional gel electrodes, improving the wearing comfort and durability of the device. - These electrodes are made of conductive elastomer materials, which have good biocompatibility and conductivity, ensuring the safety and reliability of long - term use. 3. **Optimized Stimulation Waveform**: - An asymmetric pulse waveform is designed, which balances the electron flow, reduces skin irritation, and minimizes tactile interference at the wrist at the same time. ### Experimental Verification The paper verifies the effectiveness of this technology through a series of experiments, including evaluations of perceptual positioning, tactile quality, etc. The results show that users can feel about 40% - 50% of the tactile feedback on the thumb and index finger, which is significantly better than the existing electro - tactile feedback technologies. ### Summary The main contribution of this paper is to propose an innovative cross - modal illusion technology. Through visually augmented electro - tactile feedback, wrist - worn devices can provide users with finger tactile feedback, thereby enhancing the interaction experience and tactile realism in mixed reality.