Abstract:A soft finger case with three dimensional multi‐modal sensing and feedback functions is proposed. The device is featured with multi‐dimensional tactile and thermal feedback, triboelectric nanogenerator (TENG) tactile sensing with dynamic and static responses and control of movement. The integrated TENG tactile sensing unit in the device is capable of recognizing the texture of an object's surface, providing users with a more natural and intuitive way of interacting with digital objects. With the rapid development of virtual reality (VR) technology, artificial intelligence , and the Internet of Things , a new era of immersive interaction with the digital world has emerged. In this context, a novel soft finger case with 3D multi‐modal sensing and feedback functions (3D‐SFC) is presented. The device leverages multiple material properties to create a modulated fingertip haptic feedback for the perception of orientation and force, triboelectric nanogenerator (TENG) sensing with dynamic and static responses and control of movement, and thermal feedback based on resistive heating of TENG electrodes. The integrated TENG tactile sensing unit in the device is capable of recognizing the texture of an object's surface, providing users with a more natural and intuitive way of interacting with digital objects. The spatial consistency of multi‐modal sensing and feedback enhances human‐machine interaction in various fields such as healthcare, manufacturing and assembly, and gaming, etc. The proposed device represents a new intelligent sensing solution for achieving cross‐space sensory interaction, opening up new possibilities for the future of VR and digital interaction.

An Intuitive Tangible Game Controller

A wearable haptic game controller

Development of a wearable haptic game interface

HaptiVec - Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays.

Vibration Feedback Controlled by Intuitive Pressing in Virtual Reality.

Handheld Haptic Device with Coupled Bidirectional Input

Motion-Based Perceptual User Interface

Mid-Air Haptics in Aviation -- creating the sensation of touch where there is nothing but thin air

Stereo vision based 3D game interface

Bubble journey: Multimodal input tools design to augment sense experience in computer game

A self-sensing soft pneumatic actuator with closed-Loop control for haptic feedback wearable devices

A Skin-Integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Demonstration of JetController: High-speed Ungrounded Force Feedback Controllers Using Air Propulsion Jets

HapticWhirl, a Flywheel-Gimbal Handheld Haptic Controller for Exploring Multimodal Haptic Feedback

JetController: High-speed Ungrounded 3-DoF Force Feedback Controllers using Air Propulsion Jets

HaptGlove—Untethered Pneumatic Glove for Multimode Haptic Feedback in Reality–Virtuality Continuum

Depth Camera-Based 3D Hand Gesture Controls with Immersive Tactile Feedback for Natural Mid-Air Gesture Interactions

Mobile Terminals Haptic Interface: A Vibro-Tactile Finger Device for 3D Shape Rendering.

3D Multimodal Sensing and Feedback Finger Case for Immersive Dual‐Way Interaction

Visuohaptic augmented feedback for enhancing motor skills acquisition

Interface Design for Somatosensory Interaction