Abstract:A soft finger case with three dimensional multi‐modal sensing and feedback functions is proposed. The device is featured with multi‐dimensional tactile and thermal feedback, triboelectric nanogenerator (TENG) tactile sensing with dynamic and static responses and control of movement. The integrated TENG tactile sensing unit in the device is capable of recognizing the texture of an object's surface, providing users with a more natural and intuitive way of interacting with digital objects. With the rapid development of virtual reality (VR) technology, artificial intelligence , and the Internet of Things , a new era of immersive interaction with the digital world has emerged. In this context, a novel soft finger case with 3D multi‐modal sensing and feedback functions (3D‐SFC) is presented. The device leverages multiple material properties to create a modulated fingertip haptic feedback for the perception of orientation and force, triboelectric nanogenerator (TENG) sensing with dynamic and static responses and control of movement, and thermal feedback based on resistive heating of TENG electrodes. The integrated TENG tactile sensing unit in the device is capable of recognizing the texture of an object's surface, providing users with a more natural and intuitive way of interacting with digital objects. The spatial consistency of multi‐modal sensing and feedback enhances human‐machine interaction in various fields such as healthcare, manufacturing and assembly, and gaming, etc. The proposed device represents a new intelligent sensing solution for achieving cross‐space sensory interaction, opening up new possibilities for the future of VR and digital interaction.

Fiber-optic-based human-computer interaction device for VR systems

Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

Fiber optical multifunctional human-machine interface for motion capture, temperature, and contact force monitoring

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

Virtual-Physical Interaction System

Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality

3D Multimodal Sensing and Feedback Finger Case for Immersive Dual‐Way Interaction

Optical‐Nanofiber‐Enabled Gesture‐Recognition Wristband for Human–Machine Interaction with the Assistance of Machine Learning

Data Glove with Self-Compensation Mechanism Based on High-Sensitive Elastic Fiber-Optic Sensor

Haptic Feedback Relocation from the Fingertips to the Wrist for Two-Finger Manipulation in Virtual Reality

Principles in the management of oculomycosis. XXXI Edward Jackson memorial lecture.

Suspended Three-Dimensional Display Haptic Interaction Based on Leap Motion

A Multi-Point Cutaneous Tactile Device for Fingertip Haptics

Vision-based 3D Finger Interactions for Mixed Reality Games with Physics Simulation

Virtual reality interaction based on visual attention and kinesthetic information

Force-Aware Interface via Electromyography for Natural VR/AR Interaction

Contactless Human–computer Interaction System Based on Three-Dimensional Holographic Display and Gesture Recognition

A Wearable Haptic Device for the Hand With Interchangeable End-Effectors

Amyloid beta neurotoxicity in the cholinergic but not in the serotonergic phenotype of RN46A cells.

3DTouch: A wearable 3D input device with an optical sensor and a 9-DOF inertial measurement unit

Design and Research of Multimodal Fusion Feedback Device Based on Virtual Interactive System