Abstract:This paper proposes a pseudo-haptic feedback method conveying simulated soft surface stiffness information through a visual interface. The method exploits a combination of two feedback techniques, namely visual feedback of soft surface deformation and control of the indenter avatar speed, to convey stiffness information of a simulated surface of a soft object in virtual environments. The proposed method was effective in distinguishing different sizes of virtual hard nodules integrated into the simulated soft bodies. To further improve the interactive experience, the approach was extended creating a multi-point pseudo-haptic feedback system. A comparison with regards to (a) nodule detection sensitivity and (b) elapsed time as performance indicators in hard nodule detection experiments to a tablet computer incorporating vibration feedback was conducted. The multi-point pseudo-haptic interaction is shown to be more time-efficient than the single-point pseudo-haptic interaction. It is noted that multi-point pseudo-haptic feedback performs similarly well when compared to a vibration-based feedback method based on both performance measures elapsed time and nodule detection sensitivity. This proves that the proposed method can be used to convey detailed haptic information for virtual environmental tasks, even subtle ones, using either a computer mouse or a pressure sensitive device as an input device. This pseudo-haptic feedback method provides an opportunity for low-cost simulation of objects with soft surfaces and hard inclusions, as, for example, occurring in ever more realistic video games with increasing emphasis on interaction with the physical environment and minimally invasive surgery in the form of soft tissue organs with embedded cancer nodules. Hence, the method can be used in many low-budget applications where haptic sensation is required, such as surgeon training or video games, either using desktop computers or portable devices, showing reasonably high fidelity in conveying stiffness perception to the user.

A human-in-the-loop haptic interaction with subjective evaluation

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

Affective Haptics and Multimodal Experiments Research

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

Haptic Sensing and Feedback Techniques toward Virtual Reality

Virtual-Physical Interaction System

Evaluation Patterns of Tele-Haptics

User-Experience with Haptic Feedback Technologies and Text Input in Interactive Multimedia Devices

"Can I Touch This?": Survey of Virtual Reality Interactions via Haptic Solutions

Human-machine Interface for a Master-Slave Hydraulic Manipulator with Vision Enhancement and Auditory Feedback

Pseudo-Haptics Survey: Human-Computer Interaction in Extended Reality & Teleoperation

Proposal and Evaluation of Visual Haptics for Manipulation of Remote Machine System

Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot

Affective Haptics Research and Interaction Design.

Development and Application of Integrated Human Machine Interaction Simulation System

A Skin-Integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Haptic interface with multimodal tactile sensing and feedback for human–robot interaction

Research on the Application of Multimodal Haptic Technology in the Interaction Design of Virtual Characters

Recent Progress of Tactile and Force Sensors for Human-Machine Interaction

Evaluation of Pseudo-Haptic Interactions with Soft Objects in Virtual Environments

Multimodal Interfaces for Effective Teleoperation