Abstract:Remote machine systems have drawn a lot of attention owing to accelerations of virtual reality (VR), augmented reality (AR), and the fifth generation (5G) networks. Despite recent trends of developing autonomous systems, the realization of sophisticated dexterous hand that can fully replace human hands is considered to be decades away. It is also extremely difficult to reproduce the sensilla of complex human hands. On the other hand, it is known that humans can perceive haptic information from visual information even without any physical feedback as cross modal sensation between visual and haptics sensations or pseudo haptics. In this paper, we propose a visual haptic technology, where haptic information is visualized in more perceptual images overlaid at the contact points of a remote machine hand. The usability of the proposed visual haptics was evaluated by subject's brain waves aiming to find out a new approach for quantifying "sense of oneness." In our proof-of-concept experiments using VR, subjects are asked to operate a virtual arm and hand presented in the VR space, and the performance of the operation with and without visual haptics information as measured with brain wave sensing. Consequently, three results were verified. Firstly, the information flow in the brain were significantly reduced with the proposed visual haptics for the whole α, β, and θ-waves by 45% across nine subjects. This result suggests that superimposing visual effects may be able to reduce the cognitive burden on the operator during the manipulation for the remote machine system. Secondly, high correlation (Pearson correlation factor of 0.795 at a p-value of 0.011) was verified between the subjective usability points and the brainwave measurement results. Finally, the number of the task successes across sessions were improved in the presence of overlaid visual stimulus. It implies that the visual haptics image could also facilitate operators' pre-training to get skillful at manipulating the remote machine interface more quickly.

1A2-F04 Approach for Basic Property of Force Telecommunication System from Human Sensory Aspect

Virtual Hand Deformation-Based Pseudo-Haptic Feedback for Enhanced Force Perception and Task Performance in Physically Constrained Teleoperation

Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot

Force-Aware Interface via Electromyography for Natural VR/AR Interaction

Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance

Virtual Reality Based Tactile Sensing Enhancements for Bilateral Teleoperation System with In-Hand Manipulation

Air jet driven force feedback in virtual reality

Wearable teleoperation controller with 2-DoF robotic arm and haptic feedback for enhanced interaction in virtual reality

Peripersonal Space Tele-Operation in Virtual Reality: The Role of Tactile - Force Feedback

Telepresence augmentation for visual and haptic guided immersive teleoperation of industrial manipulator

Perceptual Dimensions of Physical Properties of Handheld Objects Induced by Impedance Changes

Force feedback haptic interface for bilateral teleoperation of robot manipulation

Construction of force haptic reappearance system based on Geomagic Touch haptic device

Construction of Ultrasonic Tactile Force Feedback Model in Teleoperation Robot System

Visual Tactile Sensor Based Force Estimation for Position-Force Teleoperation

Haptic interface with flexible self-sensing actuators for wireless touch communication

Design and Implementation of Force Sensation and Feedback Systems for Telepresence Robotic Arm

Haptic Sensing and Feedback Techniques toward Virtual Reality

Proposal and Evaluation of Visual Haptics for Manipulation of Remote Machine System

Multi-dimensional force sensor for haptic interaction: a review

Skin-Integrated Haptic Interfaces Enabled by Scalable Mechanical Actuators for Virtual Reality