Abstract:Background: In this work, we present a novel sensory substitution system that enables to learn three dimensional digital information via touch when vision is unavailable. The system is based on a mouse-shaped device, designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. The device hosts a tactile actuator with three degrees of freedom: elevation, roll and pitch. The actuator approximates the tactile interaction with a plane tangential to the contact point between the finger and the field. Spatial information can therefore be mentally constructed by integrating local and global tactile cues: the actuator provides local cues, whereas proprioception associated with the mouse motion provides the global cues. Methods: The efficacy of the system is measured by a virtual/real object-matching task. Twenty-four gender and age-matched participants (one blind and one blindfolded sighted group) matched a tactile dictionary of virtual objects with their 3D-printed solid version. The exploration of the virtual objects happened in three conditions, i.e., with isolated or combined height and inclination cues. We investigated the performance and the mental cost of approximating virtual objects in these tactile conditions. Results: In both groups, elevation and inclination cues were sufficient to recognize the tactile dictionary, but their combination worked at best. The presence of elevation decreased a subjective estimate of mental effort. Interestingly, only visually impaired participants were aware of their performance and were able to predict it. Conclusions: The proposed technology could facilitate the learning of science, engineering and mathematics in absence of vision, being also an industrial low-cost solution to make graphical user interfaces accessible for people with vision loss.

Effect of 2D/3D Visual and Haptic Cues for Fine Operation Tasks With Varying Difficulties

Exploring the Effect of Fingertip Aero-Haptic Feedforward Cues in Directing Eyes-Free Target Acquisition in VR

Comparison of Visual and Multisensory Augmented Reality for Precise Manual Manipulation Tasks

Investigating Haptic Feedback in Vision-Deficient Millirobot Telemanipulation

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

Peripersonal Space Tele-Operation in Virtual Reality: The Role of Tactile - Force Feedback

Haptic Compass: Active Vibrotactile Feedback of Physical Object for Path Guidance

Usability of Pseudo-Haptic Feedback for Manual Precise Manipulation of Objects in Augmented Reality

Design and Evaluation of a 3-DoF Haptic Device for Directional Shear Cues on the Forearm

Haptic Feedback Helps Me? A VR-SAR Remote Collaborative System with Tangible Interaction

Visual Attention and Haptic Control: A Cross-Study.

Experiments and Assessments of a 3-DOF Haptic Device for Interactive Operation.

Enabling visually impaired people to learn three-dimensional tactile graphics with a 3DOF haptic mouse

Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality.

Concurrent Crossmodal Feedback Assists Target-searching: Displaying Distance Information Through Visual, Auditory and Haptic Modalities

A Novel Haptic Training Method Through Skill Decomposition

GuidingBand: Evaluating Speed, Precision and Accuracy of a Vibrotactile Hand Guidance System

Usability evaluation of augmented reality visualizations on an optical see-through head-mounted display for assisting machine operations

A Hand-Held Device Presenting Haptic Directional Cues for the Visually Impaired

Multimodal Interfaces for Effective Teleoperation

Holdable Haptic Device for 4-DOF Motion Guidance