Abstract:Background: In this work, we present a novel sensory substitution system that enables to learn three dimensional digital information via touch when vision is unavailable. The system is based on a mouse-shaped device, designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. The device hosts a tactile actuator with three degrees of freedom: elevation, roll and pitch. The actuator approximates the tactile interaction with a plane tangential to the contact point between the finger and the field. Spatial information can therefore be mentally constructed by integrating local and global tactile cues: the actuator provides local cues, whereas proprioception associated with the mouse motion provides the global cues. Methods: The efficacy of the system is measured by a virtual/real object-matching task. Twenty-four gender and age-matched participants (one blind and one blindfolded sighted group) matched a tactile dictionary of virtual objects with their 3D-printed solid version. The exploration of the virtual objects happened in three conditions, i.e., with isolated or combined height and inclination cues. We investigated the performance and the mental cost of approximating virtual objects in these tactile conditions. Results: In both groups, elevation and inclination cues were sufficient to recognize the tactile dictionary, but their combination worked at best. The presence of elevation decreased a subjective estimate of mental effort. Interestingly, only visually impaired participants were aware of their performance and were able to predict it. Conclusions: The proposed technology could facilitate the learning of science, engineering and mathematics in absence of vision, being also an industrial low-cost solution to make graphical user interfaces accessible for people with vision loss.

Locomotion Assistance for the Blind

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Hybrid auditory feedback: a new method for mobility assistance of the visually impaired.

Real and virtual explorations of the environment and interactive tracking of movable objects for the blind on the basis of tactile-acoustical maps and 3D environment models

Helping Blind People Grasp: Evaluating a Tactile Bracelet for Remotely Guiding Grasping Movements

Teleguidance-based remote navigation assistance for visually impaired and blind people-usability and user experience

Moving Assistance for Visually Impaired People by Laser Profile and Haptic Alert

Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device

Feelit: Combining Compliant Shape Displays with Vision-Based Tactile Sensors for Real-Time Teletaction

Vibrotactile Feedback for Vertical 2D Space Exploration

Tactile Simultaneous Localization and Mapping Using Low-Cost, Wearable LiDAR

VISTATM: Visual Impairment Subtle Touch AidTM - a range detection and feedback system for sightless navigation

LIDAR Assist Spatial Sensing for the Visually Impaired and Performance Analysis

Obstacle avoidance for blind people using a 3D camera and a haptic feedback sleeve

Low-Cost Open Source Ultrasound-Sensing Based Navigational Support for the Visually Impaired

Object Localization Assistive System Based on CV and Vibrotactile Encoding

Android Assistant EyeMate for Blind and Blind Tracker

Enabling visually impaired people to learn three-dimensional tactile graphics with a 3DOF haptic mouse

An electronic travel aid device to help blind people playing sport

Accessible Point-and-Tap Interaction for Acquiring Detailed Information about Tactile Graphics and 3D Models

A wearable assistive system for the visually impaired using object detection, distance measurement and tactile presentation