Abstract:Frequently in rehabilitation, visually impaired persons are passive agents of exercises with fixed environmental constraints. In fact, a printed tactile map, i.e. a particular picture with a specific spatial arrangement, can usually not be edited. Interaction with map content, instead, facilitates the learning of spatial skills because it exploits mental imagery, manipulation and strategic planning simultaneously. However, it has rarely been applied to maps, mainly because of technological limitations. This study aims to understand if visually impaired people can autonomously build objects that are completely virtual. Specifically, we investigated if a group of twelve blind persons, with a wide age range, could exploit mental imagery to interact with virtual content and actively manipulate it by means of a haptic device. The device is mouse-shaped and designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. Spatial information can be mentally constructed by integrating local tactile cues, given by the device, with global proprioceptive cues, given by hand and arm motion. The experiment consisted of a bi-manual task, in which one hand explored some basic virtual objects and the other hand acted on a keyboard to change the position of one object in real-time. The goal was to merge basic objects into more complex objects, like a puzzle. The experiment spanned different resolutions of the tactile information. We measured task accuracy, efficiency, usability and execution time. The average accuracy in solving the puzzle was 90.5%. Importantly, accuracy was linearly predicted by efficiency, measured as the number of moves needed to solve the task. Subjective parameters linked to usability and spatial resolutions did not predict accuracy; gender modulated the execution time, with men being faster than women. Overall, we show that building purely virtual tactile objects is possible in absence of vision and that the process is measurable and achievable in partial autonomy. Introducing virtual tactile graphics in rehabilitation protocols could facilitate the stimulation of mental imagery, a basic element for the ability to orient in space. The behavioural variable introduced in the current study can be calculated after each trial and therefore could be used to automatically measure and tailor protocols to specific user needs. In perspective, our experimental setup can inspire remote rehabilitation scenarios for visually impaired people.

Real and virtual explorations of the environment and interactive tracking of movable objects for the blind on the basis of tactile-acoustical maps and 3D environment models

Outdoor Navigation Assistive System Based on Robust and Real-Time Visual-Auditory Substitution Approach

Vision-Based Mobile Indoor Assistive Navigation Aid for Blind People

Exploiting the haptic and audio channels to improve orientation and mobility apps for the visually impaired

An electronic travel aid device to help blind people playing sport

An Assistive Low-Vision Platform That Augments Spatial Cognition Through Proprioceptive Guidance: Point-to-Tell-and-Touch

EchoSee: An Assistive Mobile Application for Real-Time 3D Environment Reconstruction and Sonification Supporting Enhanced Navigation for People with Vision Impairments

Object Localization Assistive System Based on CV and Vibrotactile Encoding

When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition

Intuitive Environmental Perception Assistance for Blind Amputees Using Spatial Audio Rendering

Sensing and Navigation of Wearable Assistance Cognitive Systems for the Visually Impaired

Blind people can actively manipulate virtual objects with a novel tactile device

A Virtual Vision Navigation System for The Blind Using Wearable Touch-vision Devices

Blind Pedestrian Body-Worn Navigational Aid Based on Pedometry and Smart Intersection Connectivity

Help the Blind See: Assistance for the Visually Impaired through Augmented Acoustic Simulation

Android Assistant EyeMate for Blind and Blind Tracker

Obstacle avoidance for blind people using a 3D camera and a haptic feedback sleeve

Navigation Systems for the Blind and Visually Impaired: Past Work, Challenges, and Open Problems

The Design and Implementation of a Walking Assistant System with Vibrotactile Indication and Voice Prompt for the Visually Impaired

Teleguidance-based remote navigation assistance for visually impaired and blind people-usability and user experience

3-D Space Visualization System Using Ultrasonic Sensors as an Assistive Device for the Blind