Abstract:Frequently in rehabilitation, visually impaired persons are passive agents of exercises with fixed environmental constraints. In fact, a printed tactile map, i.e. a particular picture with a specific spatial arrangement, can usually not be edited. Interaction with map content, instead, facilitates the learning of spatial skills because it exploits mental imagery, manipulation and strategic planning simultaneously. However, it has rarely been applied to maps, mainly because of technological limitations. This study aims to understand if visually impaired people can autonomously build objects that are completely virtual. Specifically, we investigated if a group of twelve blind persons, with a wide age range, could exploit mental imagery to interact with virtual content and actively manipulate it by means of a haptic device. The device is mouse-shaped and designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. Spatial information can be mentally constructed by integrating local tactile cues, given by the device, with global proprioceptive cues, given by hand and arm motion. The experiment consisted of a bi-manual task, in which one hand explored some basic virtual objects and the other hand acted on a keyboard to change the position of one object in real-time. The goal was to merge basic objects into more complex objects, like a puzzle. The experiment spanned different resolutions of the tactile information. We measured task accuracy, efficiency, usability and execution time. The average accuracy in solving the puzzle was 90.5%. Importantly, accuracy was linearly predicted by efficiency, measured as the number of moves needed to solve the task. Subjective parameters linked to usability and spatial resolutions did not predict accuracy; gender modulated the execution time, with men being faster than women. Overall, we show that building purely virtual tactile objects is possible in absence of vision and that the process is measurable and achievable in partial autonomy. Introducing virtual tactile graphics in rehabilitation protocols could facilitate the stimulation of mental imagery, a basic element for the ability to orient in space. The behavioural variable introduced in the current study can be calculated after each trial and therefore could be used to automatically measure and tailor protocols to specific user needs. In perspective, our experimental setup can inspire remote rehabilitation scenarios for visually impaired people.

Universal pictures: A lithophane codex helps teenagers with blindness visualize nanoscopic systems

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Multimodal Perception of Histological Images for Persons Who Are Blind or Visually Impaired

Inclusive multisensory science and immunology books for blind, low‐vision and diverse needs audiences

Bridging the Gap of Graphical Information Accessibility in Education With Multimodal Touchscreens Among Students With Blindness and Low Vision

Development of Low-Cost Tactile Neuroanatomy Learning Tools for Students With Visual-Impairment

"They Aren't Built For Me": A Replication Study of Visual Graphical Perception with Tactile Representations of Data for Visually Impaired Users

Accessible Point-and-Tap Interaction for Acquiring Detailed Information about Tactile Graphics and 3D Models

Subretinal electronic chips allow blind patients to read letters and combine them to words

Augmented Tactile Book: Design of a Multisensory Page Prototype.

3D-Printed Melatonin Tablets with Braille Motifs for the Visually Impaired

Identification of Textured Tactile Pictures in Visually Impaired and Blindfolded Sighted Children

A tactile approach to introduce the skin autoimmune disease psoriasis to the general public and the vision-impaired community

Biomechanical Considerations of Refreshable Braille and Tactile Graphics Towards Equitable Access: A Review

ASSISTIVE TECHNOLOGY FOR STUDENTS WITH VISUAL IMPAIRMENTS

Enabling Learning Experiences for Visually Impaired Children by Interaction Design

Implementation of Protocols To Enable Doctoral Training in Physical and Computational Chemistry of a Blind Graduate Student

Making science accessible for blind and low‐vision people, and those with diverse needs

Tactile Picture Book Making and Multimodal Composition: Students Design for Equity in English Language Arts

Blind people can actively manipulate virtual objects with a novel tactile device

Mathematical Content Browsing for Print-Disabled Readers Based on Virtual-World Exploration and Audio-Visual Sensory Substitution