Abstract:Frequently in rehabilitation, visually impaired persons are passive agents of exercises with fixed environmental constraints. In fact, a printed tactile map, i.e. a particular picture with a specific spatial arrangement, can usually not be edited. Interaction with map content, instead, facilitates the learning of spatial skills because it exploits mental imagery, manipulation and strategic planning simultaneously. However, it has rarely been applied to maps, mainly because of technological limitations. This study aims to understand if visually impaired people can autonomously build objects that are completely virtual. Specifically, we investigated if a group of twelve blind persons, with a wide age range, could exploit mental imagery to interact with virtual content and actively manipulate it by means of a haptic device. The device is mouse-shaped and designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. Spatial information can be mentally constructed by integrating local tactile cues, given by the device, with global proprioceptive cues, given by hand and arm motion. The experiment consisted of a bi-manual task, in which one hand explored some basic virtual objects and the other hand acted on a keyboard to change the position of one object in real-time. The goal was to merge basic objects into more complex objects, like a puzzle. The experiment spanned different resolutions of the tactile information. We measured task accuracy, efficiency, usability and execution time. The average accuracy in solving the puzzle was 90.5%. Importantly, accuracy was linearly predicted by efficiency, measured as the number of moves needed to solve the task. Subjective parameters linked to usability and spatial resolutions did not predict accuracy; gender modulated the execution time, with men being faster than women. Overall, we show that building purely virtual tactile objects is possible in absence of vision and that the process is measurable and achievable in partial autonomy. Introducing virtual tactile graphics in rehabilitation protocols could facilitate the stimulation of mental imagery, a basic element for the ability to orient in space. The behavioural variable introduced in the current study can be calculated after each trial and therefore could be used to automatically measure and tailor protocols to specific user needs. In perspective, our experimental setup can inspire remote rehabilitation scenarios for visually impaired people.

Rapid Development of Reaching/grasping and Intersensory Recognition in a Previously Blind Tibetan Girl

Rapid Integration of Tactile and Visual Information by a Newly Sighted Child.

First-sight recognition of touched objects shows that chicks can solve Molyneux's problem

First Congenital Prosopagnosia Case Reported in China

”I can’t name it, but I can perceive it” Conceptual and Operational Design of ”Tactile Accuracy” Assisting Tactile Image Cognition

Identification of Textured Tactile Pictures in Visually Impaired and Blindfolded Sighted Children

Impact of early visual experience on later usage of color cues

Early visual experience and the recognition of basic facial expressions: involvement of the middle temporal and inferior frontal gyri during haptic identification by the early blind

Dynamic response to initial stage blindness in visual system development.

Chinese Children with Congenital and Acquired Blindness Represent Concrete Concepts in Vertical Space through Tactile Perception

Early visual exposure primes future cross-modal specialization of the fusiform face area in tactile face processing in the blind

Functional relevance of cross-modal plasticity in blind humans

Visual and auditory object representations in ventral visual cortex after restoring sight in humans

Motion's privilege in recognizing facial expressions following treatment for blindness

Face-specific identification impairments following sight-providing treatment may be alleviated by an initial period of low visual acuity

Developmental plasticity of the structural network of the occipital cortex in congenital blindness

TacGNN:Learning Tactile-based In-hand Manipulation with a Blind Robot

Brief Postnatal Visual Deprivation Triggers Long-Lasting Interactive Structural and Functional Reorganization of the Human Cortex

Blind people can actively manipulate virtual objects with a novel tactile device

Learning to see after early and extended blindness: A scoping review

HD-tDCS to the lateral occipital complex improves haptic object recognition