Abstract:Visual-to-auditory sensory substitution devices (SSDs) provide improved access to the visual environment for the visually impaired by converting images into auditory information. Research is lacking on the mechanisms involved in processing data that is perceived through one sensory modality, but directly associated with a source in a different sensory modality. This is important because SSDs that use auditory displays could involve binaural presentation requiring both ear canals, or monaural presentation requiring only one - but which ear would be ideal? SSDs may be similar to reading, as an image (printed word) is converted into sound (when read aloud). Reading, and language more generally, are typically lateralised to the left cerebral hemisphere. Yet, unlike symbolic written language, SSDs convert images to sound based on visuospatial properties, with the right cerebral hemisphere potentially having a role in processing such visuospatial data. Here we investigated whether there is a hemispheric bias in the processing of visual-to-auditory sensory substitution information and whether that varies as a function of experience and visual ability. We assessed the lateralization of auditory processing with two tests: a standard dichotic listening test and a novel dichotic listening test created using the auditory information produced by an SSD, The vOICe. Participants were tested either in the lab or online with the same stimuli. We did not find a hemispheric bias in the processing of visual-to-auditory information in visually impaired, experienced vOICe users. Further, we did not find any difference between visually impaired, experienced vOICe users and sighted novices in the hemispheric lateralization of visual-to-auditory information processing. Although standard dichotic listening is lateralised to the left hemisphere, the auditory processing of images in SSDs is bilateral, possibly due to the increased influence of right hemisphere processing. Auditory SSDs might therefore be equally effective with presentation to either ear if a monaural, rather than binaural, presentation were necessary.

Flexibility and Stability in Sensory Processing Revealed Using Visual-to-Auditory Sensory Substitution

Across-ear Stimulus-Specific Adaptation in the Auditory Cortex.

Stimulus-specific Adaptation (SSA) in the Auditory System: Functional Relevance and Underlying Mechanisms.

Integrative Stimulus-Specific Adaptation of the Natural Sounds in the Auditory Cortex of the Awake Rat

Cross-Modal Interaction and Integration Through Stimulus-Specific Adaptation in the Thalamic Reticular Nucleus of Rats.

Cortical Oscillatory Dynamics of Tactile Selective Sensation - for a Novel Type of Somatosensory Brain-computer Interface

Multisensory Conflict Impairs Cortico-Muscular Network Connectivity and Postural Stability: Insights from Partial Directed Coherence Analysis.

Visual-to-auditory sensory substitution alters language asymmetry in both sighted novices and experienced visually impaired users

Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli

Auditory Scene Analysis Principles Improve Image Reconstruction Abilities of Novice Vision-to-Audio Sensory Substitution Users

The role of conflict processing in multisensory perception: behavioural and electroencephalography evidence

Investigating the Effect of Sensory Concurrency on Learning Haptic Spatiotemporal Signals

The Development of Audio-Visual Integration for Temporal Judgements

A multimodal approach connecting cortical and behavioural responses to the visual continuity illusion

The brain can develop conflicting multisensory principles to guide behavior

Orthogonality of sensory and contextual categorical dynamics embedded in a continuum of responses from the second somatosensory cortex

Coordinated Response Modulations Enable Flexible Use of Visual Information

Stability of cross-sensory input to primary somatosensory cortex across experience

Distinct mechanisms of visual and sound adaptation in the cat visual cortex

Auditory, Visual and Audiovisual Speech Processing Streams in Superior Temporal Sulcus

Hierarchical processing underpins competition in tactile perceptual bistability