Abstract:Background: Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker. Objectives: In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise. Methods: To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch. Results: We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness. Conclusions: These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.

Touch Helps Hearing: Evidence From Continuous Audio-Tactile Stimulation

Using Auditory Noise to Enhance the Fine-Motor of Human's Hand Due to Cross-Modal Stochastic Resonance.

A multi-class tactile brain-computer interface based on stimulus-induced oscillatory dynamics.

Speech-derived haptic stimulation enhances speech recognition in a multi-talker background

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Tactile Stimulation Improves Sensorimotor Rhythm-Based BCI Performance in Stroke Patients.

Cortical Oscillatory Dynamics of Tactile Selective Sensation - for a Novel Type of Somatosensory Brain-computer Interface

Improved tactile speech perception using audio-to-tactile sensory substitution with formant frequency focusing

Effect of Vibrotactile Stimulation on Auditory Timbre Perception for Normal-Hearing Listeners and Cochlear-Implant Users

Neuronal basis of audio-tactile speech perception

Multisensory benefits for speech recognition in noisy environments

Perceived auditory dynamic range is enhanced with wrist-based tactile stimulation

Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution

Electro-Tactile Stimulation Enhances Cochlear Implant Speech Recognition in Noise

Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels

Why early tactile speech aids may have failed: no perceptual integration of tactile and auditory signals

Tactile stimulations reduce or promote the segregation of auditory streams: psychophysics and modelling

Resting-state functional connectivity changes following audio-tactile speech training

EarTouch: Facilitating Smartphone Use for Visually Impaired People in Mobile and Public Scenarios

Enhanced neural phase locking through audio-tactile stimulation

An investigation into the effectiveness of using acoustic touch to assist people who are blind