Abstract:Active echolocation allows blind individuals to explore their surroundings via self-generated sounds, similarly to dolphins and other echolocating animals. Echolocators emit sounds, such as finger snaps or mouth clicks, and parse the returning echoes for information about their surroundings, including the location, size, and material composition of objects. Because a crucial function of perceiving objects is to enable effective interaction with them, it is important to understand the degree to which three-dimensional shape information extracted from object echoes is useful in the context of other modalities such as haptics or vision. Here, we investigated the resolution of crossmodal transfer of object-level information between acoustic echoes and other senses. First, in a delayed match-to-sample task, blind expert echolocators and sighted control participants inspected common (everyday) and novel target objects using echolocation, then distinguished the target object from a distractor using only haptic information. For blind participants, discrimination accuracy was overall above chance and similar for both common and novel objects, whereas as a group, sighted participants performed above chance for the common, but not novel objects, suggesting that some coarse object information (a) is available to both expert blind and novice sighted echolocators, (b) transfers from auditory to haptic modalities, and (c) may be facilitated by prior object familiarity and/or material differences, particularly for novice echolocators. Next, to estimate an equivalent resolution in visual terms, we briefly presented blurred images of the novel stimuli to sighted participants ( N = 22), who then performed the same haptic discrimination task. We found that visuo-haptic discrimination performance approximately matched echo-haptic discrimination for a Gaussian blur kernel σ of ~2.5°. In this way, by matching visual and echo-based contributions to object discrimination, we can estimate the quality of echoacoustic information that transfers to other sensory modalities, predict theoretical bounds on perception, and inform the design of assistive techniques and technology available for blind individuals.

Object recognition via echoes: quantifying the crossmodal transfer of three-dimensional shape information between echolocation, vision, and haptics

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Human Echolocation: 2D Shape Discrimination Using Features Extracted from Acoustic Echoes

Discrimination of object information by bat echolocation deciphered from acoustic simulations

Human click-based echolocation: Effects of blindness and age, and real-life implications in a 10-week training program

Echolocation as a Means for People with Visual Impairment (PVI) to Acquire Spatial Knowledge of Virtual Space

Effectiveness of time-varying echo information for target geometry identification in bat-inspired human echolocation

Effectiveness of different sounds in human echolocation in live tests

Possible limitations of dolphin echolocation: a simulation study based on a cross-modal matching experiment

Changes in primary visual and auditory cortex of blind and sighted adults following 10 weeks of click-based echolocation training

Perceiving depth beyond sight: Evaluating intrinsic and learned cues via a proof of concept sensory substitution method in the visually impaired and sighted

Mouth-clicks Used by Blind Expert Human Echolocators - Signal Description and Model Based Signal Synthesis.

Distinct but related abilities for visual and haptic object recognition

Information-seeking across auditory scenes by an echolocating dolphin

Human Echolocation in Static Situations: Auditory Models of Detection Thresholds for Distance, Pitch, Loudness and Timbre

Residual inefficiencies of recovered vision in cortically blind fields – insights from equivalent noise analysis

Highly compromised auditory spatial perception in aided congenitally hearing-impaired and rapid improvement with tactile technology

Help the Blind See: Assistance for the Visually Impaired through Augmented Acoustic Simulation

Cross-modal codification of images with auditory stimuli: a language for the visually impaired

Cross-modal Transfer in Man