Abstract:Sound localization is essential to perceive the surrounding world and to interact with objects. This ability can be learned across time, and multisensory and motor cues play a crucial role in the learning process. A recent study demonstrated that when training localization skills, reaching to the sound source to determine its position reduced localization errors faster and to a greater extent as compared to just naming sources' positions, despite the fact that in both tasks, participants received the same feedback about the correct position of sound sources in case of wrong response. However, it remains to establish which features have made reaching to sound more effective as compared to naming. In the present study, we introduced a further condition in which the hand is the effector providing the response, but without it reaching toward the space occupied by the target source: the pointing condition. We tested three groups of participants (naming, pointing, and reaching groups) each while performing a sound localization task in normal and altered listening situations (i.e. mild-moderate unilateral hearing loss) simulated through auditory virtual reality technology. The experiment comprised four blocks: during the first and the last block, participants were tested in normal listening condition, while during the second and the third in altered listening condition. We measured their performance, their subjective judgments (e.g. effort), and their head-related behavior (through kinematic tracking). First, people's performance decreased when exposed to asymmetrical mild-moderate hearing impairment, more specifically on the ipsilateral side and for the pointing group. Second, we documented that all groups decreased their localization errors across altered listening blocks, but the extent of this reduction was higher for reaching and pointing as compared to the naming group. Crucially, the reaching group leads to a greater error reduction for the side where the listening alteration was applied. Furthermore, we documented that, across blocks, reaching and pointing groups increased the implementation of head motor behavior during the task (i.e., they increased approaching head movements toward the space of the sound) more than naming. Third, while performance in the unaltered blocks (first and last) was comparable, only the reaching group continued to exhibit a head behavior similar to those developed during the altered blocks (second and third), corroborating the previous observed relationship between the reaching to sounds task and head movements. In conclusion, this study further demonstrated the effectiveness of reaching to sounds as compared to pointing and naming in the learning processes. This effect could be related both to the process of implementing goal-directed motor actions and to the role of reaching actions in fostering the implementation of head-related motor strategies.

Studies of multisensory integration in sound localization and updating of auditory spatial attention during head motion

The role of self-motion processing in impairments of the spatial perception of auditory scenes

Transformation of Spatiotemporal Dynamics in the Macaque Vestibular System from Otolith Afferents to Cortex

Insights into dynamic sound localisation: A direction-dependent comparison between human listeners and a Bayesian model

Contribution of self-motion perception to acoustic target localization

The effect of self-motion and room familiarity on sound source localization in virtual environments

Auditory space perception during self-motion

Localization of sound presented via a spatial audio display during visually induced vection in pitch, roll, and yaw

Head-orienting behaviors during simultaneous speech detection and localization

Head and Eye Movements Reveal Compensatory Strategies for Acute Binaural Deficits During Sound Localization

Psychophysical evidence for auditory motion parallax

Sound localization in noisy contexts: performance, metacognitive evaluations and head movements

Changes in the integration of self motion and auditory spatial cues with age, hearing impairment, and use of hearing devices

Re-weighting of Sound Localization Cues by Audiovisual Training

The addition of a spatial auditory cue improves spatial updating in a virtual reality navigation task

Multiple spatial reference frames underpin perceptual recalibration to audio-visual discrepancies

An investigation of multisensory perception of surrounding space in aided congenitally hearing impaired

Head rotations follow those of a truncated Fick gimbal during an auditory guided visual search task

Integration of auditory and visual cues in spatial navigation under normal and impaired viewing conditions

Spatial hearing training in virtual reality with simulated asymmetric hearing loss