Abstract:Sound localization is essential to perceive the surrounding world and to interact with objects. This ability can be learned across time, and multisensory and motor cues play a crucial role in the learning process. A recent study demonstrated that when training localization skills, reaching to the sound source to determine its position reduced localization errors faster and to a greater extent as compared to just naming sources' positions, despite the fact that in both tasks, participants received the same feedback about the correct position of sound sources in case of wrong response. However, it remains to establish which features have made reaching to sound more effective as compared to naming. In the present study, we introduced a further condition in which the hand is the effector providing the response, but without it reaching toward the space occupied by the target source: the pointing condition. We tested three groups of participants (naming, pointing, and reaching groups) each while performing a sound localization task in normal and altered listening situations (i.e. mild-moderate unilateral hearing loss) simulated through auditory virtual reality technology. The experiment comprised four blocks: during the first and the last block, participants were tested in normal listening condition, while during the second and the third in altered listening condition. We measured their performance, their subjective judgments (e.g. effort), and their head-related behavior (through kinematic tracking). First, people's performance decreased when exposed to asymmetrical mild-moderate hearing impairment, more specifically on the ipsilateral side and for the pointing group. Second, we documented that all groups decreased their localization errors across altered listening blocks, but the extent of this reduction was higher for reaching and pointing as compared to the naming group. Crucially, the reaching group leads to a greater error reduction for the side where the listening alteration was applied. Furthermore, we documented that, across blocks, reaching and pointing groups increased the implementation of head motor behavior during the task (i.e., they increased approaching head movements toward the space of the sound) more than naming. Third, while performance in the unaltered blocks (first and last) was comparable, only the reaching group continued to exhibit a head behavior similar to those developed during the altered blocks (second and third), corroborating the previous observed relationship between the reaching to sounds task and head movements. In conclusion, this study further demonstrated the effectiveness of reaching to sounds as compared to pointing and naming in the learning processes. This effect could be related both to the process of implementing goal-directed motor actions and to the role of reaching actions in fostering the implementation of head-related motor strategies.

Spatial audio reproduction for studying second language speech perception in varying acoustic environments

Evaluating Spatial Hearing Using a Dual-Task Approach in a Virtual-Acoustics Environment

Evaluation of spatial audio reproduction schemes for application in hearing aid research

Spatial Analysis and Synthesis Methods: Subjective and Objective Evaluations Using Various Microphone Arrays in the Auralization of a Critical Listening Room

Replicating outdoor environments using VR and ambisonics: a methodology for accurate audio-visual recording, processing and reproduction

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Spatial aspects of reproduced sound in small rooms

SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

Interaction effect of reproducing spatialized human-induced and environmental sounds from nearby sources on the social Simon effect

Spatial resolution of late reverberation in virtual acoustic environments

Sound Field Translation and Mixed Source Model for Virtual Applications with Perceptual Validation

Can we hear physical and social space together through prosody?

Experimental Analysis of Spatial Sound for Storytelling in Virtual Reality

Room-aware portable Auditory Augmented Reality: Real-time spatial audio generation with geometric data analysis

A Compact Two-Loudspeaker Virtual Sound Reproduction System for Clinical Testing of Spatial Hearing With Hearing-Assistive Devices

Effect of acoustic scene complexity and visual scene representation on auditory perception in virtual audio-visual environments

Spatial Knowledge via Auditory Information for Blind Individuals: Spatial Cognition Studies and the Use of Audio-VR

Spatial hearing training in virtual reality with simulated asymmetric hearing loss

Investigating sound-field reproduction methods as perceived by bilateral hearing aid users and normal-hearing listeners

Evaluation of Virtual Acoustic Environments with Different Acoustic Level of Detail

Hearing Anything Anywhere