Abstract:Three-dimensional sound's effectiveness in virtual reality (VR) environments has been widely studied. However, due to the big differences between VR and augmented reality (AR) systems in registration, calibration, perceptual difference of immersiveness, navigation, and localization, it is important to develop new approaches to seamlessly register virtual 3-D sound in AR environments and conduct studies on 3-D sound's effectiveness in AR context. In this paper, we design two experimental AR environments to study the effectiveness of 3-D sound both quantitatively and qualitatively. Two different tracking methods are applied to retrieve the 3-D position of virtual sound sources in each experiment. We examine the impacts of 3-D sound on improving depth perception and shortening task completion time. We also investigate its impacts on immersive and realistic perception, different spatial objects identification, and subjective feeling of "human presence and collaboration". Our studies show that applying 3-D sound is an effective way to complement visual AR environments. It helps depth perception and task performance, and facilitates collaborations between users. Moreover, it enables a more realistic environment and more immersive feeling of being inside the AR environment by both visual and auditory means. In order to make full use of the intensity cues provided by 3-D sound, a process to scale the intensity difference of 3-D sound at different depths is designed to cater small AR environments. The user study results show that the scaled 3-D sound significantly increases the accuracy of depth judgments and shortens the searching task completion time. This method provides a necessary foundation for implementing 3-D sound in small AR environments. Our user study results also show that this process does not degrade the intuitiveness and realism of an augmented audio reality environment

A refined algorithm of 3-D sound synthesis

3D Audio Rendering in Distributed Virtual Environment

Simplified model for generating 3D realistic sound in the multimedia and virtual reality systems

Head-related transfer function (HRTF) synthesis based on a three-dimensional array model and singular value decomposition

Analysis and synthesis of three-dimensional sound fields using a hybrid microphone array and a 3-layered loudspeaker array

Head-Related Transfer Function Modeling Based on Finite-Impulse Response

Individualization Of Head-Related Transfer Function For Three-Dimensional Virtual Auditory Display: A Review

FINITE ELEMENT DETERMINATION OF THE HEAD-RELATED TRANSFER FUNCTION

Three-Dimensional Acoustic Simulation Based on Virtual Environments.

A Study of Morphological Influence on Head-Related Transfer Functions

A Simple Implementation for 3D Virtual Surround Sound Effect and Its Application in Multichannel Audio Coding

Individualized HRTF-based Binaural Renderer for Higher-Order Ambisonics

Numerical Modeling of Head-Related Transfer Functions Using the Virtual Source Representation

VisibleSound: Perceiving Environmental Sound with 4D Form

HRTF Estimation in the Wild

Hearing Anything Anywhere

The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments

Modeling of Individual HRTFs Based on Spatial Principal Component Analysis.

Time-of-arrival Estimation and Phase Unwrapping of Head-related Transfer Functions With Integer Linear Programming

An Experimental Study on the Role of Software Synthesized 3D Sound in Augmented Reality Environments

A Three-Dimensional Sound Ray Tracing Method by Deploying Regular Tetrahedrons