Abstract:Non-interactive and linear experiences like cinema film offer high quality surround sound audio to enhance immersion, however the listener's experience is usually fixed to a single acoustic perspective. With the rise of virtual reality, there is a demand for recording and recreating real-world experiences in a way that allows for the user to interact and move within the reproduction. Conventional sound field translation techniques take a recording and expand it into an equivalent environment of virtual sources. However, the finite sampling of a commercial higher order microphone produces an acoustic sweet-spot in the virtual reproduction. As a result, the technique remains to restrict the listener's navigable region. In this paper, we propose a method for listener translation in an acoustic reproduction that incorporates a mixture of near-field and far-field sources in a sparsely expanded virtual environment. We perceptually validate the method through a Multiple Stimulus with Hidden Reference and Anchor (MUSHRA) experiment. Compared to the planewave benchmark, the proposed method offers both improved source localizability and robustness to spectral distortions at translated positions. A cross-examination with numerical simulations demonstrated that the sparse expansion relaxes the inherent sweet-spot constraint, leading to the improved localizability for sparse environments. Additionally, the proposed method is seen to better reproduce the intensity and binaural room impulse response spectra of near-field environments, further supporting the strong perceptual results.

A Simplified Way to Simulate 3D Virtual Sound Image

3D Audio Rendering in Distributed Virtual Environment

Simplified model for generating 3D realistic sound in the multimedia and virtual reality systems

A Simple Implementation for 3D Virtual Surround Sound Effect and Its Application in Multichannel Audio Coding

Hybrid Method of Image Source Model and Diffuse Surface Integration for the Simulation of Room Sound Field

Simulation System to Construct Virtual Acoustic Environment Based on Dynamic Mechanisms

Three-Dimensional Acoustic Simulation Based on Virtual Environments.

A refined algorithm of 3-D sound synthesis

Sound Field Translation and Mixed Source Model for Virtual Applications with Perceptual Validation

VisibleSound: Perceiving Environmental Sound with 4D Form

A Signal-Processing-Based Simulation System for High-End Stereo Headsets

Time-space analysis, synthesis, and room response modeling of virtual-reality sound fields using microphone and loudspeaker arrays

Numerical Modeling of Head-Related Transfer Functions Using the Virtual Source Representation

Comparative Study of Audio Spatializers for Dual-Loudspeaker Mobile Phones

Simulation and Realization of 3D Sound for Flight Simulator

Individualized HRTF-based Binaural Renderer for Higher-Order Ambisonics

Head-related transfer function (HRTF) synthesis based on a three-dimensional array model and singular value decomposition

Individualization Of Head-Related Transfer Function For Three-Dimensional Virtual Auditory Display: A Review

Acoustic Simulation with Dynamic Mechanisms in Virtual Reality

Implementation of Virtual Reproduction of AC-3 5.1 Channel Surround Sound Based on Subband-domain Filtering

Simulating room transfer functions between transducers mounted on audio devices using a modified image source method