Effect of vascular endothelial growth factor on functional recovery after hepatectomy in lean and obese mice.

C. Redaelli,D. Semela,F. Carrick,M. Ledermann,D. Candinas,B. Sauter,J. Dufour

DOI: https://doi.org/10.1016/J.JHEP.2003.10.027

IF: 25.7

2004-02-01

Journal of Hepatology

Abstract:

What problem does this paper attempt to address?

3D Audio Rendering in Distributed Virtual Environment

张琼,石教英

DOI: https://doi.org/10.3321/j.issn:1003-9775.2002.12.011

2002-01-01

Abstract:Sinusoidal transform is separated into audio analysis and synthesis phases. Referring to the ideas of progressive refinement of geometry/image and scalable video, head-related transfer function (HRTF) filtering is naturally integrated into a progressive resynthesis process and MPEG psychoacoustic model 1 is used to guide the selection of matching pairs before transmission/synthesis. The implementation of this scheme in a distributed virtual environment has quite a few advantages, including scalability, direction flexibility and user-adapted HRTF etc.
WAVE: Interactive Wave-based Sound Propagation for Virtual Environments

Ravish Mehra,Atul Rungta,Abhinav Golas,Ming Lin,Dinesh Manocha

DOI: https://doi.org/10.1109/tvcg.2015.2391858

IF: 5.2

2015-04-18

IEEE Transactions on Visualization and Computer Graphics

Abstract:We present an interactive wave-based sound propagation system that generates accurate, realistic sound in virtual environments for dynamic (moving) sources and listeners. We propose a novel algorithm to accurately solve the wave equation for dynamic sources and listeners using a combination of precomputation techniques and GPU-based runtime evaluation. Our system can handle large environments typically used in VR applications, compute spatial sound corresponding to listener's motion (including head tracking) and handle both omnidirectional and directional sources, all at interactive rates. As compared to prior wave-based techniques applied to large scenes with moving sources, we observe significant improvement in runtime memory. The overall sound-propagation and rendering system has been integrated with the Half-Life 2 game engine, Oculus-Rift head-mounted display, and the Xbox game controller to enable users to experience high-quality acoustic effects (e.g., amplification, diffraction low-passing, high-order scattering) and spatial audio, based on their interactions in the VR application. We provide the results of preliminary user evaluations, conducted to study the impact of wave-based acoustic effects and spatial audio on users' navigation performance in virtual environments.

computer science, software engineering
Effects of virtual acoustics on dynamic auditory distance perception

Atul Rungta,Nicholas Rewkowski,Roberta Klatzky,Ming Lin,Dinesh Manocha

DOI: https://doi.org/10.1121/1.4981234

2017-04-20

Abstract:Sound propagation encompasses various acoustic phenomena including reverberation. Current virtual acoustic methods, ranging from parametric filters to physically-accurate solvers, can simulate reverberation with varying degrees of fidelity. We investigate the effects of reverberant sounds generated using different propagation algorithms on acoustic distance perception, i.e., how faraway humans perceive a sound source. In particular, we evaluate two classes of methods for real-time sound propagation in dynamic scenes based on parametric filters and ray tracing. Our study shows that the more accurate method shows less distance compression as compared to the approximate, filter-based method. This suggests that accurate reverberation in VR results in a better reproduction of acoustic distances. We also quantify the levels of distance compression introduced by different propagation methods in a virtual environment.

Sound
Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

Jean-Marc Jot,Rémi Audfray,Mark Hertensteiner,Brian Schmidt

DOI: https://doi.org/10.48550/arXiv.2109.12471

2021-09-26

Sound

Abstract:Interactive audio spatialization technology previously developed for video game authoring and rendering has evolved into an essential component of platforms enabling shared immersive virtual experiences for future co-presence, remote collaboration and entertainment applications. New wearable virtual and augmented reality displays employ real-time binaural audio computing engines rendering multiple digital objects and supporting the free navigation of networked participants or their avatars through a juxtaposition of environments, real and virtual, often referred to as the Metaverse. These applications require a parametric audio scene programming interface to facilitate the creation and deployment of shared, dynamic and realistic virtual 3D worlds on mobile computing platforms and remote servers. We propose a practical approach for designing parametric 6-degree-of-freedom object-based interactive audio engines to deliver the perceptually relevant binaural cues necessary for audio/visual and virtual/real congruence in Metaverse experiences. We address the effects of room reverberation, acoustic reflectors, and obstacles in both the virtual and real environments, and discuss how such effects may be driven by combinations of pre-computed and real-time acoustic propagation solvers. We envision an open scene description model distilled to facilitate the development of interoperable applications distributed across multiple platforms, where each audio object represents, to the user, a natural sound source having controllable distance, size, orientation, and acoustic radiation properties.
Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

Nikolas Borrel-Jensen,Somdatta Goswami,Allan P. Engsig-Karup,George Em Karniadakis,Cheol-Ho Jeong

2024-01-13

Abstract:We address the challenge of sound propagation simulations in 3D virtual rooms with moving sources, which have applications in virtual/augmented reality, game audio, and spatial computing. Solutions to the wave equation can describe wave phenomena such as diffraction and interference. However, simulating them using conventional numerical discretization methods with hundreds of source and receiver positions is intractable, making stimulating a sound field with moving sources impractical. To overcome this limitation, we propose using deep operator networks to approximate linear wave-equation operators. This enables the rapid prediction of sound propagation in realistic 3D acoustic scenes with moving sources, achieving millisecond-scale computations. By learning a compact surrogate model, we avoid the offline calculation and storage of impulse responses for all relevant source/listener pairs. Our experiments, including various complex scene geometries, show good agreement with reference solutions, with root mean squared errors ranging from 0.02 Pa to 0.10 Pa. Notably, our method signifies a paradigm shift as no prior machine learning approach has achieved precise predictions of complete wave fields within realistic domains. We anticipate that our findings will drive further exploration of deep neural operator methods, advancing research in immersive user experiences within virtual environments.$

Sound,Machine Learning,Audio and Speech Processing
Efficient learning-based sound propagation for virtual and real-world audio processing applications

Anton Jeran Ratnarajah

2024-09-08

Abstract:Sound propagation is the process by which sound energy travels through a medium, such as air, to the surrounding environment as sound waves. The room impulse response (RIR) describes this process and is influenced by the positions of the source and listener, the room's geometry, and its materials. Physics-based acoustic simulators have been used for decades to compute accurate RIRs for specific acoustic environments. However, we have encountered limitations with existing acoustic simulators. To address these limitations, we propose three novel solutions. First, we introduce a learning-based RIR generator that is two orders of magnitude faster than an interactive ray-tracing simulator. Our approach can be trained to input both statistical and traditional parameters directly, and it can generate both monaural and binaural RIRs for both reconstructed and synthetic 3D scenes. Our generated RIRs outperform interactive ray-tracing simulators in speech-processing applications, including ASR, Speech Enhancement, and Speech Separation. Secondly, we propose estimating RIRs from reverberant speech signals and visual cues without a 3D representation of the environment. By estimating RIRs from reverberant speech, we can augment training data to match test data, improving the word error rate of the ASR system. Our estimated RIRs achieve a 6.9% improvement over previous learning-based RIR estimators in far-field ASR tasks. We demonstrate that our audio-visual RIR estimator aids tasks like visual acoustic matching, novel-view acoustic synthesis, and voice dubbing, validated through perceptual evaluation. Finally, we introduce IR-GAN to augment accurate RIRs using real RIRs. IR-GAN parametrically controls acoustic parameters learned from real RIRs to generate new RIRs that imitate different acoustic environments, outperforming Ray-tracing simulators on the far-field ASR benchmark by 8.95%.

Sound,Audio and Speech Processing
Interactive sound propagation with bidirectional path tracing

Chunxiao Cao,Zhong Ren,Carl Schissler,Dinesh Manocha,Kun Zhou

DOI: https://doi.org/10.1145/2980179.2982431

2016-01-01

Abstract:We introduce Bidirectional Sound Transport (BST), a new algorithm that simulates sound propagation by bidirectional path tracing using multiple importance sampling. Our approach can handle multiple sources in large virtual environments with complex occlusion, and can produce plausible acoustic effects at an interactive rate on a desktop PC. We introduce a new metric based on the signal-to-noise ratio (SNR) of the energy response and use this metric to evaluate the performance of ray-tracing-based acoustic simulation methods. Our formulation exploits temporal coherence in terms of using the resulting sample distribution of the previous frame to guide the sample distribution of the current one. We show that our sample redistribution algorithm converges and better balances between early and late reflections. We evaluate our approach on different benchmarks and demonstrate significant speedup over prior geometric acoustic algorithms.
Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes

Anton Ratnarajah,Dinesh Manocha

2024-02-01

Abstract:We present an end-to-end binaural audio rendering approach (Listen2Scene) for virtual reality (VR) and augmented reality (AR) applications. We propose a novel neural-network-based binaural sound propagation method to generate acoustic effects for indoor 3D models of real environments. Any clean audio or dry audio can be convolved with the generated acoustic effects to render audio corresponding to the real environment. We propose a graph neural network that uses both the material and the topology information of the 3D scenes and generates a scene latent vector. Moreover, we use a conditional generative adversarial network (CGAN) to generate acoustic effects from the scene latent vector. Our network can handle holes or other artifacts in the reconstructed 3D mesh model. We present an efficient cost function for the generator network to incorporate spatial audio effects. Given the source and the listener position, our learning-based binaural sound propagation approach can generate an acoustic effect in 0.1 milliseconds on an NVIDIA GeForce RTX 2080 Ti GPU. We have evaluated the accuracy of our approach with binaural acoustic effects generated using an interactive geometric sound propagation algorithm and captured real acoustic effects / real-world recordings. We also performed a perceptual evaluation and observed that the audio rendered by our approach is more plausible than audio rendered using prior learning-based and geometric-based sound propagation algorithms. We quantitatively evaluated the accuracy of our approach using statistical acoustic parameters, and energy decay curves. The demo videos, code and dataset are available online (<a class="link-external link-https" href="https://anton-jeran.github.io/Listen2Scene/" rel="external noopener nofollow">this https URL</a>).

Audio and Speech Processing,Computer Vision and Pattern Recognition,Machine Learning,Multimedia,Sound
A Modified Radiosity Algorithm for Integrated Visual and Auditory Rendering

JY SHI,AD ZHANG,J ENCARNACAO,M GOBEL

DOI: https://doi.org/10.1016/0097-8493(93)90112-m

IF: 1.821

1993-01-01

Computers & Graphics

Abstract:A concept on integration of 3D visual and auditory rendering is proposed in this paper. By the auditory rendering we mean the computer acoustical simulation with direct sound outputs that is based on the physical model simulation. The so-called visual rendering means the computer generation of 3D images of real world and even virtual world, but without sounds. By integration of 3D visual and auditory rendering we mean while computer generates a 3D image of physical model of real world, it generates the sound based on the physical model displayed if there is a reverberation-free sound source. Based on some kinds of similarity between the propagation nature of light and sound, a modified radiosity algorithm has been proposed for integrating implementation. The algorithm is suitable for both visual and room auditory rendering. It means for a given enclosure, once the form factors are calculated, they can be applied for calculating both the light radiosities and sound radiosities simultaneously. The features of the algorithm are indicated. The implementation techniques are given in detail. The integration of visual and auditory rendering is a big step toward real world simulation, furthermore it will extend the research direction of visualization in scientific computing (ViSC) to visualization and audiobilization in scientific computing (VAiSC). The combination of VAiSC with virtual reality technique will improve human-computer interface greatly.
Interpolating the Directional Room Impulse Response for Dynamic Spatial Audio Reproduction

Jiahong Zhao,Xiguang Zheng,Christian Ritz,Daeyoung Jang

DOI: https://doi.org/10.3390/app12042061

2022-02-16

Applied Sciences

Abstract:Virtual reality (VR) is increasingly important for exploring the real world, which has partially moved to virtual workplaces. In order to create immersive presence in a simulated scene for humans, VR needs to reproduce spatial audio that describes three-dimensional acoustic characteristics in the counterpart physical environment. When the user moves, this reproduction should be dynamically updated, which provides practical challenges because the bandwidth for continuously transmitting audio and video scene data may be limited. This paper proposes an interpolation approach for dynamic spatial audio reproduction using acoustic characteristics of direction and reverberation at limited numbers of positions, which are represented using a first order Ambisonics encoding of the room impulse response (RIR), called the directional RIR (DRIR). We decompose two known DRIRs into reflection components, before interpolating early dominant components for DRIR synthesis and utilizing DRIR recordings for accuracy evaluation. Results indicate that the most accurate interpolation is obtained by the proposed method over two comparative approaches, particularly in a simulated small room where most direction of arrival estimation errors of early components are below five degrees. These findings suggest precise interpolated DRIRs with limited data using the proposed approach, which is vital for dynamic spatial audio reproduction for VR applications.
A Method for Capturing and Reproducing Directional Reverberation in Six Degrees of Freedom

Benoit Alary,Vesa Välimäki

DOI: https://doi.org/10.48550/arXiv.2110.04082

2021-10-08

Abstract:The reproduction of acoustics is an important aspect of the preservation of cultural heritage. A common approach is to capture an impulse response in a hall and auralize it by convolving an input signal with the measured reverberant response. For immersive applications, it is typical to acquire spatial impulse responses using a spherical microphone array to capture the reverberant sound field. While this allows a listener to freely rotate their head from the captured location during reproduction, delicate considerations must be made to allow a full six degrees of freedom auralization. Furthermore, the computational cost of convolution with a high-order Ambisonics impulse response remains prohibitively expensive for current real-time applications, where most of the resources are dedicated towards rendering graphics. For this reason, simplifications are often made in the reproduction of reverberation, such as using a uniform decay around the listener. However, recent work has highlighted the importance of directional characteristics in the late reverberant sound field and more efficient reproduction methods have been developed. In this article, we propose a framework that extracts directional decay properties from a set of captured spatial impulse responses to characterize a directional feedback delay network. For this purpose, a data set was acquired in the main auditorium of the Finnish National Opera and Ballet in Helsinki from multiple source-listener positions, in order to analyze the anisotropic characteristics of this auditorium and illustrate the proposed reproduction framework.

Audio and Speech Processing,Sound,Signal Processing
An end-to-end approach for blindly rendering a virtual sound source in an audio augmented reality environment

Shivam Saini,Isaac Engel,Jürgen Peissig

DOI: https://doi.org/10.1186/s13636-024-00338-6

IF: 2.114

2024-03-28

EURASIP Journal on Audio Speech and Music Processing

Abstract:Audio augmented reality (AAR), a prominent topic in the field of audio, requires understanding the listening environment of the user for rendering an authentic virtual auditory object. Reverberation time ( ) is a predominant metric for the characterization of room acoustics and numerous approaches have been proposed to estimate it blindly from a reverberant speech signal. However, a single value may not be sufficient to correctly describe and render the acoustics of a room. This contribution presents a method for the estimation of multiple room acoustic parameters required to render close-to-accurate room acoustics in an unknown environment. It is shown how these parameters can be estimated blindly using an audio transformer that can be deployed on a mobile device. Furthermore, the paper also discusses the use of the estimated room acoustic parameters to find a similar room from a dataset of real BRIRs that can be further used for rendering the virtual audio source. Additionally, a novel binaural room impulse response (BRIR) augmentation technique to overcome the limitation of inadequate data is proposed. Finally, the proposed method is validated perceptually by means of a listening test.

engineering, electrical & electronic,acoustics
Sound Field Translation and Mixed Source Model for Virtual Applications with Perceptual Validation

Lachlan Birnie,Thushara Abhayapala,Vladimir Tourbabin,Prasanga Samarasinghe

DOI: https://doi.org/10.48550/arXiv.2007.11795

2020-07-23

Audio and Speech Processing

Abstract:Non-interactive and linear experiences like cinema film offer high quality surround sound audio to enhance immersion, however the listener's experience is usually fixed to a single acoustic perspective. With the rise of virtual reality, there is a demand for recording and recreating real-world experiences in a way that allows for the user to interact and move within the reproduction. Conventional sound field translation techniques take a recording and expand it into an equivalent environment of virtual sources. However, the finite sampling of a commercial higher order microphone produces an acoustic sweet-spot in the virtual reproduction. As a result, the technique remains to restrict the listener's navigable region. In this paper, we propose a method for listener translation in an acoustic reproduction that incorporates a mixture of near-field and far-field sources in a sparsely expanded virtual environment. We perceptually validate the method through a Multiple Stimulus with Hidden Reference and Anchor (MUSHRA) experiment. Compared to the planewave benchmark, the proposed method offers both improved source localizability and robustness to spectral distortions at translated positions. A cross-examination with numerical simulations demonstrated that the sparse expansion relaxes the inherent sweet-spot constraint, leading to the improved localizability for sparse environments. Additionally, the proposed method is seen to better reproduce the intensity and binaural room impulse response spectra of near-field environments, further supporting the strong perceptual results.
A real-time auralization framework for scientific experiments

Philipp Schaefer,Lukas Aspoeck,Pascal Palenda,Janina Fels,Michael Vorlaender

DOI: https://doi.org/10.1121/10.0023455

2023-10-01

The Journal of the Acoustical Society of America

Abstract:The software Virtual Acoustics (VA) is an open-source auralization framework developed at the Institute for Hearing Technology and Acoustics, RWTH Aachen University, Germany. Using physics-based models for source emission and sound propagation, it allows plausible rendering of virtual scenes based on purely synthetic data. Its modular design provides a variety of rendering modules using different assumptions for the sound propagation. This allows the rendering of various indoor and outdoor scenarios with adjustable degree of complexity. Based on a similarly modular concept, VA allows a flexible way of reproducing the sound via headphones or loudspeaker arrays. For this purpose, the signals can be spatialized using binaural synthesis, higher-order ambisonics or VBAP. The respective scenarios, including source and receiver movement, can be controlled using the C + +, C#, Matlab, Python programming languages. Additionally, there are interfaces for the Unreal and Unity game engines allowing the combination with sophisticated visual cues, e.g., using HMDs. The software’s flexible structure and configuration possibilities enable the controlled application in listening experiments while providing an adequate level of plausibility. This work discusses the options as well as the limitations of the software and presents application examples in scientific experiments.

acoustics,audiology & speech-language pathology
Hearing Anything Anywhere

Mason Wang,Ryosuke Sawata,Samuel Clarke,Ruohan Gao,Shangzhe Wu,Jiajun Wu

2024-06-12

Abstract:Recent years have seen immense progress in 3D computer vision and computer graphics, with emerging tools that can virtualize real-world 3D environments for numerous Mixed Reality (XR) applications. However, alongside immersive visual experiences, immersive auditory experiences are equally vital to our holistic perception of an environment. In this paper, we aim to reconstruct the spatial acoustic characteristics of an arbitrary environment given only a sparse set of (roughly 12) room impulse response (RIR) recordings and a planar reconstruction of the scene, a setup that is easily achievable by ordinary users. To this end, we introduce DiffRIR, a differentiable RIR rendering framework with interpretable parametric models of salient acoustic features of the scene, including sound source directivity and surface reflectivity. This allows us to synthesize novel auditory experiences through the space with any source audio. To evaluate our method, we collect a dataset of RIR recordings and music in four diverse, real environments. We show that our model outperforms state-ofthe-art baselines on rendering monaural and binaural RIRs and music at unseen locations, and learns physically interpretable parameters characterizing acoustic properties of the sound source and surfaces in the scene.

Sound,Computer Vision and Pattern Recognition,Machine Learning,Audio and Speech Processing
Dynamic Portal Occlusion for Precomputed Interactive Sound Propagation

Nikunj Raghuvanshi

DOI: https://doi.org/10.48550/arXiv.2107.11548

2021-07-27

Abstract:An immersive audio-visual experience in games and virtual reality requires fast calculation of diffraction-based acoustic effects. To maintain plausibility, the effects must retain spatial smoothness on source and listener motion within geometrically complex scenes. Precomputed wave-based techniques can render such results at low runtime CPU cost, but remain limited to static scenes. Modeling the occlusion effect of dynamic portals such as doors present an unresolved challenge to maintain audio-visual consistency. We present a fast solution implementable as a drop-in extension to existing precomputed systems. Key is a novel portal-search method that leverages precomputed propagation delay and direction data to find portals intervening the diffracted shortest path connecting dynamic source and listener at runtime. The method scales linearly with number of portals in worst case, far cheaper than explicit global path search that scales with scene area. We discuss culling techniques to accelerate further. The search algorithm is combined with geometric-acoustic approximations to model the additional direct and indirect energy loss from intervening portals depending on their dynamic closure state. We demonstrate plausible audio-visual animations within our system integrated with Unreal Engine 4 (TM) and AudioKinetic Wwise (TM).

Sound,Graphics,Audio and Speech Processing
Room-aware portable Auditory Augmented Reality: Real-time spatial audio generation with geometric data analysis

Rai Sato,Yuto Izumi,Sungyoung Kim

DOI: https://doi.org/10.1121/10.0023527

2023-10-01

The Journal of the Acoustical Society of America

Abstract:This study proposes an innovative and practical approach to spatial acoustic rendering for Auditory Augmented Reality (AAR) in small room usage. AAR aims to enhance user experiences by overlaying spatially appropriate sounds in the real environment, creating the illusion that virtual sounds coexist in the physical world. However, current technological constraints in hardware and AAR rendering present challenges in creating a truly immersive sensation of “being there.” To address these challenges, we present a dynamic processing framework for a typical mobile AAR setting. This framework combines a game-audio engine with 3-D visual computation both specialized for real-time processing, providing a plausible spatial impression with lightweight computation. The process involves capturing room information by the Light Detection And Ranging (LiDAR) sensor mounted on the device, followed by estimating its dominant acoustic materials. The generated data will be used to compute dynamic early reflections and late reverberation. Early reflections are calculated up to the fourth reflection using the image source method, considering the acoustic materials. Late reverberation is generated using the Feedback Delay Network (FDN), with room frequency characteristics and spatial directivity varying relative to the listener's position. All components will be represented in fifth-order Ambisonics and binauralized with head-tracking. Notably, this dynamic rendering method could be light enough to handle all processing on a single mobile device.

acoustics,audiology & speech-language pathology
Osteoarthritis in the neonate: risk factors and outcome.

G. Berberian,V. Firpo,A. Soto,Julio Lopez Mañan,C. Torroija,G. Castro,P. Polanuer,Camilo Espinola,J. L. Piñeiro,M. Rosanova

DOI: https://doi.org/10.1590/s1413-86702010000400018

Abstract:OBJECTIVES The aim of this study was to identify the clinical, radiological, and bacteriological features, risk factors, and outcome of neonates with bone and joint infections. STUDY DESIGN Observational, retrospective, and analytical study of 77 patients less than 2 months of age, admitted to a tertiary neonatal intensive care unit (NICU) with the diagnosis of bone or joint infection, based on clinical, radiological, and microbiological criteria. RESULTS Seventy-seven patients with 99 acute osteoarthritis foci in a 16 year period were included in the study. Risk factors for infection could be identified in 69% of the patients. The hip was the most frequent. Staphylococcus aureus was the main isolated microorganism. Twenty-nine infants (38%) had sequelae. Hip involvement, culture positive, and Staphylococcus aureus isolation were risk factors associated with sequelae. CONCLUSION Osteoarticular infection is unusual in the neonate; however it is associated with an elevated incidence of sequelae. This mandates for a high degree of suspicion to diagnose this potentially disabling entity.
A Simplified Model for Generating 3D Realistic Sound in the Multimedia and Virtual Reality Systems

Zhao Yu,Zhang Qiong,Xiang Hui,Shi Jiaoying,He Zhijun

DOI: https://doi.org/10.1007/bf02947213

IF: 1.871

1996-01-01

Journal of Computer Science and Technology

Abstract:It is a key feature to embed 3D realistic sound effect in the future multimedia and virtual reality systems. Recent research on acoustics and psychoacoustics reveals the important cues for sound localization and sound perception. One promising approach to generate 3D realistic sound effect uses two earphones by simulating the sound waveforms from sound source to eardrum. This paper summarizes two methods for generating 3D realistic sound and points out their inherent drawbacks. To overcome these drawbacks we propose a simplified model to generate 3D realistic sound at any positions in the horizontal plane based on the results of sound perception and localization. Experimental results show that the model is correct and efficient.
Scene-Aware Audio Rendering via Deep Acoustic Analysis

Zhenyu Tang,Nicholas J. Bryan,Dingzeyu Li,Timothy R. Langlois,Dinesh Manocha

DOI: https://doi.org/10.1109/tvcg.2020.2973058

IF: 5.2

2020-05-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models. Given the captured audio and an approximate geometric model of a real-world room, we present a novel learning-based method to estimate its acoustic material properties. Our approach is based on deep neural networks that estimate the reverberation time and equalization of the room from recorded audio. These estimates are used to compute material properties related to room reverberation using a novel material optimization objective. We use the estimated acoustic material characteristics for audio rendering using interactive geometric sound propagation and highlight the performance on many real-world scenarios. We also perform a user study to evaluate the perceptual similarity between the recorded sounds and our rendered audio.

computer science, software engineering

Effect of vascular endothelial growth factor on functional recovery after hepatectomy in lean and obese mice.

3D Audio Rendering in Distributed Virtual Environment

WAVE: Interactive Wave-based Sound Propagation for Virtual Environments

Effects of virtual acoustics on dynamic auditory distance perception

Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

Efficient learning-based sound propagation for virtual and real-world audio processing applications

Interactive sound propagation with bidirectional path tracing

Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes

A Modified Radiosity Algorithm for Integrated Visual and Auditory Rendering

Interpolating the Directional Room Impulse Response for Dynamic Spatial Audio Reproduction

A Method for Capturing and Reproducing Directional Reverberation in Six Degrees of Freedom

An end-to-end approach for blindly rendering a virtual sound source in an audio augmented reality environment

Sound Field Translation and Mixed Source Model for Virtual Applications with Perceptual Validation

A real-time auralization framework for scientific experiments

Hearing Anything Anywhere

Dynamic Portal Occlusion for Precomputed Interactive Sound Propagation

Room-aware portable Auditory Augmented Reality: Real-time spatial audio generation with geometric data analysis

Osteoarthritis in the neonate: risk factors and outcome.

A Simplified Model for Generating 3D Realistic Sound in the Multimedia and Virtual Reality Systems

Scene-Aware Audio Rendering via Deep Acoustic Analysis