Abstract:Recent years have seen the increasing need of location awareness by mobile applications. This paper presents a room-level indoor localization approach based on the measured room's echos in response to a two-millisecond single-tone inaudible chirp emitted by a smartphone's loudspeaker. Different from other acoustics-based room recognition systems that record full-spectrum audio for up to ten seconds, our approach records audio in a narrow inaudible band for 0.1 seconds only to preserve the user's privacy. However, the short-time and narrowband audio signal carries limited information about the room's characteristics, presenting challenges to accurate room recognition. This paper applies deep learning to effectively capture the subtle fingerprints in the rooms' acoustic responses. Our extensive experiments show that a two-layer convolutional neural network fed with the spectrogram of the inaudible echos achieve the best performance, compared with alternative designs using other raw data formats and deep models. Based on this result, we design a RoomRecognize cloud service and its mobile client library that enable the mobile application developers to readily implement the room recognition functionality without resorting to any existing infrastructures and add-on hardware. Extensive evaluation shows that RoomRecognize achieves 99.7%, 97.7%, 99%, and 89% accuracy in differentiating 22 and 50 residential/office rooms, 19 spots in a quiet museum, and 15 spots in a crowded museum, respectively. Compared with the state-of-the-art approaches based on support vector machine, RoomRecognize significantly improves the Pareto frontier of recognition accuracy versus robustness against interfering sounds (e.g., ambient music).

Dimensionality Reduction of Room Acoustic Impulse Responses and Applications to System Identification.

Proceedings of Meetings on Acoustics

SoundCam: A Dataset for Finding Humans Using Room Acoustics

Joint Blind Room Acoustic Characterization From Speech And Music Signals Using Convolutional Recurrent Neural Networks

Online adaptive identification of multichannel systems for audio applications

State-Space Estimation of Spatially Dynamic Room Impulse Responses using a Room Acoustic Model-based Prior

Room dimensions and absorption inference from room transfer function via machine learning

Blind Acoustic Room Parameter Estimation Using Phase Features

Neural Acoustic Context Field: Rendering Realistic Room Impulse Response With Neural Fields

RevRIR: Joint Reverberant Speech and Room Impulse Response Embedding using Contrastive Learning with Application to Room Shape Classification

Room Impulse Response Estimation in a Multiple Source Environment

Uncertainties of Reverberation Time Estimation Via Adaptively Identified Room Impulse Responses.

Acoustic Modal Analysis of Room Responses from the Perspective of State-Space Balanced Realization with Application to Field Interpolation.

Mean absorption estimation from room impulse responses using virtually supervised learning

Room impulse response reconstruction with physics-informed deep learning

Room Impulse Response Estimation using Optimal Transport: Simulation-Informed Inference

Diminishing Domain Mismatch for DNN-Based Acoustic Distance Estimation via Stochastic Room Reverberation Models

Deep Room Recognition Using Inaudible Echos

Advanced system identification techniques for acoustics enhancement

Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark