Abstract:Robot audition systems with multiple microphone arrays have many applications in practice. However, accurate calibration of multiple microphone arrays remains challenging because there are many unknown parameters to be identified, including the relative transforms (i.e., orientation, translation) and asynchronous factors (i.e., initial time offset and sampling clock difference) between microphone arrays. To tackle these challenges, in this paper, we adopt batch simultaneous localization and mapping (SLAM) for joint calibration of multiple asynchronous microphone arrays and sound source localization. Using the Fisher information matrix (FIM) approach, we first conduct the observability analysis (i.e., parameter identifiability) of the above-mentioned calibration problem and establish necessary/sufficient conditions under which the FIM and the Jacobian matrix have full column rank, which implies the identifiability of the unknown parameters. We also discover several scenarios where the unknown parameters are not uniquely identifiable. Subsequently, we propose an effective framework to initialize the unknown parameters, which is used as the initial guess in batch SLAM for multiple microphone arrays calibration, aiming to further enhance optimization accuracy and convergence. Extensive numerical simulations and real experiments have been conducted to verify the performance of the proposed method. The experiment results show that the proposed pipeline achieves higher accuracy with fast convergence in comparison to methods that use the noise-corrupted ground truth of the unknown parameters as the initial guess in the optimization and other existing frameworks.

A New Joint Localization Model Using Multiple Microphone Arrays for Passive Acoustic Source Localization System

Real-Time Space 3D Acoustic Location Based on Monte Carlo Algorithm

Efficient Localization of Low-Frequency Sound Source with Non-Synchronous Measurement at Coprime Positions by Alternating Direction Method of Multipliers.

A Bayesian Framework of Non-Synchronous Measurements at Coprime Positions for Sound Source Localization with High Resolution

Passive Localization Based on Double-Correlation Function Using Sources of Opportunity

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

On the Accuracy of Passive Source Localization Using Acoustic Sensor Array Networks

Design and assessment of multiple-sound source localization using microphone arrays

SLAM-based Joint Calibration of Multiple Asynchronous Microphone Arrays and Sound Source Localization

Joint DOA Estimation and Dereverberation Based on Multi-Channel Linear Prediction Filtering and Azimuth Sparsity

Simultaneous Audio Source Localization and Microphone Placement.

Joint model-based recognition and localization of overlapped acoustic events using a set of distributed small microphone arrays

Sound Localization Based on Acoustic Source Using Multiple Microphone Array in an Indoor Environment

Direct Localization of Multiple Sources in Sensor Array Networks: A Joint Sparse Representation of Array Covariance Matrices Approach

Near-field Multiple Source Localization Using Joint Diagonalization

Study on the Localization Method of Multi-Aperture Acoustic Array Based on TDOA

Source Localization in Acoustic Sensor Networks Via Constrained Least-Squares Optimization Using AOA and GROA Measurements.

Research on multi-sound source localization performance based on leaf-shaped microphone array

Acoustic Array Systems : Paper ICA 2016-352 A sound source localization algorithm using microphone array with rigid body

Passive Source Localization from Array Covariance Matrices Via Joint Sparse Representations.

Towards Robust Multiple Blind Source Localization Using Source Separation and Beamforming