Abstract:Speech signals recorded by distant microphones are often contaminated with room reverberation and signals of interfering speakers. This article addresses the problem of joint source separation and dereverberation using multichannel nonnegative tensor factorization (NTF) in which late reverberant components are modeled using the so-called delayed subsources. The article formulates two distinct signal models of the time-frequency spectrum of the multichannel microphone mixture, in which reverberation is modeled either independently for each source using delayed source variances or jointly using delayed microphone signals. In addition, it defines computationally efficient variants of these two methods with a simplified spatial model in which spatial properties of the late reverberant components are estimated jointly for all delays. For each of the four distinct algorithms, the article first formulates a maximum a posteriori (MaP) estimator based on the NTF model with the localization prior over the mixing matrix that is suitable for the estimation of the early reverberation (primarily the direct-path) signals in a reverberant environment. Next it derives update equations for the four resulting expectation-maximization algorithms, which are thoroughly evaluated and shown to outperform similar state-of-the-art approaches. The results of experimental evaluations, performed using real and simulated data, for determined, over-determined and under-determined scenarios, indicate superior performance of the proposed processing over state-of-the-art in terms of standard source separation and dereverberation metrics.

Spherical-harmonics-based sound field decomposition and multichannel NMF for sound source separation

Pre-trained Spatial Priors on Multichannel NMF for Music Source Separation

Sound Field Separating on Arbitrary Surfaces Enclosing a Sound Scatterer Based on Combined Integral Equations.

A New Seperation Method for Rotationg and Static Sound Source Localization

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Real-time separation of non-stationary sound fields on spheres

Separation of Moving Sound Sources Using Multichannel NMF and Acoustic Tracking

Multichannel Blind Music Source Separation Using Directivity-Aware MNMF With Harmonicity Constraints

Adaptive Beamforming Based on Interference-Plus-Noise Covariance Matrix Reconstruction for Speech Separation

A Multichannel Learning-Based Approach for Sound Source Separation in Reverberant Environments

Direction Specific Ambisonics Source Separation with End-To-End Deep Learning

Acoustic Source Localization and Deconvolution-Based Separation

Reverberant Source Separation Using NTF With Delayed Subsources and Spatial Priors

Multi-Microphone Speaker Separation by Spatial Regions

Sound Field Translation and Mixed Source Model for Virtual Applications with Perceptual Validation

Music source separation conditioned on 3D point clouds

Source Separation by Feature-Based Clustering of Microphones in Ad Hoc Arrays

Informed spatial filtering for sound extraction using distributed microphone arrays

Delay-and-Sum Beamforming Based Spatial Mapping for Multi-Source Sound Localization

Reconstruction of Interior Sound Field with Spherical Microphone Array

Frequency Domain Singular Value Decomposition for Efficient Spatial Audio Coding