Abstract:This paper describes an efficient unsupervised learning method for a neural source separation model that utilizes a probabilistic generative model of observed multichannel mixtures proposed for blind source separation (BSS). For this purpose, amortized variational inference (AVI) has been used for directly solving the inverse problem of BSS with full-rank spatial covariance analysis (FCA). Although this unsupervised technique called neural FCA is in principle free from the domain mismatch problem, it is computationally demanding due to the full rankness of the spatial model in exchange for robustness against relatively short reverberations. To reduce the model complexity without sacrificing performance, we propose neural FastFCA based on the jointly-diagonalizable yet full-rank spatial model. Our neural separation model introduced for AVI alternately performs neural network blocks and single steps of an efficient iterative algorithm called iterative source steering. This alternating architecture enables the separation model to quickly separate the mixture spectrogram by leveraging both the deep neural network and the multichannel optimization algorithm. The training objective with AVI is derived to maximize the marginalized likelihood of the observed mixtures. The experiment using mixture signals of two to four sound sources shows that neural FastFCA outperforms conventional BSS methods and reduces the computational time to about 2% of that for the neural FCA.

Neural Network Alternatives to Convolutive Audio Models for Source Separation

A Neural Network Alternative to Non-Negative Audio Models

End-to-end Non-Negative Autoencoders for Sound Source Separation

End-to-end Networks for Supervised Single-channel Speech Separation

Conformer Space Neural Architecture Search for Multi-Task Audio Separation

Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separation

A variance modeling framework based on variational autoencoders for speech enhancement

Deep NMF for speech separation

Transductive Convolutive Nonnegative Matrix Factorization For Speech Separation

Reverberant Signal Separation Using Optimized Complex Sparse Nonnegative Tensor Deconvolution on Spectral Covariance Matrix

Multichannel blind speech source separation with a disjoint constraint source model

Depthwise Separable Convolutions Versus Recurrent Neural Networks for Monaural Singing Voice Separation

Neural Network Approaches to Nonlinear Blind Source Separation.

Integration of variational autoencoder and spatial clustering for adaptive multi-channel neural speech separation

Underdetermined Convolutive Blind Separation of Sources Integrating Tensor Factorization and Expectation Maximization.

On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

Deformable Temporal Convolutional Networks for Monaural Noisy Reverberant Speech Separation

Single channel informed signal separation using artificial‐stereophonic mixtures and exemplar‐guided matrix factor deconvolution

Deep Attractor with Convolutional Network for Monaural Speech Separation

Underdetermined Reverberant Acoustic Source Separation Using Weighted Full-Rank Nonnegative Tensor Models.