Abstract:Reducing the interference noise in a monaural noisy speech signal has been a challenging task for many years. Compared to traditional unsupervised speech enhancement methods, e.g., Wiener filtering, supervised approaches, such as algorithms based on hidden Markov models (HMM), lead to higher-quality enhanced speech signals. However, the main practical difficulty of these approaches is that for each noise type a model is required to be trained a priori. In this paper, we investigate a new class of supervised speech denoising algorithms using nonnegative matrix factorization (NMF). We propose a novel speech enhancement method that is based on a Bayesian formulation of NMF (BNMF). To circumvent the mismatch problem between the training and testing stages, we propose two solutions. First, we use an HMM in combination with BNMF (BNMF-HMM) to derive a minimum mean square error (MMSE) estimator for the speech signal with no information about the underlying noise type. Second, we suggest a scheme to learn the required noise BNMF model online, which is then used to develop an unsupervised speech enhancement system. Extensive experiments are carried out to investigate the performance of the proposed methods under different conditions. Moreover, we compare the performance of the developed algorithms with state-of-the-art speech enhancement schemes using various objective measures. Our simulations show that the proposed BNMF-based methods outperform the competing algorithms substantially.

A Neural Network Alternative to Non-Negative Audio Models

Neural Network Alternatives to Convolutive Audio Models for Source Separation

End-to-end Non-Negative Autoencoders for Sound Source Separation

Deep NMF for speech separation

Rethinking Non-Negative Matrix Factorization with Implicit Neural Representations

Nonparametric Bayesian Nonnegative Matrix Factorization

Non-Negative Matrix Factorization with Sparsity Learning for Single Channel Audio Source Separation

End-to-end Networks for Supervised Single-channel Speech Separation

Adversarial Generative NMF for Single Channel Source Separation

Tackling Interpretability in Audio Classification Networks With Non-negative Matrix Factorization

Supervised and Unsupervised Speech Enhancement Using Nonnegative Matrix Factorization

Blind nonnegative source separation using biological neural networks

Neural-Based Separating Method for Nonlinear Mixtures

Determined Multichannel Blind Source Separation with Clustered Source Model

Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separation

Online algorithms for Nonnegative Matrix Factorization with the Itakura-Saito divergence

Maximum Discrepancy Generative Regularization and Non-Negative Matrix Factorization for Single Channel Source Separation

Separation of Moving Sound Sources Using Multichannel NMF and Acoustic Tracking

Multichannel Audio Source Separation with Independent Deeply Learned Matrix Analysis Using Product of Source Models

Conformer Space Neural Architecture Search for Multi-Task Audio Separation