Abstract:Recently, supervised speaker-independent speech separation methods. such as deep clustering and permutation invariant training, have demonstrated better performance than conventional unsupervised speech separation methods. However, their performance drops sharply in reverberant environments. To solve the problem, we propose a multi-channel speech separation algorithm that fully explores spatial information. It first extracts a spatial feature, named interaural phase difference (IPD), as one of the input features of the single-channel deep clustering algorithm. Then, it uses the deep clustering as the noise estimation component of the deep-learning-based beamforming. The novelty of the proposed algorithm lies in that it extends the spatial-feature-based deep clustering to a multichannel algorithm which boosts the performance by exploring spatial information at both the input and output of deep clustering. Its advantages have two aspects. First, the spatial feature IPD significantly improves the robustness of deep clustering in reverberant environments. Second, the deep-clusteing-based beamforming, which is a linear algorithm, suffers less nonlinear distortions than the single-channel deep clustering. We have compared the proposed algorithm with the single-channel deep clustering algorithm, spatial-feature-based multi-channel deep clustering with IPD, and deep-clustering-based beamforming without IPD in reverberant environments. Experimental results show that the proposed algorithm performs significantly better than the comparison methods.

Speaker Segmentation and Clustering Based on the Improved Spectral Clustering

Multi-speaker Segmentation and Clustering of Telephone Speech

A new DP-like speaker clustering algorithm

An Investigation of Speaker Clustering Algorithms in Adverse Acoustic Environments

UBM Based Speaker Segmentation and Clustering for 2-Speaker Detection

Efficient Audio Stream Segmentation Via the Combined T-2 Statistic and Bayesian Information Criterion

Single-Channel Multi-Speaker Separation using Deep Clustering

Speaker Segmentation Based on Between-Window Correlation over Speakers' Characteristics

Self-Tuning Spectral Clustering for Speaker Diarization

A Novel Speaker Clustering Algorithm Via Supervised Affinity Propagation

Unsupervised audio stream segmentation and clustering via the Bayesian information criterion

Speaker Clustering of Telephone Speech Based on Front-End Factor Analysis

Speaker Clustering Algorithm in Speech Recognition

An Improved Speaker Based Speech Segmentation Algorithm

Computationally Efficient Audio Segmentation Through a Multi-Stage BIC Approach

Boosting Spatial Information for Deep Learning Based Multichannel Speaker-Independent Speech Separation in Reverberant Environments.

Speaker Diarization Using EHMM and CLR

A pitch-based rapid speech segmentation for speaker indexing

A Quick and Effective Speaker Diarization System.

Method of Speakers Segmentation Based on Pre-Segmentation

Speaker Segmentation and Clustering in Meetings