Abstract:Deep learning (DL)-based speaker diarization methods have proven powerful performance comparing to traditional clustering-based methods for multi-talker speech diarization and recognition in farfield scenes. However, most DL-based approaches cannot utilize the spatial information well due to the poor robustness to unknown array topology and acoustic scenario. In this paper, a spatial long-term iterative mask estimation (SLT-IME) method is proposed to improve the performance of speaker diarization in various real-world acoustic scenarios. First, the complex angular central gaussian mixture model (cACGMM) with diarization results as initial values is used to estimate the presence probability of each speaker at each time-frequency bin, namely speaker masks, in a long-term chunk. Then, the speaker masks are converted to speaker activities according to the threshold, which deliver the diarization information of which speaker is active and when. Finally, the estimated speaker activity can also serve as the initial input for the diarization system, resulting in improved ASR performance. Experimental results on the CHiME-7 three datasets (CHiME-6, DiPCo, Mixer 6) show proposed method can improve diarization and recognition systems performance simultaneously. It also plays a key role in the ensemble system that achieves the best performance in the main track of CHiME-7 DASR Challenge.

A new DP-like speaker clustering algorithm

Speaker Segmentation and Clustering Based on the Improved Spectral Clustering

Multi-speaker Segmentation and Clustering of Telephone Speech

A Quick and Effective Speaker Diarization System.

Using confidence measures to evaluate the speaker turns in speaker segmentation

Speaker clustering method for distributed microphone

Speaker Clustering Algorithm in Speech Recognition

Efficient Audio Stream Segmentation Via the Combined T-2 Statistic and Bayesian Information Criterion

Single-Channel Multi-Speaker Separation using Deep Clustering

Discriminative Neural Clustering for Speaker Diarisation.

Low-Latency Deep Clustering For Speech Separation

Speaker Clustering Aided by Visual Dialogue Analysis

Interrelate Training and Searching: A Unified Online Clustering Framework for Speaker Diarization

UBM Based Speaker Segmentation and Clustering for 2-Speaker Detection

Speaker Recognition Based on Pre-Trained Model and Deep Clustering

Deep Self-Supervised Hierarchical Clustering for Speaker Diarization

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.

Speaker Classification Algorithm Based on Spatial Acoustic Feature

Analysis of Deep Clustering as Preprocessing for Automatic Speech Recognition of Sparsely Overlapping Speech

Speaker Adaptation for Telephony Data Using Speaker Clustering

SOT Triggered Neural Clustering for Speaker Attributed ASR