Abstract:Deep learning (DL)-based speaker diarization methods have proven powerful performance comparing to traditional clustering-based methods for multi-talker speech diarization and recognition in farfield scenes. However, most DL-based approaches cannot utilize the spatial information well due to the poor robustness to unknown array topology and acoustic scenario. In this paper, a spatial long-term iterative mask estimation (SLT-IME) method is proposed to improve the performance of speaker diarization in various real-world acoustic scenarios. First, the complex angular central gaussian mixture model (cACGMM) with diarization results as initial values is used to estimate the presence probability of each speaker at each time-frequency bin, namely speaker masks, in a long-term chunk. Then, the speaker masks are converted to speaker activities according to the threshold, which deliver the diarization information of which speaker is active and when. Finally, the estimated speaker activity can also serve as the initial input for the diarization system, resulting in improved ASR performance. Experimental results on the CHiME-7 three datasets (CHiME-6, DiPCo, Mixer 6) show proposed method can improve diarization and recognition systems performance simultaneously. It also plays a key role in the ensemble system that achieves the best performance in the main track of CHiME-7 DASR Challenge.

Speaker Identification Based on the Time-Delay Hierarchical Mixture of Experts

Speaker Identification Using Time-delay Hmes.

Combine Multiple Time-Delay HMEs for Speaker Identification

Learning Virtual HD Model for Bi-model Emotional Speaker Recognition

Universal background model reduction based efficient speaker recognition

Real-time Speaker Recognition System for PDA

An Hmm/Mfnn Hybrid Architecture Based On Stacked Generalization For Speaker Identification

Text-dependent Speaker Identification Based on Input/output HMMs: an Empirical Study

A Modified Mixtures of Experts Architecture for Classification with Diverse Features

Mixture of Support Vector Machines for Text-Independent Speaker Recognition

Speaker Identification Using a Reference Speaker Model Based a Two-Layer Structure

Look, Listen and Learn - A Multimodal LSTM for Speaker Identification

Speaker Identification based on LSP and Gaussian Mixture Model

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Speaker Identification System Based on Hybrid Neural Network

Speech Enhancement Based on Deep Mixture of Distinguishing Experts

Short Time Speaker Recognition Method Based on Common Feature Selection

Speech Enhancement using a Deep Mixture of Experts

Text Prompted Speaker Verification Based On Phoneme Clustering With Earth Mover'S Distane And Cauchy-Schwarz Divergence

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.