Abstract:Deep learning (DL)-based speaker diarization methods have proven powerful performance comparing to traditional clustering-based methods for multi-talker speech diarization and recognition in farfield scenes. However, most DL-based approaches cannot utilize the spatial information well due to the poor robustness to unknown array topology and acoustic scenario. In this paper, a spatial long-term iterative mask estimation (SLT-IME) method is proposed to improve the performance of speaker diarization in various real-world acoustic scenarios. First, the complex angular central gaussian mixture model (cACGMM) with diarization results as initial values is used to estimate the presence probability of each speaker at each time-frequency bin, namely speaker masks, in a long-term chunk. Then, the speaker masks are converted to speaker activities according to the threshold, which deliver the diarization information of which speaker is active and when. Finally, the estimated speaker activity can also serve as the initial input for the diarization system, resulting in improved ASR performance. Experimental results on the CHiME-7 three datasets (CHiME-6, DiPCo, Mixer 6) show proposed method can improve diarization and recognition systems performance simultaneously. It also plays a key role in the ensemble system that achieves the best performance in the main track of CHiME-7 DASR Challenge.

Research on Speaker-Independent Continuous Figure Speech-Recognition Based on High-Dimensional Space Covering and Dynamic Scanning

A Continuous Speech Recognition Method Based On Biomimetic Pattern Recognition Theory

Single Figure Syllable Modeling Based on Neural Network for Continuous Speech Recognition

Cepstral Smoothing of Spectral Masks for Acoustic Vector-Sensor Based Convolutive Speech Separation

Recognition of Chinese Continuous Speech Based on 3-Dimension Viterbi Search

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.

Research on continuous Chinese speech recognition system and knowledge based search strategies

Geometry Analysis and Recognition Research of Speech Signal

Research on Segmentation of Continuous Chinese Speech

Continuous Speech Speaker Recognition Based on CNN

A Russian Continuous Speech Recognition System Based on the DTW Algorithm under Artificial Intelligence

A New Subspace Based Speaker Adaptation Method

Spotting Chief Speaker from Press Conference Recordings Based on Silence Detection

Experiments and Analysis for Speaker Dependent Mandarin Syllable Recognition.

A New Model for Speech Recognition : Center-Distance Continuous Probability Model

Research on Continuous Chinese Speech Segmentation Based on Pitch Periodic Track

An Efficient Computation Algorithm In Mandarin Continuous Speech Recognition

Language Recognition Method Based on Hierarchical Space Analysis

Study on the Integration of Phonetic and Prosodic Probability Based on 3-Dimension Viterbi Search

Auditory model-based speech feature extraction and its application to speaker identification

Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study