Abstract:In this paper, we apply a latent class model (LCM) to the task of speaker diarization. LCM is similar to Patrick Kenny's variational Bayes (VB) method in that it uses soft information and avoids premature hard decisions in its iterations. In contrast to the VB method, which is based on a generative model, LCM provides a framework allowing both generative and discriminative models. The discriminative property is realized through the use of i-vector (Ivec), probabilistic linear discriminative analysis (PLDA), and a support vector machine (SVM) in this work. Systems denoted as LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid are introduced. In addition, three further improvements are applied to enhance its performance. 1) Adding neighbor windows to extract more speaker information for each short segment. 2) Using a hidden Markov model to avoid frequent speaker change points. 3) Using an agglomerative hierarchical cluster to do initialization and present hard and soft priors, in order to overcome the problem of initial sensitivity. Experiments on the National Institute of Standards and Technology Rich Transcription 2009 speaker diarization database, under the condition of a single distant microphone, show that the diarization error rate (DER) of the proposed methods has substantial relative improvements compared with mainstream systems. Compared to the VB method, the relative improvements of LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid systems are 23.5%, 27.1%, and 43.0%, respectively. Experiments on our collected database, CALLHOME97, CALLHOME00 and SRE08 short2-summed trial conditions also show that the proposed LCM-Ivec-Hybrid system has the best overall performance.

Automatic Meeting Participant Role Detection by Dialogue Patterns

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

Using Prosody for Automatic Sentence Segmentation of Multi-party Meetings

Speaker Verification in Agent-Generated Conversations

Online Recognition of Group Actions in Intelligent Meeting Scenario

Joint Speech Activity and Overlap Detection with Multi-Exit Architecture

Online speaker diarization of meetings guided by speech separation

Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos

Self-Supervised Vision-Based Detection of the Active Speaker as Support for Socially-Aware Language Acquisition

Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features

Multi-Stage Face-Voice Association Learning with Keynote Speaker Diarization

Dialogue Act Modeling for Automatic Tagging and Recognition of Conversational Speech

Audio-visual child-adult speaker classification in dyadic interactions

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.

A survey of multi-party dialogue research based on deep learning

Speaker Overlap-aware Neural Diarization for Multi-party Meeting Analysis

Joint speech and overlap detection: a benchmark over multiple audio setup and speech domains

Investigation of Spatial-Acoustic Features for Overlapping Speech Detection in Multiparty Meetings

Latent Class Model with Application to Speaker Diarization

INTEGRATION OF SPEECH SEPARATION, DIARIZATION, AND RECOGNITION FOR MULTI-SPEAKER MEETINGS: SYSTEM DESCRIPTION, COMPARISON, AND ANALYSIS

Multi-Scale Temporal Convolution Network for Classroom Voice Detection