Abstract:In this paper, we apply a latent class model (LCM) to the task of speaker diarization. LCM is similar to Patrick Kenny's variational Bayes (VB) method in that it uses soft information and avoids premature hard decisions in its iterations. In contrast to the VB method, which is based on a generative model, LCM provides a framework allowing both generative and discriminative models. The discriminative property is realized through the use of i-vector (Ivec), probabilistic linear discriminative analysis (PLDA), and a support vector machine (SVM) in this work. Systems denoted as LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid are introduced. In addition, three further improvements are applied to enhance its performance. 1) Adding neighbor windows to extract more speaker information for each short segment. 2) Using a hidden Markov model to avoid frequent speaker change points. 3) Using an agglomerative hierarchical cluster to do initialization and present hard and soft priors, in order to overcome the problem of initial sensitivity. Experiments on the National Institute of Standards and Technology Rich Transcription 2009 speaker diarization database, under the condition of a single distant microphone, show that the diarization error rate (DER) of the proposed methods has substantial relative improvements compared with mainstream systems. Compared to the VB method, the relative improvements of LCM-Ivec-PLDA, LCM-Ivec-SVM, and LCM-Ivec-Hybrid systems are 23.5%, 27.1%, and 43.0%, respectively. Experiments on our collected database, CALLHOME97, CALLHOME00 and SRE08 short2-summed trial conditions also show that the proposed LCM-Ivec-Hybrid system has the best overall performance.

Probabilistic Latent Speaker Analysis for Large Vocabulary Speech Recognition

Probabilistic Latent Speaker Training for Large Vocabulary Speech Recognition

Probabilistic Speaker-Class Based Acoustic Modeling for Large Vocabulary Continuous Speech Recognition

Learning Virtual HD Model for Bi-model Emotional Speaker Recognition

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Latent Correlation Analysis of HMM Parameters for Speech Recognition

Joint Probabilistic Linear Discriminant Analysis

Model Adaptation Using the Projection to Latent Structure Algorithm

Hidden Markov Acoustic Modeling with Bootstrap and Restructuring for Low-Resourced Languages

Probabilistic Spherical Discriminant Analysis: An Alternative to PLDA for length-normalized embeddings

Latent Class Model with Application to Speaker Diarization

Who Spoke What? A Latent Variable Framework for the Joint Decoding of Multiple Speakers and their Keywords

Language-aware PLDA for multilingual speaker recognition

High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model

Text-Independent Speaker Verification Via State Alignment.

Research on Polynomial-Fitting Speech-Trajectory Model in Chinese Continuous Speech Recognition

Exploiting Glottal Information in Speaker Recognition Using Parallel GMMs

A hidden trajectory model with bi-directional target filtering: cascaded vs. integrated implementation for phonetic recognition

A New Combined Model of Statics-Dynamics of Speech.

Learning Similarity Functions for Pronunciation Variations

Improving Short Utterance PLDA Speaker Verification using SUV Modelling and Utterance Partitioning Approach