Abstract:In the development of a task-oriented dialogue system, defining the dialogue structure is a time-consuming task. Hence, several works have looked into automatically inferring it from data, e.g., actual conversations between a customer and a support agent. To recover such dialogue structure, recent methods based on discrete variational models learn to jointly encode and cluster utterances in dialogue states, but (i) represent utterances by only considering preceding dialogue context, and (ii) are slow to train since they are optimized with a compute-expensive decoding objective. We revisit and improve upon an existing efficient pipeline approach, commonly adopted as a baseline, that first encodes utterances and then clusters them with k -means to induce the dialogue structure. However, the existing approach represents utterances as bag-of-words or skip-thought vectors, which have been shown to perform poorly in semantic similarity tasks, and without considering dialogue context. We therefore first investigate the use of more powerful transformer-based encoders for encoding utterances. Next, we propose ell o dar , a method for learning representations that capture both preceding and subsequent dialogue context, inspired by word-to-vec training strategies. ell o dar is efficient since representations are learned directly in the encoding space by finetuning just a single linear layer on top of a frozen sentence encoder with a vector-to-vector regression training objective. Extensive experiments on representative datasets for dialogue structure induction (SimDial, Schema Guided Dialogues, DSTC2, and CamRest676) demonstrate that in terms of effectiveness to induce the correct dialogue structure, (i) clustering utterances represented by transformed-based encoders improves recent joint models by 13%–32% on standard cluster metrics, and (ii) clustering ell o dar 's representations yields additional improvements ranging from +20% to +26%, with speedups of – compared to the recent joint models.

Speaker Clustering Aided by Visual Dialogue Analysis

Audio–Visual Deep Clustering for Speech Separation

CLUCDD: CONTRASTIVE DIALOGUE DISENTANGLEMENT VIA CLUSTERING

Speaker clustering method for distributed microphone

A new DP-like speaker clustering algorithm

A Clustering Based Adaptive Sequence-To-Sequence Model For Dialogue Systems

A Quick and Effective Speaker Diarization System.

Enhanced Streaming Based Subspace Clustering Applied to Acoustic Scene Data Clustering

D{é}tection de locuteurs dans les s{é}ries TV

Revisiting clustering for efficient unsupervised dialogue structure induction

A Novel Speaker Clustering Algorithm Via Supervised Affinity Propagation

Highly Efficient Real-Time Streaming and Fully On-Device Speaker Diarization with Multi-Stage Clustering

Speaker Clustering of Telephone Speech Based on Front-End Factor Analysis

SPEAKER RETRIEVAL FOR TV SHOW VIDEOS BY ASSOCIATING AUDIO SPEAKER RECOGNITION RESULT TO VISUAL FACES

Speaker Clustering Algorithm in Speech Recognition

Unsupervised Person Clustering in Videos with Cross-Modal Communication.

An Investigation of Speaker Clustering Algorithms in Adverse Acoustic Environments

Deep Self-Supervised Hierarchical Clustering for Speaker Diarization

Interrelate Training and Searching: A Unified Online Clustering Framework for Speaker Diarization

Speaker Segmentation and Clustering Based on the Improved Spectral Clustering

Single-Channel Multi-Speaker Separation using Deep Clustering