Abstract:In the development of a task-oriented dialogue system, defining the dialogue structure is a time-consuming task. Hence, several works have looked into automatically inferring it from data, e.g., actual conversations between a customer and a support agent. To recover such dialogue structure, recent methods based on discrete variational models learn to jointly encode and cluster utterances in dialogue states, but (i) represent utterances by only considering preceding dialogue context, and (ii) are slow to train since they are optimized with a compute-expensive decoding objective. We revisit and improve upon an existing efficient pipeline approach, commonly adopted as a baseline, that first encodes utterances and then clusters them with k -means to induce the dialogue structure. However, the existing approach represents utterances as bag-of-words or skip-thought vectors, which have been shown to perform poorly in semantic similarity tasks, and without considering dialogue context. We therefore first investigate the use of more powerful transformer-based encoders for encoding utterances. Next, we propose ell o dar , a method for learning representations that capture both preceding and subsequent dialogue context, inspired by word-to-vec training strategies. ell o dar is efficient since representations are learned directly in the encoding space by finetuning just a single linear layer on top of a frozen sentence encoder with a vector-to-vector regression training objective. Extensive experiments on representative datasets for dialogue structure induction (SimDial, Schema Guided Dialogues, DSTC2, and CamRest676) demonstrate that in terms of effectiveness to induce the correct dialogue structure, (i) clustering utterances represented by transformed-based encoders improves recent joint models by 13%–32% on standard cluster metrics, and (ii) clustering ell o dar 's representations yields additional improvements ranging from +20% to +26%, with speedups of – compared to the recent joint models.

Gaining Insights into Unrecognized User Utterances in Task-Oriented Dialog Systems

Finding Dominant User Utterances And System Responses in Conversations

Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue

Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

Task Oriented Dialogue as a Catalyst for Self-Supervised Automatic Speech Recognition

Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions

Making Task-Oriented Dialogue Datasets More Natural by Synthetically Generating Indirect User Requests

Revisiting clustering for efficient unsupervised dialogue structure induction

DialogUSR: Complex Dialogue Utterance Splitting and Reformulation for Multiple Intent Detection

Algorithms for automatic intents extraction and utterances classification for goal-oriented dialogue systems

An Efficient Self-Learning Framework For Interactive Spoken Dialog Systems

Conversational Intent Understanding for Passengers in Autonomous Vehicles

Understanding User Satisfaction with Task-oriented Dialogue Systems

Dialogos: a robust system for human-machine spoken dialogue on the telephone

Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems

From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue

Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation

"Stupid robot, I want to speak to a human!" User Frustration Detection in Task-Oriented Dialog Systems

Intent Mining from past conversations for conversational agent

DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems