Abstract:In the development of a task-oriented dialogue system, defining the dialogue structure is a time-consuming task. Hence, several works have looked into automatically inferring it from data, e.g., actual conversations between a customer and a support agent. To recover such dialogue structure, recent methods based on discrete variational models learn to jointly encode and cluster utterances in dialogue states, but (i) represent utterances by only considering preceding dialogue context, and (ii) are slow to train since they are optimized with a compute-expensive decoding objective. We revisit and improve upon an existing efficient pipeline approach, commonly adopted as a baseline, that first encodes utterances and then clusters them with k -means to induce the dialogue structure. However, the existing approach represents utterances as bag-of-words or skip-thought vectors, which have been shown to perform poorly in semantic similarity tasks, and without considering dialogue context. We therefore first investigate the use of more powerful transformer-based encoders for encoding utterances. Next, we propose ell o dar , a method for learning representations that capture both preceding and subsequent dialogue context, inspired by word-to-vec training strategies. ell o dar is efficient since representations are learned directly in the encoding space by finetuning just a single linear layer on top of a frozen sentence encoder with a vector-to-vector regression training objective. Extensive experiments on representative datasets for dialogue structure induction (SimDial, Schema Guided Dialogues, DSTC2, and CamRest676) demonstrate that in terms of effectiveness to induce the correct dialogue structure, (i) clustering utterances represented by transformed-based encoders improves recent joint models by 13%–32% on standard cluster metrics, and (ii) clustering ell o dar 's representations yields additional improvements ranging from +20% to +26%, with speedups of – compared to the recent joint models.

Triple-Encoders: Representations That Fire Together, Wire Together

Revisiting clustering for efficient unsupervised dialogue structure induction

Imperfect Vision Encoders: Efficient and Robust Tuning for Vision-Language Models

Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue

Joint Learning of Context and Feedback Embeddings in Spoken Dialogue

A Bi-Encoder LSTM Model For Learning Unstructured Dialogs

Uncovering Hidden Connections: Iterative Search and Reasoning for Video-grounded Dialog

Explaining Vision-Language Similarities in Dual Encoders with Feature-Pair Attributions

Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning

Uni-Encoder: A Fast and Accurate Response Selection Paradigm for Generation-Based Dialogue Systems

An Efficient and Explanatory Image and Text Clustering System with Multimodal Autoencoder Architecture

Peeling Back the Layers: An In-Depth Evaluation of Encoder Architectures in Neural News Recommenders

Decoder : Generate rewritten-utterance Encoder : Last Utterance RepresentationEncoder : Context Representation

CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognition

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

Collaborative Training of Acoustic Encoders for Speech Recognition

Two-Stage Triplet Loss Training with Curriculum Augmentation for Audio-Visual Retrieval

Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval

Electrolaryngeal Speech Intelligibility Enhancement Through Robust Linguistic Encoders

Linking Representations with Multimodal Contrastive Learning