Abstract:The advancement of large language models (LLMs) has propelled the development of dialogue systems. Unlike the popular ChatGPT-like assistant model, which only satisfies the user's preferences, task-oriented dialogue systems have also faced new requirements and challenges in the broader business field. They are expected to provide correct responses at each dialogue turn, at the same time, achieve the overall goal defined by the task. By understanding rhetorical structures and topic structures via topic segmentation and discourse parsing, a dialogue system may do a better planning to achieve both objectives. However, while both structures belong to discourse structure in linguistics, rhetorical structure and topic structure are mostly modeled separately or with one assisting the other in the prior work. The interaction between these two structures has not been considered for joint modeling and mutual learning. Furthermore, unsupervised learning techniques to achieve the above are not well explored. To fill this gap, we propose an unsupervised mutual learning framework of two structures leveraging the global and local connections between them. We extend the topic modeling between non-adjacent discourse units to ensure global structural relevance with rhetorical structures. We also incorporate rhetorical structures into the topic structure through a graph neural network model to ensure local coherence consistency. Finally, we utilize the similarity between the two fused structures for mutual learning. The experimental results demonstrate that our methods outperform all strong baselines on two dialogue rhetorical datasets (STAC and Molweni), as well as dialogue topic datasets (Doc2Dial and TIAGE). We provide our code at <a class="link-external link-https" href="https://github.com/Jeff-Sue/URT" rel="external noopener nofollow">this https URL</a>.

Semi-Supervised Learning of Dialogue Acts Using Sentence Similarity Based on Word Embeddings

OssCSE: Overcoming Surface Structure Bias in Contrastive Learning for Unsupervised Sentence Embedding

Word embeddings: A semi-supervised learning method for slot-filling in spoken dialog systems

Learning Dialogue Representations from Consecutive Utterances

Learning Semantic Textual Similarity from Conversations

Sentence Similarity Computation in Question Answering Robot

Sentence Similarity Based on Contexts

Improving Sentence Similarity Estimation for Unsupervised Extractive Summarization

Singing Voice Detection Via Similarity-Based Semi-Supervised Learning.

Word Usage Similarity Estimation with Sentence Representations and Automatic Substitutes

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

Unsupervised Mutual Learning of Dialogue Discourse Parsing and Topic Segmentation

Simple Dialogue System with AUDITED

Semi-supervised learning of word embeddings

A Context-based Approach for Dialogue Act Recognition using Simple Recurrent Neural Networks

Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings

Learning Dialogue History for Spoken Language Understanding.

Unsupervised Dialogue Topic Segmentation with Topic-aware Utterance Representation

Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction

Sentence-Embedding and Similarity via Hybrid Bidirectional-LSTM and CNN Utilizing Weighted-Pooling Attention

Unsupervised Dialog Structure Learning