Abstract:The advancement of large language models (LLMs) has propelled the development of dialogue systems. Unlike the popular ChatGPT-like assistant model, which only satisfies the user's preferences, task-oriented dialogue systems have also faced new requirements and challenges in the broader business field. They are expected to provide correct responses at each dialogue turn, at the same time, achieve the overall goal defined by the task. By understanding rhetorical structures and topic structures via topic segmentation and discourse parsing, a dialogue system may do a better planning to achieve both objectives. However, while both structures belong to discourse structure in linguistics, rhetorical structure and topic structure are mostly modeled separately or with one assisting the other in the prior work. The interaction between these two structures has not been considered for joint modeling and mutual learning. Furthermore, unsupervised learning techniques to achieve the above are not well explored. To fill this gap, we propose an unsupervised mutual learning framework of two structures leveraging the global and local connections between them. We extend the topic modeling between non-adjacent discourse units to ensure global structural relevance with rhetorical structures. We also incorporate rhetorical structures into the topic structure through a graph neural network model to ensure local coherence consistency. Finally, we utilize the similarity between the two fused structures for mutual learning. The experimental results demonstrate that our methods outperform all strong baselines on two dialogue rhetorical datasets (STAC and Molweni), as well as dialogue topic datasets (Doc2Dial and TIAGE). We provide our code at <a class="link-external link-https" href="https://github.com/Jeff-Sue/URT" rel="external noopener nofollow">this https URL</a>.

Joint Dual Learning with Mutual Information Maximization for Natural Language Understanding and Generation in Dialogues

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Deep Reinforcement Learning for Dialogue Generation

End-to-End Joint Learning of Natural Language Understanding and Dialogue Manager

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System.

Dual Semantic Knowledge Composed Multimodal Dialog Systems

Unsupervised Mutual Learning of Dialogue Discourse Parsing and Topic Segmentation

A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applications

Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization

Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language Model

Modeling Text-visual Mutual Dependency for Multi-modal Dialog Generation

Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History

Tri-level Joint Natural Language Understanding for Multi-turn Conversational Datasets

Unified Generative and Discriminative Training for Multi-modal Large Language Models

Dual Learning for Semi-Supervised Natural Language Understanding

Know Deeper: Knowledge-Conversation Cyclic Utilization Mechanism for Open-domain Dialogue Generation

UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

DLVGen: A Dual Latent Variable Approach to Personalized Dialogue Generation

DialogGen: Multi-modal Interactive Dialogue System for Multi-turn Text-to-Image Generation