Abstract:The advancement of large language models (LLMs) has propelled the development of dialogue systems. Unlike the popular ChatGPT-like assistant model, which only satisfies the user's preferences, task-oriented dialogue systems have also faced new requirements and challenges in the broader business field. They are expected to provide correct responses at each dialogue turn, at the same time, achieve the overall goal defined by the task. By understanding rhetorical structures and topic structures via topic segmentation and discourse parsing, a dialogue system may do a better planning to achieve both objectives. However, while both structures belong to discourse structure in linguistics, rhetorical structure and topic structure are mostly modeled separately or with one assisting the other in the prior work. The interaction between these two structures has not been considered for joint modeling and mutual learning. Furthermore, unsupervised learning techniques to achieve the above are not well explored. To fill this gap, we propose an unsupervised mutual learning framework of two structures leveraging the global and local connections between them. We extend the topic modeling between non-adjacent discourse units to ensure global structural relevance with rhetorical structures. We also incorporate rhetorical structures into the topic structure through a graph neural network model to ensure local coherence consistency. Finally, we utilize the similarity between the two fused structures for mutual learning. The experimental results demonstrate that our methods outperform all strong baselines on two dialogue rhetorical datasets (STAC and Molweni), as well as dialogue topic datasets (Doc2Dial and TIAGE). We provide our code at <a class="link-external link-https" href="https://github.com/Jeff-Sue/URT" rel="external noopener nofollow">this https URL</a>.

UniDU: Towards A Unified Generative Dialogue Understanding Framework

UniDS: A Unified Dialogue System for Chit-Chat and Task-oriented Dialogues

UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understanding

Uni3DL: Unified Model for 3D and Language Understanding

UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learning

UniMF: A Unified Framework to Incorporate Multimodal Knowledge Bases Intoend-to-end Task-Oriented Dialogue Systems

DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning

UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog

Unikdd: A Unified Generative Model for Knowledge-Driven Dialogue

UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems

UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models

Unified Language Model Pre-training for Natural Language Understanding and Generation

UniGen: A Unified Generative Framework for Retrieval and Question Answering with Large Language Models

Unsupervised Mutual Learning of Dialogue Discourse Parsing and Topic Segmentation

UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model

UniTranSeR: A Unified Transformer Semantic Representation Framework for Multimodal Task-Oriented Dialog System

UniDiff: Advancing Vision-Language Models with Generative and Discriminative Learning

A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems

Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation

UniEvent: Unified Generative Model with Multi-Dimensional Prefix for Zero-Shot Event-Relational Reasoning.