Abstract:Zero-shot dialogue state tracking (DST) seeks to enable dialogue systems to transition to unfamiliar domains without manual annotation or extensive retraining. Prior research has approached this objective by embedding prompts into language models (LMs). Common methodologies include integrating prompts at the input layer or introducing learnable variables at each transformer layer. Nonetheless, each strategy exhibits inherent limitations. Prompts integrated at the input layer risk underutilization, with their impact potentially diminishing across successive transformer layers. Conversely, the addition of learnable variables to each layer can complicate the training process and increase inference latency. To tackle the issues mentioned above, this paper proposes Dual Low-Rank Adaptation (DualLoRA), a plug-and-play architecture designed for zero-shot DST. DualLoRA incorporates two distinct Low-Rank Adaptation (LoRA) components, targeting both dialogue context processing and prompt optimization, to ensure the comprehensive influence of prompts throughout the transformer model layers. This is achieved without incurring additional inference latency, showcasing an efficient integration into existing architectures. Through rigorous evaluation on the MultiWOZ and SGD datasets, DualLoRA demonstrates notable improvements across multiple domains, outperforming traditional baseline methods in zero-shot settings. Our code is accessible at: \url{<a class="link-external link-https" href="https://github.com/suntea233/DualLoRA" rel="external noopener nofollow">this https URL</a>}.

ECO-DST: An Efficient Cross-lingual Dialogue State Tracking Framework

Zero-shot language extension for dialogue state tracking via pre-trained models and multi-auxiliary-tasks fine-tuning

Exploiting domain-slot related keywords description for Few-Shot Cross-Domain Dialogue State Tracking

XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Tracking

Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptation

Efficient Dialogue State Tracking by Selectively Overwriting Memory

Non-Autoregressive Dialog State Tracking

Enhanced Multi-Domain Dialogue State Tracker with Second-Order Slot Interactions

A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding

Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking

Jointly Optimizing State Operation Prediction and Value Generation for Dialogue State Tracking

Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Tracking

DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning

UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking

Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulation

SF-DST: Few-Shot Self-Feeding Reading Comprehension Dialogue State Tracking with Auxiliary Task

Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

OLISIA: a Cascade System for Spoken Dialogue State Tracking

Benchmarks Underestimate the Readiness of Multi-lingual Dialogue Agents

Cross-domain coreference modeling in dialogue state tracking with prompt learning

DSTEA: Improving Dialogue State Tracking via Entity Adaptive Pre-training