Abstract:Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems. Supervised learning approaches have proven effective at tackling this challenge, but they need a significant amount of labeled training data in a given domain. However, new domains (i.e., unseen in training) may emerge after deployment. Thus, it is imperative that these models seamlessly adapt and fill slots from both seen and unseen domains -- unseen domains contain unseen slot types with no training data, and even seen slots in unseen domains are typically presented in different contexts. This setting is commonly referred to as zero-shot slot filling. Little work has focused on this setting, with limited experimental evaluation. Existing models that mainly rely on context-independent embedding-based similarity measures fail to detect slot values in unseen domains or do so only partially. We propose a new zero-shot slot filling neural model, LEONA, which works in three steps. Step one acquires domain-oblivious, context-aware representations of the utterance word by exploiting (a) linguistic features; (b) named entity recognition cues; (c) contextual embeddings from pre-trained language models. Step two fine-tunes these rich representations and produces slot-independent tags for each word. Step three exploits generalizable context-aware utterance-slot similarity features at the word level, uses slot-independent tags, and contextualizes them to produce slot-specific predictions for each word. Our thorough evaluation on four diverse public datasets demonstrates that our approach consistently outperforms the SOTA models by 17.52%, 22.15%, 17.42%, and 17.95% on average for unseen domains on SNIPS, ATIS, MultiWOZ, and SGD datasets, respectively.

Novel Slot Detection: A Benchmark for Discovering Unknown Slot Types in the Task-Oriented Dialogue System

Exploiting domain-slot related keywords description for Few-Shot Cross-Domain Dialogue State Tracking

A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots

Slot Self-Attentive Dialogue State Tracking

Active Discovering New Slots for Task-Oriented Conversation

STN4DST: A Scalable Dialogue State Tracking based on Slot Tagging Navigation

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning

Act-Aware Slot-Value Predicting in Multi-Domain Dialogue State Tracking

Dialogue State Tracking With Explicit Slot Connection Modeling

Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking

Transforming Slot Schema Induction with Generative Dialogue State Inference

Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbations

A Post-Processing Method for Detecting Unknown Intent of Dialogue System Via Pre-Trained Deep Neural Network Classifier

Knowledge-Aware Audio-Grounded Generative Slot Filling for Limited Annotated Data

A Novel Slot-Gated Model Combined with a Key Verb Context Feature for Task Request Understanding by Service Robots

Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems

Unknown Intent Detection Method Based on Model Post-Processing

Enhanced Multi-Domain Dialogue State Tracker with Second-Order Slot Interactions

Linguistically-Enriched and Context-Aware Zero-shot Slot Filling

On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools