Abstract:Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems. Supervised learning approaches have proven effective at tackling this challenge, but they need a significant amount of labeled training data in a given domain. However, new domains (i.e., unseen in training) may emerge after deployment. Thus, it is imperative that these models seamlessly adapt and fill slots from both seen and unseen domains -- unseen domains contain unseen slot types with no training data, and even seen slots in unseen domains are typically presented in different contexts. This setting is commonly referred to as zero-shot slot filling. Little work has focused on this setting, with limited experimental evaluation. Existing models that mainly rely on context-independent embedding-based similarity measures fail to detect slot values in unseen domains or do so only partially. We propose a new zero-shot slot filling neural model, LEONA, which works in three steps. Step one acquires domain-oblivious, context-aware representations of the utterance word by exploiting (a) linguistic features; (b) named entity recognition cues; (c) contextual embeddings from pre-trained language models. Step two fine-tunes these rich representations and produces slot-independent tags for each word. Step three exploits generalizable context-aware utterance-slot similarity features at the word level, uses slot-independent tags, and contextualizes them to produce slot-specific predictions for each word. Our thorough evaluation on four diverse public datasets demonstrates that our approach consistently outperforms the SOTA models by 17.52%, 22.15%, 17.42%, and 17.95% on average for unseen domains on SNIPS, ATIS, MultiWOZ, and SGD datasets, respectively.

OmniFill: Domain-Agnostic Form Filling Suggestions Using Multi-Faceted Context

Linguistically-Enriched and Context-Aware Zero-shot Slot Filling

mForms : Multimodal Form-Filling with Question Answering

CAPFF: A Context-Aware Assistant for Paper Form Filling.

Field Label Prediction for Autofill in Web Browsers

A Situation-Aware and Interactive System for Assisting People Fill out Paper Forms

OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMs

Sequential Decision-Making for Inline Text Autocomplete

Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestion

LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systems

Enabling Language Models to Fill in the Blanks

Make Your LLM Fully Utilize the Context

FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information

FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information.

Prompt Middleware: Mapping Prompts for Large Language Models to UI Affordances

An Ensemble Approach to Personalized Real Time Predictive Writing for Experts

Context-faithful Prompting for Large Language Models

NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window?

OMNI: Open-endedness via Models of human Notions of Interestingness

Generalized Multiple Intent Conditioned Slot Filling

CodeFill: Multi-token Code Completion by Jointly Learning from Structure and Naming Sequences