Abstract:Internet of Things (IoT) based voice interaction system, as a new artificial intelligence application, provides a new human–computer interaction mode. The more intelligent and efficient communication approach poses greater challenges to the semantic understanding module in the system. Facing with the complex and diverse interactive scenarios in practical applications, the academia and the industry urgently need more powerful Natural Language Understanding (NLU) methods as support. Intent Detection and Slot Filling joint task, as one of the core sub-tasks in NLU, has been widely used in different human–computer interaction scenarios. In the current era of deep learning, the joint task of Intent Detection and Slot Filling has also changed from previous rule-based methods to deep learning-based methods. It is an important problem to explore how to realize the models of these tasks to be refined and targeted designed, and to make the Intent Detection task better serve the improvement of precision of Slot Filling task by connecting the before and after tasks. It has great significance for building a more humanized IoT voice interaction system. In this study, we designed two joint models to realize Intent Detection and Slot Filling joint task. For the Intent Detection type task, one is based on BiGRU-Att-CapsuleNet (hybrid-based model) and the other is based on the RCNN model. Both methods use the BiGRU-CRF model for the Slot Filling type task. The hybrid-based model can enhance the semantic capture capability of a single model. And by combining specialized models built independently for each task to achieve a complete joint task, it can be better to achieve optimal performance on each task. This study also carried out detailed comparative experiments of tasks and joint tasks on multiple datasets. Experiments show that the joint models have achieved competitive results in 7 typical datasets included in multiple scenarios in English and Chinese compared with other models.

Improving NLU Training over Linked Data with Placeholder Concepts

Towards Enhancing Linked Data Retrieval in Conversational UIs using Large Language Models

Efficient Deployment of Conversational Natural Language Interfaces over Databases

Using NLU in Context for Question Answering: Improving on Facebook's bAbI Tasks

Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU

NLU for Game-based Learning in Real: Initial Evaluations

A Language Model based Framework for New Concept Placement in Ontologies

Exploring the importance of context and embeddings in neural NER models for task-oriented dialogue systems

Using Natural Language Inference to Improve Persona Extraction from Dialogue in a New Domain

Link the World: Improving Open-domain Conversation with Dynamic Spatiotemporal-aware Knowledge

NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue

Improving Contextual Language Models for Response Retrieval in Multi-Turn Conversation

Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets

Using Pause Information for More Accurate Entity Recognition

Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems

Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems

Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoders

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade

Natural language understanding approaches based on joint task of intent detection and slot filling for IoT voice interaction