Abstract:Internet of Things (IoT) based voice interaction system, as a new artificial intelligence application, provides a new human–computer interaction mode. The more intelligent and efficient communication approach poses greater challenges to the semantic understanding module in the system. Facing with the complex and diverse interactive scenarios in practical applications, the academia and the industry urgently need more powerful Natural Language Understanding (NLU) methods as support. Intent Detection and Slot Filling joint task, as one of the core sub-tasks in NLU, has been widely used in different human–computer interaction scenarios. In the current era of deep learning, the joint task of Intent Detection and Slot Filling has also changed from previous rule-based methods to deep learning-based methods. It is an important problem to explore how to realize the models of these tasks to be refined and targeted designed, and to make the Intent Detection task better serve the improvement of precision of Slot Filling task by connecting the before and after tasks. It has great significance for building a more humanized IoT voice interaction system. In this study, we designed two joint models to realize Intent Detection and Slot Filling joint task. For the Intent Detection type task, one is based on BiGRU-Att-CapsuleNet (hybrid-based model) and the other is based on the RCNN model. Both methods use the BiGRU-CRF model for the Slot Filling type task. The hybrid-based model can enhance the semantic capture capability of a single model. And by combining specialized models built independently for each task to achieve a complete joint task, it can be better to achieve optimal performance on each task. This study also carried out detailed comparative experiments of tasks and joint tasks on multiple datasets. Experiments show that the joint models have achieved competitive results in 7 typical datasets included in multiple scenarios in English and Chinese compared with other models.

Intent Detection and Slot Filling with Capsule Net Architectures for a Romanian Home Assistant

Fine-grained Language Identification with Multilingual CapsNet Model

Intent Detection and Slot Filling for Home Assistants: Dataset and Analysis for Bangla and Sylheti

Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data Augmentation

Adversarial Capsule Networks for Romanian Satire Detection and Sentiment Analysis

Natural language understanding approaches based on joint task of intent detection and slot filling for IoT voice interaction

Multitask Learning with Capsule Networks for Speech-to-Intent Applications

Cross-lingual Capsule Network for Hate Speech Detection in Social Media

Zero-shot User Intent Detection via Capsule Neural Networks

Intent-enhanced attentive Bert capsule network for zero-shot intention detection

Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection

A Novel Model Based on a Transformer for Intent Detection and Slot Filling

Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterances

Reconstructing Capsule Networks for Zero-shot Intent Classification

Multilingual deep learning framework for fake news detection using capsule neural network

Real-time Caller Intent Detection In Human-Human Customer Support Spoken Conversations

Intent detection for task‐oriented conversational agents: A comparative study of recurrent neural networks and transformer models

User-in-the-loop Adaptive Intent Detection for Instructable Digital Assistant

A Persian Benchmark for Joint Intent Detection and Slot Filling

Multi-turn Intent Determination and Slot Filling with Neural Networks and Regular Expressions.

Hierarchical Object-Centric Learning with Capsule Networks