Abstract:Internet of Things (IoT) based voice interaction system, as a new artificial intelligence application, provides a new human–computer interaction mode. The more intelligent and efficient communication approach poses greater challenges to the semantic understanding module in the system. Facing with the complex and diverse interactive scenarios in practical applications, the academia and the industry urgently need more powerful Natural Language Understanding (NLU) methods as support. Intent Detection and Slot Filling joint task, as one of the core sub-tasks in NLU, has been widely used in different human–computer interaction scenarios. In the current era of deep learning, the joint task of Intent Detection and Slot Filling has also changed from previous rule-based methods to deep learning-based methods. It is an important problem to explore how to realize the models of these tasks to be refined and targeted designed, and to make the Intent Detection task better serve the improvement of precision of Slot Filling task by connecting the before and after tasks. It has great significance for building a more humanized IoT voice interaction system. In this study, we designed two joint models to realize Intent Detection and Slot Filling joint task. For the Intent Detection type task, one is based on BiGRU-Att-CapsuleNet (hybrid-based model) and the other is based on the RCNN model. Both methods use the BiGRU-CRF model for the Slot Filling type task. The hybrid-based model can enhance the semantic capture capability of a single model. And by combining specialized models built independently for each task to achieve a complete joint task, it can be better to achieve optimal performance on each task. This study also carried out detailed comparative experiments of tasks and joint tasks on multiple datasets. Experiments show that the joint models have achieved competitive results in 7 typical datasets included in multiple scenarios in English and Chinese compared with other models.

A multi-tasking model of speaker-keyword classification for keeping human in the loop of drone-assisted inspection

A Multi-tasking Model of Speaker-Keyword Classification for Keeping Human in the Loop of Drone-assisted Inspection

Learning to Assist and Communicate with Novice Drone Pilots for Expert Level Performance

Multi-task Deep Cross-Attention Networks for Far-Field Speaker Verification and Keyword Spotting

A Virtual-Reality-Based Training and Assessment System for Bridge Inspectors With an Assistant Drone

MHRC: Closed-loop Decentralized Multi-Heterogeneous Robot Collaboration with Large Language Models

Multimodal Human-Autonomous Agents Interaction Using Pre-Trained Language and Visual Foundation Models

Examining Audio Communication Mechanisms for Supervising Fleets of Agricultural Robots

Enhancing Robot Task Planning and Execution through Multi-Layer Large Language Models

Audio-visual Keyword Spotting Based on Adaptive Decision Fusion under Noisy Conditions for Human-Robot Interaction.

Patrol Agent: an Autonomous UAV Framework for Urban Patrol Using on Board Vision Language Model and on Cloud Large Language Model

Brain-Inspired Perception Feature and Cognition Model Applied to Safety Patrol Robot

Multi-layer Attention Mechanism for Speech Keyword Recognition

ChatGPT As Your Vehicle Co-Pilot: an Initial Attempt.

Audio-Visual Multi-person Keyword Spotting Via Hybrid Fusion

Integrating spoken instructions into flight trajectory prediction to optimize automation in air traffic control

Speaking Style Compensation on Synthetic Audio for Robust Keyword Spotting.

On-device audio-visual multi-person wake word spotting

Joint Intent Detection Model for Task-oriented Human-Computer Dialogue System Using Asynchronous Training

AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment

Natural language understanding approaches based on joint task of intent detection and slot filling for IoT voice interaction