Abstract:Purpose Intent detection (ID) and slot filling (SF) are two important tasks in natural language understanding. ID is to identify the main intent of a paragraph of text. The goal of SF is to extract the information that is important to the intent from the input sentence. However, most of the existing methods use sentence-level intention recognition, which has the risk of error propagation, and the relationship between intention recognition and SF is not explicitly modeled. Aiming at this problem, this paper proposes a collaborative model of ID and SF for intelligent spoken language understanding called ID-SF-Fusion. Design/methodology/approach ID-SF-Fusion uses Bidirectional Encoder Representation from Transformers (BERT) and Bidirectional Long Short-Term Memory (BiLSTM) to extract effective word embedding and context vectors containing the whole sentence information respectively. Fusion layer is used to provide intent–slot fusion information for SF task. In this way, the relationship between ID and SF task is fully explicitly modeled. This layer takes the result of ID and slot context vectors as input to obtain the fusion information which contains both ID result and slot information. Meanwhile, to further reduce error propagation, we use word-level ID for the ID-SF-Fusion model. Finally, two tasks of ID and SF are realized by joint optimization training. Findings We conducted experiments on two public datasets, Airline Travel Information Systems (ATIS) and Snips. The results show that the Intent ACC score and Slot F1 score of ID-SF-Fusion on ATIS and Snips are 98.0 per cent and 95.8 per cent, respectively, and the two indicators on Snips dataset are 98.6 per cent and 96.7 per cent, respectively. These models are superior to slot-gated, SF-ID NetWork, stack-Prop and other models. In addition, ablation experiments were performed to further analyze and discuss the proposed model. Originality/value This paper uses word-level intent recognition and introduces intent information into the SF process, which is a significant improvement on both data sets.

dzFinNlp at AraFinNLP: Improving Intent Detection in Financial Conversational Agents

AraFinNLP 2024: The First Arabic Financial NLP Shared Task

Learning Better Intent Representations for Financial Open Intent Classification

ArBanking77: Intent Detection Neural Model and a New Dataset in Modern and Dialectical Arabic

FinChain-BERT: A High-Accuracy Automatic Fraud Detection Model Based on NLP Methods for Financial Scenarios

LongFin: A Multimodal Document Understanding Model for Long Financial Domain Documents

DarijaBanking: A New Resource for Overcoming Language Barriers in Banking Intent Detection for Moroccan Arabic Speakers

Multilingual and Cross-Lingual Intent Detection from Spoken Data

FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining

Fraud detection in telephone conversations for financial services using linguistic features

Multi-Lingual Attention based Multi-Intent Detection in Dialogue System

Finsformer: A Novel Approach to Detecting Financial Attacks Using Transformer and Cluster-Attention

Enhancing Language Models for Financial Relation Extraction with Named Entities and Part-of-Speech

Data-Centric Financial Large Language Models

SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models

ID-SF-Fusion: a cooperative model of intent detection and slot filling for natural language understanding

Intent detection for task‐oriented conversational agents: A comparative study of recurrent neural networks and transformer models

Large Language Model Adaptation for Financial Sentiment Analysis

FinSoSent: Advancing Financial Market Sentiment Analysis through Pretrained Large Language Models

Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs

FETILDA: An Evaluation Framework for Effective Representations of Long Financial Documents