Abstract:Multi-turn dialogue systems with cognitive capabilities have been popularly used in many applications and generate a large volume of dialogue texts. The dialogue texts of many dialogue systems contain multiple labels, and a typical case is that the customer requirements or complaints in an online multi-turn dialogue service system often need to be classified into multiple categories or forwarded to multiple departments, that is, multi-label classification on multi-turn dialogue texts. Traditional methods treat the dialogue text as the plain text, which makes it difficult for classifiers to learn important features. On the other hand, regarding each utterance as the basic semantic unit may destroy the semantic information integrity of the dialogue. Furthermore, the above methods all ignore the relationship between labels. To address above issues, we propose to use the utterance pair as the basic semantic unit and design a novel multi-label classification model for multi-turn dialogue texts in this paper. Specifically, we propose to use multi-head attention mechanism to learn the key features of multiple labels and design a new method to learn the correlation among labels. Besides, we propose to use penalty term to allow multi-head attention to focus on different semantics. Finally, we conduct sufficient experiments on four real-world multi-turn dialogue datasets and the experimental results show that our model produces superior performance.

Balance the Labels: Hierarchical Label Structured Network for Dialogue Act Recognition

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

Local Contextual Attention with Hierarchical Structure for Dialogue Act Recognition

Dialogue Act Recognition Using Branch Architecture with Attention Mechanism for Imbalanced Data

Dialogue Act Recognition Via CRF-Attentive Structured Network

Improved Dynamic Memory Network for Dialogue Act Classification with Adversarial Training

A Dual-Attention Hierarchical Recurrent Neural Network for Dialogue Act Classification

HAIN: Multi-label Classification with Hierarchical Attention-based Interaction Network for Multi-turn Dialogue Texts

Learning Conditional Random Field with Hierarchical Representations for Dialogue Act Recognition

Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attention

Combining Heterogeneous Deep Neural Networks with Conditional Random Fields for Chinese Dialogue Act Recognition

Integrating User History into Heterogeneous Graph for Dialogue Act Recognition.

Dialogue Act Recognition Based on Self-supervised Act Denoising

Dialogue Act Sequence Labeling using Hierarchical encoder with CRF

Multi-level Gated Recurrent Neural Network for Dialog Act Classification

Hierarchical Intention Enhanced Network for Automatic Dialogue Coherence Assessment.

A Hierarchical Model for Dialog Act Recognition Considering Acoustic and Lexical Context Information

DialogAct2Vec: Towards End-to-End Dialogue Agent by Multi-Task Representation Learning

DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification.

Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog

Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning