Abstract:Sequence labeling is a crucial task in the NLP community that aims at identifying and assigning spans within the input sentence. It has wide applications in various fields such as information extraction, dialogue system, and sentiment analysis. However, previously proposed span-based or sequence-to-sequence models conduct locating and assigning in order, resulting in problems of error propagation and unnecessary training loss, respectively. This paper addresses the problem by reformulating the sequence labeling as a non-autoregressive set generation to realize locating and assigning in parallel. Herein, we propose a Dual-Query Set Generation (DQSetGen) model for unified sequence labeling tasks. Specifically, the dual-query set, including a prompted type query and a positional query with anchor span, is fed into the non-autoregressive decoder to probe the spans which correspond to the positional query and have similar patterns with the type query. By avoiding the autoregressive nature of previous approaches, our method significantly improves efficiency and reduces error propagation. Experimental results illustrate that our approach can obtain superior performance on 5 sub-tasks across 11 benchmark datasets. The non-autoregressive nature of our method allows for parallel computation, achieving faster inference speed than compared baselines. In conclusion, our proposed non-autoregressive dual-query set generation method offers a more efficient and accurate approach to sequence labeling tasks in NLP. Its advantages in terms of performance and efficiency make it a promising solution for various applications in data mining and other related fields.

Sequence Labeling with Deep Gated Dual Path CNN.

GNN-SL: Sequence Labeling Based on Nearest Examples Via GNN

A Two-Stage Deep Neural Network for Sequence Labeling.

Attention-Based Recurrent Neural Network for Sequence Labeling.

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labeling

Convolutional Neural Networks with Intra-Layer Recurrent Connections for Scene Labeling

A Sequence Labeling Convolutional Network and Its Application to Handwritten String Recognition.

Dual Adversarial Transfer for Sequence Labeling

Scene Labeling using Gated Recurrent Units with Explicit Long Range Conditioning

Hierarchical Video Frame Sequence Representation with Deep Convolutional Graph Network

Jointly Trained Sequential Labeling and Classification by Sparse Attention Neural Networks.

Gated Neural Network with Regularized Loss for Multi-label Text Classification.

Label Attention Network for Structured Prediction

A Survey on Recent Advances in Sequence Labeling from Deep Learning Models

Sequence Labeling as Non-autoregressive Dual-Query Set Generation

Part-Level Sketch Segmentation and Labeling Using Dual-CNN

Outdoor Scene Labeling Using Deep Convolutional Neural Networks

Incorporating Deep Syntactic and Semantic Knowledge for Chinese Sequence Labeling with GCN

Automatic Labeling of Large Amounts of Handwritten Characters with Gate-Guided Dynamic Deep Learning

GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition.