Abstract:<p>Natural language processing (NLP) is useful for handling text and speech, and sequence labeling plays an important role by automatically analyzing a sequence (text) to assign category labels to each part. However, the performance of these conventional models depends greatly on hand-crafted features and task-specific knowledge, which is a time consuming task. Several conditional random fields (CRF)-based models for sequence labeling have been presented, but the major limitation is how to use neural networks for extracting useful representations for each unit or segment in the input sequence. In this paper, we propose an attention segmental recurrent neural network (ASRNN) that relies on a hierarchical attention neural semi-Markov conditional random fields (semi-CRF) model for the task of sequence labeling. Our model uses a hierarchical structure to incorporate character-level and word-level information and applies an attention mechanism to both levels. This enables our method to differentiate more important information from less important information when constructing the segmental representation. We evaluated our model on three sequence labeling tasks, including named entity recognition (NER), chunking, and reference parsing. Experimental results show that the proposed model benefited from the hierarchical structure, and it achieved competitive and robust performance on all three sequence labeling tasks.</p>

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

Citation Metadata Extraction Via Deep Neural Network-based Segment Sequence Labeling

A Two-Stage Deep Neural Network for Sequence Labeling.

GNN-SL: Sequence Labeling Based on Nearest Examples Via GNN

Attention-Based Recurrent Neural Network for Sequence Labeling.

Label Attention Network for Structured Prediction

Sequence Labeling with Deep Gated Dual Path CNN.

RoSeq: Robust Sequence Labeling.

Empower Sequence Labeling with Task-Aware Neural Language Model

Hybrid Semi-Markov CRF for Neural Sequence Labeling.

Named Entity Recognition with Bidirectional LSTM-CNNs

Bidirectional LSTM-CRF Models for Sequence Tagging

Enhancing Neural Sequence Labeling with Position-Aware Self-Attention.

A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding.

Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence Labeler.

Jointly Trained Sequential Labeling and Classification by Sparse Attention Neural Networks.

Learning Label-Relational Output Structure for Adaptive Sequence Labeling

ASRNN: A recurrent neural network with an attention model for sequence labeling

LM Enhanced BiRNN-CRF for Joint Chinese Word Segmentation and POS Tagging.

CCG Supertagging Via Bidirectional LSTM-CRF Neural Architecture

Labeling Sequential Data Based on Word Representations and Conditional Random Fields