Abstract:<p>Natural language processing (NLP) is useful for handling text and speech, and sequence labeling plays an important role by automatically analyzing a sequence (text) to assign category labels to each part. However, the performance of these conventional models depends greatly on hand-crafted features and task-specific knowledge, which is a time consuming task. Several conditional random fields (CRF)-based models for sequence labeling have been presented, but the major limitation is how to use neural networks for extracting useful representations for each unit or segment in the input sequence. In this paper, we propose an attention segmental recurrent neural network (ASRNN) that relies on a hierarchical attention neural semi-Markov conditional random fields (semi-CRF) model for the task of sequence labeling. Our model uses a hierarchical structure to incorporate character-level and word-level information and applies an attention mechanism to both levels. This enables our method to differentiate more important information from less important information when constructing the segmental representation. We evaluated our model on three sequence labeling tasks, including named entity recognition (NER), chunking, and reference parsing. Experimental results show that the proposed model benefited from the hierarchical structure, and it achieved competitive and robust performance on all three sequence labeling tasks.</p>

Attention Recurrent Neural Networks for Image-Based Sequence Text Recognition.

Recurrent Attention Unit

Recurrent attention unit: A new gated recurrent unit for long-term memory of important parts in sequential data

Attention-Based Recurrent Neural Network for Sequence Labeling.

ASRNN: A recurrent neural network with an attention model for sequence labeling

Recurrent Attention Networks for Long-text Modeling

Recurrent Highway Networks with Attention Mechanism for Scene Text Recognition

Adaptive Embedding Gate for Attention-Based Scene Text Recognition.

Learning Attentional Recurrent Neural Network for Visual Tracking

Deep Neural Network with Attention Model for Scene Text Recognition.

Sequential Alignment Attention Model for Scene Text Recognition

Attention-based Recurrent Convolutional Neural Network for Automatic Essay Scoring.

An Attention-aware Bidirectional Multi-residual Recurrent Neural Network (Abmrnn): A Study about Better Short-term Text Classification

Text-to-Image Generation with Attention Based Recurrent Neural Networks

Recurrent Attention LSTM Model for Image Chinese Caption Generation

ReADS: A Rectified Attentional Double Supervised Network for Scene Text Recognition

Attention-gated LSTM for Image Captioning

An Attention-based C-GRU Neural Network for Text Classification

Recurrent Networks with Attention and Convolutional Networks for Sentence Representation and Classification

End-to-End Language Identification Using Attention-Based Recurrent Neural Networks

Recurrently Controlled Recurrent Networks