Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Investigating Lstm with K-Max Pooling for Text Classification

Database Systems for Advanced Applications

Improving Short Text Classification Through Better Feature Space Selection

Recurrent Convolutional Neural Networks for Text Classification

Chinese Text Classification Based on Hybrid Model of CNN and LSTM

Interpretable Text Classification Using CNN and Max-pooling

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Max-pooling Loss Training of Long Short-Term Memory Networks for Small-Footprint Keyword Spotting

Local Bidirectional Long Short Term Memory for Text Classification

Chinese Text Classification Model Based on Deep Learning

Research of Text Classification Based on TF-IDF and CNN-LSTM

Convolutional Neural Networks for Text Classification with Multi-size Convolution and Multi-type Pooling.

Feature-enhanced text-inception model for Chinese long text classification

A C-LSTM Neural Network for Text Classification

Integrating Bidirectional LSTM with Inception for Text Classification

Text Sentiment Classification Based on Improved BiLSTM-CNN

Investigating Siamese LSTM networks for text categorization

Long short-term memory (LSTM)-based news classification model

KSCB: a novel unsupervised method for text sentiment analysis