Abstract:With the explosion of online communication and publication, texts become obtainable via forums, chat messages, blogs, book reviews and movie reviews. Usually, these texts are much short and noisy without sufficient statistical signals and enough information for a good semantic analysis. Traditional natural language processing methods such as Bow-of-Word (BOW) based probabilistic latent semantic models fail to achieve high performance due to the short text environment. Recent researches have focused on the correlations between words, i.e., term dependencies, which could be helpful for mining latent semantics hidden in short texts and help people to understand them. Long short-term memory (LSTM) network can capture term dependencies and is able to remember the information for long periods of time. LSTM has been widely used and has obtained promising results in variants of problems of understanding latent semantics of texts. At the same time, by analyzing the texts, we find that a number of keywords contribute greatly to the semantics of the texts. In this paper, we establish a keyword vocabulary and propose an LSTM-based model that is sensitive to the words in the vocabulary; hence, the keywords leverage the semantics of the full document. The proposed model is evaluated in a short-text sentiment analysis task on two datasets: IMDB and SemEval-2016, respectively. Experimental results demonstrate that our model outperforms the baseline LSTM by 1%~2% in terms of accuracy and is effective with significant performance enhancement over several non-recurrent neural network latent semantic models (especially in dealing with short texts). We also incorporate the idea into a variant of LSTM named the gated recurrent unit (GRU) model and achieve good performance, which proves that our method is general enough to improve different deep learning models.

Electronic Medical Record Classification Method Based on LSTM of Text Word Features Dimensionality Reduction

Cross-Domain Learning Based Traditional Chinese Medicine Medical Record Classification.

Traditional Chinese Medicine Clinical Records Classification Using Knowledge-Powered Document Embedding

Topic model based medical record classification method

Electronic Medical Data Analysis Based on Word Vector and Deep Learning Model

Medical Aided Diagnosis Using Electronic Medical Records Based On Lda And Word Vector Model

Short Text Classification of EMR Based on Entities and Dependency Parser

Improving Medical Short Text Classification with Semantic Expansion Using Word-Cluster Embedding

Improving Clinical Expertise in Large Language Models Using Electronic Medical Records

A multiclass classification method based on deep learning for named entity recognition in electronic medical records

An Efficient Method for Text Classification Task

Medical Record Text Analysis Based on Latent Semantic Analysis

Re-Structuring and Specific Similarity Computation of Electronic Medical Records

An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification

Emphasizing Essential Words for Sentiment Classification Based on Recurrent Neural Networks

Chinese Word Segmentation in Flectronic Medical Record Text via Graph Neural Network-Bidirectional LSTM-CRF Model

Medical Text Classification System Based on Deep Learning

Information Extraction from Electronic Medical Records Using Multitask Recurrent Neural Network with Contextual Word Embedding

LSTM Based Classification Model and Its Application for Doctor-Patient Relationship Evaluation

Research on Medical Text Classification Based on Improved Capsule Network

TCM Medical Record Analysis Algorithm Based on Recurrent Convolutional Neural Network