Abstract:Text classification first needs to convert the text into embedding vectors. Considering that static word embedding models such as Word2vec do not consider the position information of word and the difference of its role in different documents, while dynamic word embedding models such as Bert consume a large amount of time. An improved word embedding model based on pre-trained Word2vec is proposed, which achieves better classification accuracy and much lower classification time than Bert. At first, the concept of Term Document Frequency (TDF) is proposed on the basis of TF-IDF, and the TF-IDF-TDF of each word in different documents is calculated. Then, The positional encoding is added. Finally, in order to reduce the misleading of words with low importance, a filter is designed to set the embedding vector with low importance to zero. Considering that the sequence length that the deep learning model can handle is limited, and the text sequence exceeding the Maximum Sequence Length (MSL) set by the deep learning model will be directly truncated and discarded, an adaptive segmentation model is proposed, which can set different segmentation strategies for different texts according to the length of the text and the MSL. In order to maintain the continuity of adjacent text after segmentation, an adjacent-segment-vector-attended co-attention network is designed. In addition, the multi-channel convolution and the capsule network are designed to further extract deep hidden features. Multiple comparative experiment results show that the proposed model achieves the best Accuracy and Micro-F1 on five long text baseline datasets and six short text baseline datasets. In addition, when the MSL is not set too large compared with the document length in the dataset, the classification results of the proposed model are not affected by it.

Semantic Enhancement and Multi-level Label Embedding for Chinese News Headline Classification

A Semantic Representation Enhancement Method for Chinese News Headline Classification.

Hybrid Decision Based Chinese News Headline Classification

Text classification of Chinese news based on multi-scale CNN and LSTM hybrid model

Chinese Short Text Classification Based on Interactive Attention Mechanism

A Local Information Perception Enhancement–Based Method for Chinese NER

Semantic Role Labeling Integrated with Multilevel Linguistic Cues and Bi-LSTM-CRF

A Long-Text Classification Method of Chinese News Based on BERT and CNN

Chinese News Event 5W1H Elements Extraction Using Semantic Role Labeling

Chinese text classification method based on sentence information enhancement and feature fusion

Chinese Text Classification Based on Hybrid Model of CNN and LSTM

Long short-term memory (LSTM)-based news classification model

A News Headlines Classification Method Based on the Fusion of Related Words.

Semantic Embedded Deep Neural Network: A Generic Approach to Boost Multi-Label Image Classification Performance

Optimizing News Text Classification with Bi-LSTM and Attention Mechanism for Efficient Data Processing

Chinese text classification based on attention mechanism and feature-enhanced fusion neural network

NewsEmbed: Modeling News through Pre-trained Document Representations

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Text Classification with Improved Word Embedding and Adaptive Segmentation