Abstract:Text classification first needs to convert the text into embedding vectors. Considering that static word embedding models such as Word2vec do not consider the position information of word and the difference of its role in different documents, while dynamic word embedding models such as Bert consume a large amount of time. An improved word embedding model based on pre-trained Word2vec is proposed, which achieves better classification accuracy and much lower classification time than Bert. At first, the concept of Term Document Frequency (TDF) is proposed on the basis of TF-IDF, and the TF-IDF-TDF of each word in different documents is calculated. Then, The positional encoding is added. Finally, in order to reduce the misleading of words with low importance, a filter is designed to set the embedding vector with low importance to zero. Considering that the sequence length that the deep learning model can handle is limited, and the text sequence exceeding the Maximum Sequence Length (MSL) set by the deep learning model will be directly truncated and discarded, an adaptive segmentation model is proposed, which can set different segmentation strategies for different texts according to the length of the text and the MSL. In order to maintain the continuity of adjacent text after segmentation, an adjacent-segment-vector-attended co-attention network is designed. In addition, the multi-channel convolution and the capsule network are designed to further extract deep hidden features. Multiple comparative experiment results show that the proposed model achieves the best Accuracy and Micro-F1 on five long text baseline datasets and six short text baseline datasets. In addition, when the MSL is not set too large compared with the document length in the dataset, the classification results of the proposed model are not affected by it.

Document Classification Method Based on Word2vec

Knowledge-based Document Embedding for Cross-Domain Text Classification

Document Classification Based on Word Vectors

Document classification with distributions of word vectors

An Efficient Method for Document Categorization Based on Word2vec and Latent Semantic Analysis.

A VECTOR SPACE MODEL BASED DOCUMENT CLASSIFICATION SYSTEM [J]

Performance Comparison of TF*IDF, LDA and Paragraph Vector for Document Classification

Classification of E-Government Documents Based on Cooperative Expression of Word Vectors

WordNet-based Lexical Semantic Classification for Text Corpus Analysis

A document feature extraction method based on concept-word list

A Method of Feature Selection Based on Word2Vec in Text Categorization

Document Vector Extension for Documents Classification

Document Classification with Spherical Word Vectors

Classifying web documents using term spectral transforms and Multi-Dimensional Latent Semantic representation

Chinese semantic document classification based on strategies of semantic similarity computation and correlation analysis

Bag of Meta-Words: A Novel Method to Represent Document for the Sentiment Classification

Research of Chinese Text Classification Methods Based on Semantic Vector and Semantic Similarity

Generating Word and Document Matrix Representations for Document Classification

Text Classification with Improved Word Embedding and Adaptive Segmentation

Document Classification Based on Support Vector Machine Using a Concept Vector Model

An Improved Document Classification Approach with Maximum Entropy and Entropy Feature Selection