Abstract:With the development of Internet cloud technology, the scale of data is expanding. Traditional processing methods find it difficult to deal with the problem of information extraction of big data. Therefore, it is necessary to use machine-learning-assisted intelligent processing to extract information from data in order to solve the optimization problem in complex systems. There are many forms of data storage. Among them, text data is an important data type that directly reflects semantic information. Text vectorization is an important concept in natural language processing tasks. Because text data can not be directly used for model parameter training, it is necessary to vectorize the original text data and make it numerical, and then the feature extraction operation can be carried out. The traditional text digitization method is often realized by constructing a bag of words, but the vector generated by this method can not reflect the semantic relationship between words, and it also easily causes the problems of data sparsity and dimension explosion. Therefore, this paper proposes a text vectorization method combining a topic model and transfer learning. Firstly, the topic model is selected to model the text data and extract its keywords, to grasp the main information of the text data. Then, with the help of the bidirectional encoder representations from transformers (BERT) model, which belongs to the pretrained model, model transfer learning is carried out to generate vectors, which are applied to the calculation of similarity between texts. By setting up a comparative experiment, this method is compared with the traditional vectorization method. The experimental results show that the vector generated by the topic-modeling- and transfer-learning-based text vectorization (TTTV) proposed in this paper can obtain better results when calculating the similarity between texts with the same topic, which means that it can more accurately judge whether the contents of the given two texts belong to the same topic.

Feature vector optimization method for text classification

Improving Short Text Classification Through Better Feature Space Selection

A Novel Feature Selection Approach and Feature Weight Adjustment Technique in Text Classification

A comprehensive unsupervised feature selection method of two-stage strategy

Improving short text classification using public search engines

A Technique For Improving The Performance Of Naive Bayes Text Classification

Using boosting mechanism to refine the threshold of VSM-based similarity in text classification

CWC: A Clustering-Based Feature Weighting Approach for Text Classification

A Study On Feature Weighting In Chinese Text Categorization

A Study of Text Vectorization Method Combining Topic Model and Transfer Learning

N-grams based feature selection and text representation for Chinese Text Classification

A Model-based Feature Optimization Approach to Chinese Language Processing.

A Model-based Feature Optimization Approach to Chinese Language Processing

WordNet-based Concept Vector Space Model for Text Classification

An Effective Feature Selection Method For Text Categorization

Design and analysis of a general vector space model for data classification in Internet of Things

Research of Chinese Text Classification Methods Based on Semantic Vector and Semantic Similarity

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

An Automatic Chinese-Text Classifier Based on Vector Space Model

Study on Web Text Feature Selection Based on Rough Set.