Abstract:With the development of Internet cloud technology, the scale of data is expanding. Traditional processing methods find it difficult to deal with the problem of information extraction of big data. Therefore, it is necessary to use machine-learning-assisted intelligent processing to extract information from data in order to solve the optimization problem in complex systems. There are many forms of data storage. Among them, text data is an important data type that directly reflects semantic information. Text vectorization is an important concept in natural language processing tasks. Because text data can not be directly used for model parameter training, it is necessary to vectorize the original text data and make it numerical, and then the feature extraction operation can be carried out. The traditional text digitization method is often realized by constructing a bag of words, but the vector generated by this method can not reflect the semantic relationship between words, and it also easily causes the problems of data sparsity and dimension explosion. Therefore, this paper proposes a text vectorization method combining a topic model and transfer learning. Firstly, the topic model is selected to model the text data and extract its keywords, to grasp the main information of the text data. Then, with the help of the bidirectional encoder representations from transformers (BERT) model, which belongs to the pretrained model, model transfer learning is carried out to generate vectors, which are applied to the calculation of similarity between texts. By setting up a comparative experiment, this method is compared with the traditional vectorization method. The experimental results show that the vector generated by the topic-modeling- and transfer-learning-based text vectorization (TTTV) proposed in this paper can obtain better results when calculating the similarity between texts with the same topic, which means that it can more accurately judge whether the contents of the given two texts belong to the same topic.

Quantify the Short-text for a Specific Topic

Improving Short Text Classification Through Better Feature Space Selection

A Study On Feature Weighting In Chinese Text Categorization

Improving short text classification using public search engines

Text Semantics Based Automatic Summarization for Chinese Videos

A Study of Text Vectorization Method Combining Topic Model and Transfer Learning

Chinese Text Summarization Algorithm Based on Word2vec

A Comparative Study on Feature Weight in Text Categorization

A Study of the Application of Weight Distributing Method Combining Sentiment Dictionary and TF-IDF for Text Sentiment Analysis

Text Guide: Improving the quality of long text classification by a text selection method based on feature importance

N-grams based feature selection and text representation for Chinese Text Classification

Chinese Text Categorization Based On The Binary Weighting Model With Non-Binary Smoothing

Analysis On Chinese Quantitative Stylistic Features Based On Text Mining

Don't Forget the Quantifiable Relationship between Words: Using Recurrent Neural Network for Short Text Topic Discovery.

Short Text Classification Based on Strong Feature Thesaurus

The enhancement of TextRank algorithm by using word2vec and its application on topic extraction

Extremely Short Chinese Text Classification Method Based on Bidirectional Semantic Extension

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

Short Text Topic Modeling with Topic Distribution Quantization and Negative Sampling Decoder.

Several alternative term weighting methods for text representation and classification

Discrimination of Chinese quantitative style features based on text clustering