Abstract:With the development of Internet cloud technology, the scale of data is expanding. Traditional processing methods find it difficult to deal with the problem of information extraction of big data. Therefore, it is necessary to use machine-learning-assisted intelligent processing to extract information from data in order to solve the optimization problem in complex systems. There are many forms of data storage. Among them, text data is an important data type that directly reflects semantic information. Text vectorization is an important concept in natural language processing tasks. Because text data can not be directly used for model parameter training, it is necessary to vectorize the original text data and make it numerical, and then the feature extraction operation can be carried out. The traditional text digitization method is often realized by constructing a bag of words, but the vector generated by this method can not reflect the semantic relationship between words, and it also easily causes the problems of data sparsity and dimension explosion. Therefore, this paper proposes a text vectorization method combining a topic model and transfer learning. Firstly, the topic model is selected to model the text data and extract its keywords, to grasp the main information of the text data. Then, with the help of the bidirectional encoder representations from transformers (BERT) model, which belongs to the pretrained model, model transfer learning is carried out to generate vectors, which are applied to the calculation of similarity between texts. By setting up a comparative experiment, this method is compared with the traditional vectorization method. The experimental results show that the vector generated by the topic-modeling- and transfer-learning-based text vectorization (TTTV) proposed in this paper can obtain better results when calculating the similarity between texts with the same topic, which means that it can more accurately judge whether the contents of the given two texts belong to the same topic.

A Study of Text Vectorization Method Combining Topic Model and Transfer Learning

Study on Key Technology for Topic Tracking

Study on Keyword-Based Text Vectorization and Classification Algorithm

Research on Text Similarity Computing Based on Word Vector Model of Neural Networks

Learning Semantic Textual Similarity Via Topic-informed Discrete Latent Variables

The enhancement of TextRank algorithm by using word2vec and its application on topic extraction

Study on Key Technology of Topic Tracking Based on SVM

Quantify the Short-text for a Specific Topic

Continuous-bag-of-words and Skip-gram for word vector training and text classification

Topical Paragraph Vector learning

Using Big Data From The Web To Train Chinese Traffic Word Representation Model In Vector Space

Topic Model over Short Texts Incorporating Word Embedding

Combining Vector Space Features and Convolution Neural Network for Text Sentiment Analysis.

A text-Image feature mapping algorithm based on transfer learning

Vector-Quantization-Based Topic Modeling

Short text topic modeling method based on word semantic similarity

Topic Modeling for Short Texts Via Dual View Collaborate Optimization

Study on Topic Tracking System Based on KNN

Study on Feature Selection Algorithm in Topic Tracking.

Topic Modeling for Large-Scale Text Data

An Intelligent CNN-VAE Text Representation Technology Based on Text Semantics for Comprehensive Big Data