Abstract:With the development of Internet cloud technology, the scale of data is expanding. Traditional processing methods find it difficult to deal with the problem of information extraction of big data. Therefore, it is necessary to use machine-learning-assisted intelligent processing to extract information from data in order to solve the optimization problem in complex systems. There are many forms of data storage. Among them, text data is an important data type that directly reflects semantic information. Text vectorization is an important concept in natural language processing tasks. Because text data can not be directly used for model parameter training, it is necessary to vectorize the original text data and make it numerical, and then the feature extraction operation can be carried out. The traditional text digitization method is often realized by constructing a bag of words, but the vector generated by this method can not reflect the semantic relationship between words, and it also easily causes the problems of data sparsity and dimension explosion. Therefore, this paper proposes a text vectorization method combining a topic model and transfer learning. Firstly, the topic model is selected to model the text data and extract its keywords, to grasp the main information of the text data. Then, with the help of the bidirectional encoder representations from transformers (BERT) model, which belongs to the pretrained model, model transfer learning is carried out to generate vectors, which are applied to the calculation of similarity between texts. By setting up a comparative experiment, this method is compared with the traditional vectorization method. The experimental results show that the vector generated by the topic-modeling- and transfer-learning-based text vectorization (TTTV) proposed in this paper can obtain better results when calculating the similarity between texts with the same topic, which means that it can more accurately judge whether the contents of the given two texts belong to the same topic.

Word vector learning model training method and server

Knowledge-based Document Embedding for Cross-Domain Text Classification

Knowledge representation learning method in combination with entity images and server

Sentence Vector Model Based on Implicit Word Vector Expression

Domain-specific website recognition using hybrid vector space model

Electronic Medical Data Analysis Based on Word Vector and Deep Learning Model

A practical investigation of cultivating students’ art innovation ability based on word vector model

Improved Learning of Chinese Word Embeddings with Semantic Knowledge.

Automatic vocabulary primitive prediction method and device

A Study of Text Vectorization Method Combining Topic Model and Transfer Learning

Using Big Data From The Web To Train Chinese Traffic Word Representation Model In Vector Space

Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection

Improving Word Vector Model with Part-of-speech and Dependency Grammar Information

Cross-language vocabulary synonym prediction method and device and electronic equipment

Msam: A Multi-Layer Bi-Lstm Based Speech To Vector Model With Residual Attention Mechanism

Improving Word Vector with Prior Knowledge in Semantic Dictionary.

Semi-supervised learning of word embeddings

Non-autoregressive neural machine translation method and device, computer device and medium

Learning Sparse Overcomplete Word Vectors Without Intermediate Dense Representations

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

Word Vector Enrichment of Low Frequency Words in the Bag-of-Words Model for Short Text Multi-class Classification Problems