Abstract:Text classification first needs to convert the text into embedding vectors. Considering that static word embedding models such as Word2vec do not consider the position information of word and the difference of its role in different documents, while dynamic word embedding models such as Bert consume a large amount of time. An improved word embedding model based on pre-trained Word2vec is proposed, which achieves better classification accuracy and much lower classification time than Bert. At first, the concept of Term Document Frequency (TDF) is proposed on the basis of TF-IDF, and the TF-IDF-TDF of each word in different documents is calculated. Then, The positional encoding is added. Finally, in order to reduce the misleading of words with low importance, a filter is designed to set the embedding vector with low importance to zero. Considering that the sequence length that the deep learning model can handle is limited, and the text sequence exceeding the Maximum Sequence Length (MSL) set by the deep learning model will be directly truncated and discarded, an adaptive segmentation model is proposed, which can set different segmentation strategies for different texts according to the length of the text and the MSL. In order to maintain the continuity of adjacent text after segmentation, an adjacent-segment-vector-attended co-attention network is designed. In addition, the multi-channel convolution and the capsule network are designed to further extract deep hidden features. Multiple comparative experiment results show that the proposed model achieves the best Accuracy and Micro-F1 on five long text baseline datasets and six short text baseline datasets. In addition, when the MSL is not set too large compared with the document length in the dataset, the classification results of the proposed model are not affected by it.

Text Classification Based on Paragraph Distributed Representation and Extreme Learning Machine

Extreme Learning Machine Based Transfer Learning for Data Classification.

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Text classification based on ensemble extreme learning machine

Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field

Collaborative Work with Linear Classifier and Extreme Learning Machine for Fast Text Categorization

Research on Pattern Classification Based on Double Pseudo-Inverse Extreme Learning Machine

Text Categorization Based on Regularization Extreme Learning Machine

Optimizing Extreme Learning Machine Via Generalized Hebbian Learning and Intrinsic Plasticity Learning

Data Stream Classification Based on Extreme Learning Machine

Multi-Label Classification Method Based on Extreme Learning Machines

A Deep and Stable Extreme Learning Approach for Classification and Regression

Semi-supervised and unsupervised extreme learning machines.

Text Classification with Improved Word Embedding and Adaptive Segmentation

Semi-Supervised and Unsupervised Extreme Learning Machines

A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine

A Deep Learning Short Text Classification Model Integrating Part of Speech Features

Multilayer Fisher Extreme Learning Machine for Classification

Multilayer discriminative extreme learning machine for classification

A Deep Neural Network Based on ELM for Semi-supervised Learning of Image Classification