Abstract:Text classification first needs to convert the text into embedding vectors. Considering that static word embedding models such as Word2vec do not consider the position information of word and the difference of its role in different documents, while dynamic word embedding models such as Bert consume a large amount of time. An improved word embedding model based on pre-trained Word2vec is proposed, which achieves better classification accuracy and much lower classification time than Bert. At first, the concept of Term Document Frequency (TDF) is proposed on the basis of TF-IDF, and the TF-IDF-TDF of each word in different documents is calculated. Then, The positional encoding is added. Finally, in order to reduce the misleading of words with low importance, a filter is designed to set the embedding vector with low importance to zero. Considering that the sequence length that the deep learning model can handle is limited, and the text sequence exceeding the Maximum Sequence Length (MSL) set by the deep learning model will be directly truncated and discarded, an adaptive segmentation model is proposed, which can set different segmentation strategies for different texts according to the length of the text and the MSL. In order to maintain the continuity of adjacent text after segmentation, an adjacent-segment-vector-attended co-attention network is designed. In addition, the multi-channel convolution and the capsule network are designed to further extract deep hidden features. Multiple comparative experiment results show that the proposed model achieves the best Accuracy and Micro-F1 on five long text baseline datasets and six short text baseline datasets. In addition, when the MSL is not set too large compared with the document length in the dataset, the classification results of the proposed model are not affected by it.

TextANN: An Improved Text Classification Model Based on Data Augmentation

Improving Short Text Classification Through Better Feature Space Selection

Data Augmentation Methods for Enhancing Robustness in Text Classification Tasks

Data Augmentation With Semantic Enrichment for Deep Learning Invoice Text Classification

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation

A text matching model based on dynamic multi‐mask and augmented adversarial

Supervised Contrast Learning Text Classification Model Based on Data Quality Augmentation

Improving Text Classification with Large Language Model-Based Data Augmentation

AUG-BERT: An Efficient Data Augmentation Algorithm for Text Classification

DAGAM: Data Augmentation with Generation And Modification

Data Augmentation for Sentiment Classification with Semantic Preservation and Diversity

What Have Been Learned & What Should Be Learned? An Empirical Study of How to Selectively Augment Text for Classification

STA: Self-controlled Text Augmentation for Improving Text Classifications

Large Model-Based Data Augmentation for Imbalanced Text Classification

Chinese Short Text Classification Based on Interactive Attention Mechanism

Research on automatic labeling of imbalanced texts of customer complaints based on text enhancement and layer-by-layer semantic matching

Text Classification with Improved Word Embedding and Adaptive Segmentation

Random Text Perturbations Work, but not Always

Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification

Text Classification Based On A Combination Of Ontology With Statistical Method