Abstract:In response to the low accuracy of Chinese short text classification in the current data mining field and the defects of existing deep learning models with more model parameters and higher time complexity, this paper proposes a new text classification model - short text classification model (ACBSM) based on pre-trained language model with feature expansion. In ACBSM, to address the problem of high dimensionality of text data without accurate text representation, the Bert model is used to train word vector representation to solve the problem of multiple meanings of a word. From the parallelization acceleration level, a parallel acceleration strategy of two-channel neural network is designed to improve the efficiency of the algorithm in processing massive data. To address the sparsity of text data and the more complex semantics, an attention mechanism is introduced and a CNN model is used to enhance the extraction of keyword information; secondly, BiSRU is used to capture the contextual features of the text, and finally, experimental validation is conducted on a news dataset. The experimental results show that ACBSM improves the accuracy of text classification to 95.83% under the same environment and dataset, and its classification performance is better than other text classification methods.

Enhancing BERT for Short Text Classification with Latent Information

Chinese Text Classification Using BERT and Flat-Lattice Transformer.

Improving Short Text Classification Through Better Feature Space Selection

Improving short text classification using public search engines

Short-Text Classification Detector: A Bert-Based Mental Approach

Global Semantic Information Extraction Model for Chinese long text classification based on fine-tune BERT

An Enhanced Short Text Categorization Model with Deep Abundant Representation

End-to-end Learning for Short Text Expansion

Collaborative Work with Linear Classifier and Extreme Learning Machine for Fast Text Categorization

Enhancing Text Classification with Attention Matrices Based on BERT

Improving Multi-model Hybrid Chinese Long-text Classification Through BERT Optimisation.

Topic Memory Networks for Short Text Classification

Short Text Classification Model based on Pre-trained Language Model with Feature Fusion

Modeling over Short Texts

Long Text Classification Based on BERT

Short Text Classification Improved by Feature Space Extension

A BERT-Based Hybrid Short Text Classification Model Incorporating CNN and Attention-Based BiGRU

Short Text Classification Based on Strong Feature Thesaurus

Feature-enhanced text-inception model for Chinese long text classification

Leap-LSTM: Enhancing Long Short-Term Memory for Text Categorization

CogLTX: Applying BERT to Long Texts.