Abstract:Text Classification is an important research area in natural language processing (NLP) that has received a considerable amount of scholarly attention in recent years. However, real Chinese online news is characterized by long text, a large amount of information and complex structure, which also reduces the accuracy of Chinese long text classification as a result. To improve the accuracy of long text classification of Chinese news, we propose a BERT-based local feature convolutional network (LFCN) model including four novel modules. First, to address the limitation of Bidirectional Encoder Representations from Transformers (BERT) on the length of the max input sequence, we propose a named Dynamic LEAD-n (DLn) method to extract short texts within the long text based on the traditional LEAD digest algorithm. In Text-Text Encoder (TTE) module, we use BERT pretrained language model to complete the sentence-level feature vector representation of a news text and to capture global features by using the attention mechanism to identify correlated words in text. After that, we propose a CNN-based local feature convolution (LFC) module to capture local features in text, such as key phrases. Finally, the feature vectors generated by the different operations over several different periods are fused and used to predict the category of a news text. Experimental results show that the new method further improves the accuracy of long text classification of Chinese news.

Short text classification based on bidirectional TCN and attention mechanism

Database Systems for Advanced Applications

Bidirectional Gated Temporal Convolution with Attention for text classification

Improving short text classification using public search engines

A text classification method based on a convolutional and bidirectional long short-term memory model

A BERT-Based Hybrid Short Text Classification Model Incorporating CNN and Attention-Based BiGRU

Feature-Enhanced Nonequilibrium Bidirectional Long Short-Term Memory Model for Chinese Text Classification

Densely Connected CNN with Multi-scale Feature Attention for Text Classification

CRAN: A Hybrid CNN-RNN Attention-Based Model for Text Classification

Chinese Text Classification Model Based On Bert And Capsule Network Structure

A Long-Text Classification Method of Chinese News Based on BERT and CNN

Text classification method based on dependency parsing and hybrid neural network

Tightly-coupled Convolutional Neural Network with Spatial-Temporal Memory for Text Classification.

Attention-based BiLSTM fused CNN with gating mechanism model for Chinese long text classification

Short Text Classification Model based on Pre-trained Language Model with Feature Fusion

Short Text Classification Improved by Feature Space Extension

Chinese text classification based on attention mechanism and feature-enhanced fusion neural network

A text classification network model combining machine learning and deep learning